-- Logs begin at Fri 2021-08-27 00:41:25 UTC, end at Fri 2021-08-27 01:51:36 UTC. -- Aug 27 01:12:44.795235 dv-cinder-759169-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 27 01:12:44.804623 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 27 01:12:44.806669 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 27 01:12:44 2021] *** Aug 27 01:12:44.806669 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 01:12:44.806669 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 01:12:44.806669 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: nodename: dv-cinder-759169-3-iscsi Aug 27 01:12:44.806669 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: machine: x86_64 Aug 27 01:12:44.806669 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: clock source: unix Aug 27 01:12:44.806669 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: pcre jit disabled Aug 27 01:12:44.806669 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: detected number of CPU cores: 4 Aug 27 01:12:44.806669 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: current working directory: / Aug 27 01:12:44.806669 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: detected binary path: /usr/bin/uwsgi-core Aug 27 01:12:44.806669 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: your processes number limit is 47680 Aug 27 01:12:44.807241 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: your memory page size is 4096 bytes Aug 27 01:12:44.807241 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: detected max file descriptor number: 2048 Aug 27 01:12:44.807241 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: lock engine: pthread robust mutexes Aug 27 01:12:44.807241 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: thunder lock: enabled Aug 27 01:12:44.807241 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 27 01:12:44.807241 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 27 01:12:44.851465 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: Python main interpreter initialized at 0x56541369f9c0 Aug 27 01:12:44.851465 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: python threads support enabled Aug 27 01:12:44.851465 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: your server socket listen backlog is limited to 100 connections Aug 27 01:12:44.851465 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: your mercy for graceful operations on workers is 90 seconds Aug 27 01:12:44.851814 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 01:12:44.851888 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: *** Operational MODE: preforking *** Aug 27 01:12:44.852155 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: *** uWSGI is running in multiple interpreter mode *** Aug 27 01:12:44.852155 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: spawned uWSGI master process (pid: 73666) Aug 27 01:12:44.852354 dv-cinder-759169-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 27 01:12:44.854763 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: spawned uWSGI worker 1 (pid: 73678, cores: 1) Aug 27 01:12:44.854763 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: spawned uWSGI worker 2 (pid: 73679, cores: 1) Aug 27 01:12:44.854763 dv-cinder-759169-3-iscsi devstack@keystone.service[73666]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 01:12:50.015857 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 01:12:50.015857 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: from cryptography.utils import int_from_bytes Aug 27 01:12:50.016669 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 01:12:50.016669 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: from cryptography.utils import int_from_bytes Aug 27 01:12:50.017128 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 01:12:50.017128 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: from cryptography.utils import int_from_bytes Aug 27 01:12:50.017230 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 01:12:50.017230 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: from cryptography.utils import int_from_bytes Aug 27 01:12:50.065336 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 01:12:50.065541 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 01:12:50.065733 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] command line args: [] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 01:12:50.066009 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 01:12:50.066157 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 01:12:50.066251 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ================================================================================ {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 01:12:50.066438 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] admin_token = **** {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.066522 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 01:12:50.066644 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] command line args: [] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 01:12:50.066728 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] config_dir = [] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.066855 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.066942 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 01:12:50.067040 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] config_source = [] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.067123 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ================================================================================ {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 01:12:50.067221 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] debug = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.067332 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] admin_token = **** {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.067491 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.067681 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] config_dir = [] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.067744 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.067800 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.067934 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] config_source = [] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.068041 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.068151 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] debug = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.068255 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.068352 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.068476 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.068579 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.068695 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] list_limit = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.068798 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.068938 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] log_config_append = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.069043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.069144 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.069144 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] log_dir = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.069333 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.069434 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] log_file = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.069541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] list_limit = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.069636 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.069749 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] log_config_append = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.069749 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.069943 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.070064 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] log_dir = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.070144 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.070259 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] log_file = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.070338 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.070470 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.070551 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.070627 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.070747 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.070747 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.070926 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.071007 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.071083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.071200 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.071272 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.071389 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.071475 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.071576 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.071661 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.071822 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.071899 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.072057 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.072213 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.072299 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.072375 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.072508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.072596 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.072744 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.073014 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.073094 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.073257 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] publish_errors = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.073335 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.073496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.073582 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.073728 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.073907 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.074009 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.074154 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.074234 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] publish_errors = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.074388 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.074470 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.074622 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] standard_threads = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.074719 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.074800 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.074869 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.075030 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.075115 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.075243 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.075320 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.075420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] use_journal = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.075502 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] standard_threads = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.075596 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] use_json = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.075707 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.075790 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] use_stderr = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.075931 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] use_syslog = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.076007 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.076114 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.076188 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.076291 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] use_journal = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.076411 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.076487 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] use_json = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.076630 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] use_stderr = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.076706 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.076806 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] use_syslog = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.076916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.077059 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:12:50.077143 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.077318 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.077404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.077558 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.077646 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.077819 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.077903 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.078108 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.078190 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.078977 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.079378 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.079454 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.079524 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.079593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.079661 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.079730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.079848 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.079981 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.080099 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.080218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.080335 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.080464 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.080568 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.080681 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.080789 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.080962 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.081043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.081199 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.081287 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.081448 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.081528 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.081687 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.082065 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.082174 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.082258 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.082430 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.082509 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.082677 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.082755 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.082915 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.082992 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.083138 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.083206 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.083363 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.083446 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.083593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.083678 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.083827 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.083912 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.084075 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.084158 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.084322 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.084406 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.084551 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.084629 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.084780 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.084898 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.085054 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.085125 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.085297 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.085375 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.085526 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.085603 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.085759 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.085836 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.085984 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.086064 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.086218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.086303 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.086448 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.086525 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.086681 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.086766 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.086912 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.086999 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.087140 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.087230 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.087370 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.087456 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.087603 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.087686 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.087834 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.087914 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.088069 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.088155 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.088303 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.088382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.088541 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.088621 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.088775 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.088922 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.089034 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.089114 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.089275 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.089353 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.089504 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.089588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.089740 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.089817 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.089973 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.090050 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.090207 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.090293 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.090438 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.090515 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.090670 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.090752 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.090900 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.090995 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.091134 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.091218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.091369 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.091446 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.091611 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.091695 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.091841 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.091917 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.092090 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.092173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.092323 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.092409 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.092553 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.092631 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.092784 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.092888 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.093044 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.093130 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.093293 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.093379 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.093527 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.093603 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.093780 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.093929 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.094066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.094278 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.094359 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.094472 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.094550 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.094760 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.094900 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.094979 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.095160 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.095237 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.095402 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.095488 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.095654 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.095738 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.095895 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.095973 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.096133 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.096219 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.096370 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.096447 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.096598 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.096682 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.096862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.096959 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.097079 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.097166 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.097312 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.097391 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.097541 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.097628 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.097778 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.097856 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.098012 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.098089 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.098242 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.098327 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.098480 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.098557 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.098713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.098790 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.098944 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.099023 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.099185 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.099263 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.099421 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.099499 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] auth.external = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.099648 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.099732 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.099894 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.099970 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.100151 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.100236 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.100379 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] auth.password = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.100458 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.100609 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] auth.token = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.100686 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.100908 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.100989 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] auth.external = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.101092 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.101173 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.101339 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.101417 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.101573 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.101651 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.101822 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.101902 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] auth.password = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.102060 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] auth.token = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.102136 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.102288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.102365 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.102513 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] credential.caching = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.102588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.102754 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.102832 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.102983 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.103059 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.103231 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.103341 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.103464 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.103549 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.103700 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.103778 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.103930 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.104015 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] credential.caching = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.104176 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.104261 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.104423 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.104503 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.104673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.104752 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.104934 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.105018 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.105182 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.105287 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.105419 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.105546 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.105665 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.105822 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.105923 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.106065 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.106164 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.106323 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.106411 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.106559 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] federation.caching = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.106686 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.106797 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.106933 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.107063 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.107196 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.107311 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.107439 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.107542 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.107698 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.107777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.107934 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] federation.caching = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.108014 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.108172 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.108251 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.108443 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.108523 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.108693 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.108774 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.108948 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.109030 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.109198 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.109280 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.109431 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] identity.caching = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.109511 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.109807 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.110269 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.110269 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.110423 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.110497 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.110567 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.110641 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.110710 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.110786 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.110865 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.110938 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.111045 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] identity.caching = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.111170 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.111295 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.111420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.111543 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.111675 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.111781 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.111907 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.112017 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.112139 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.112266 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.112369 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.112497 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.112613 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.112736 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.112877 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.113009 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.113127 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.113260 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.113382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.113493 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.113629 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.113718 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.113899 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.113977 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.114135 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.114213 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.114372 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.114459 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.114603 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.114681 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.114838 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.114916 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.115067 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.115156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.115302 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.115404 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.115543 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.115646 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.115782 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.115889 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.116028 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.116108 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.116258 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.116337 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.116504 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.116591 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.116750 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.116928 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.117017 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.117099 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.117241 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.117329 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.117486 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.117565 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.117714 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.117798 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.117950 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.118037 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.118179 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.118257 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.118414 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.118492 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.118648 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.118807 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.118889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.118999 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.119108 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.119235 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.119342 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.119561 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.119643 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.119801 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.119880 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.120043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.120122 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.120270 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.120349 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.120510 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.120588 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.120762 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.120926 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.121031 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.121107 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.121234 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.121320 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.121483 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.121583 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.121739 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.user = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.121878 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.122007 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.122132 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.122259 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.122394 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.122394 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.122644 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.122644 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.122883 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.123009 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.123142 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.123271 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.123396 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.123520 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.user = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.123645 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.123770 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.123905 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.123905 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.124142 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.124277 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.124403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.124528 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.124660 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.124785 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.124962 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.125583 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.125781 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.126156 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.126323 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.126459 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.126588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.126716 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.126841 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.126981 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.126981 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.127230 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.127355 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.127481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.127606 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.127737 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.127871 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.127998 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.128125 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.128250 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.128401 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.128518 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.128662 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.128789 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.128928 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.129054 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.129181 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.129305 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.129440 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.129565 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.129690 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.129815 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.129940 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.130065 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.130202 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.130327 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.130461 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.130586 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.130711 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.130836 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.130968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.131094 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.131220 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.131344 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.131469 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.131594 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.131726 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.131851 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.131971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] resource.caching = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.132092 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.132227 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.132353 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.132486 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.132612 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.132736 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.132874 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.132993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.133117 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.133252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.133380 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.133505 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.133629 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.133773 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.133915 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.134055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.134182 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] resource.caching = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.134307 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.134439 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.134563 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] role.caching = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.134693 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.134826 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] role.driver = sql {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.134951 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.135075 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.135199 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.135323 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.135450 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.135582 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.135718 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.135843 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.135967 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.136095 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.136214 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.136347 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.136475 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.136600 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.136724 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] role.caching = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.136864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.136996 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] role.driver = sql {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.137122 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.137248 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.137372 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.137506 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.137631 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.137763 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.137890 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.138015 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.138140 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.138266 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.138391 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.138529 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.138529 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.138768 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.138893 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.139018 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.139153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.139288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.139414 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.139540 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.139665 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.139790 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.139915 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.140075 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.140194 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.140321 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.140445 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.140575 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.140575 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.141424 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.141547 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.141669 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.141795 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.141921 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.142045 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.142179 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.142304 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.142429 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.142559 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.142684 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.142823 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.142950 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.143085 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.143210 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.143335 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.143460 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.143593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.143593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.143831 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.143957 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] token.caching = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.143957 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.144188 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.144387 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.144515 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.144640 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.144765 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.144915 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.145043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.145179 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.145304 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.145429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.145553 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.145685 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.145810 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.145943 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.146070 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.146198 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.146323 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.146447 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.146580 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] token.caching = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.146713 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.146839 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.146964 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.147089 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.147213 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.147338 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.147470 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.147595 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.147720 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.147844 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.147969 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.148095 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.148227 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.148361 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.148486 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] database.connection = **** {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.148611 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.148736 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.148896 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.149029 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.149155 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.149280 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.149404 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.149529 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.149653 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.149788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.149913 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.150039 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.150174 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.150299 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.150424 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.150556 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.150680 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.150805 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.150929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.151054 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.151181 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] database.connection = **** {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.151313 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.151446 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.151582 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.151707 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.151832 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.151966 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.152091 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.152226 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.152351 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.152475 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.152600 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.152725 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.152863 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.152994 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.153115 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.153115 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 01:12:50.153345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.153345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.153345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.153345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.153345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.153345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.153345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.153345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.153345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.154350 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.154350 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:12:50.154350 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 01:12:50.180047 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.180275 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.180494 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.182100 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.182336 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.182562 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.189705 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.191643 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.218733 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.218991 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.220755 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.221014 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.272155 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.273360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.323798 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.324029 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.391514 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.391806 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.393670 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.393893 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.394118 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.394343 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.394559 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.394771 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.437294 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.437575 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.437823 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.438172 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.438546 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.438885 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.462680 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.462917 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.463127 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.463351 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.463577 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.463795 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.464012 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.479608 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.494936 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.495153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.495384 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.495608 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.495829 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.496046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.496261 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.499474 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.499706 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.499925 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.500168 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.500406 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.500649 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.500972 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.508561 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.511577 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.511806 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.512027 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.512245 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.512460 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.512672 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.512914 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 01:12:50.513395 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.513603 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 01:12:50.513940 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.514141 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 01:12:50.514409 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.514670 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.514928 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.515186 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.523614 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.523768 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 01:12:50.524098 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.524295 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 01:12:50.524762 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.525125 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.525404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.525660 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.526421 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.526699 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.526971 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.527254 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.536269 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.536896 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.537171 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.537447 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.537723 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.539507 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.539787 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.540068 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.540352 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.540634 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.540926 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.541197 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.541470 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.541742 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.542016 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.542284 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.545783 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.549043 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.549317 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.549596 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.549894 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.550173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.550445 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.550706 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.550972 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.551254 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.551518 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.551794 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.568506 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.570116 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.570398 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.575508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.575903 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.576183 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.577707 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.579975 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.580259 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.584337 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.584618 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.585769 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.586040 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.586425 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.589600 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.589887 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.590167 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.590449 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.590721 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.590995 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.591267 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.591537 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.593568 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.594436 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.598830 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.599113 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.599399 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.599677 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.599950 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.600217 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.600479 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.600757 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.610539 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.610810 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.615298 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.618877 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.619087 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.619275 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.619418 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.623802 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.624200 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.627441 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.627727 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.628007 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.631584 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.631882 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.632167 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.632467 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.632714 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.632870 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.633033 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.636301 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.639850 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.640145 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.640426 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.641256 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.641773 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.641903 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.652430 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.652714 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.653005 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.653268 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.661198 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.661480 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.661612 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.661745 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.661989 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.663246 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.663522 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.666674 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.666957 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.667249 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.667536 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.667816 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.669626 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.671282 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.671556 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.674677 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.674960 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.675237 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.675531 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.675807 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.681363 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.681643 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.681922 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.682203 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.682578 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.682861 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.683142 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.689441 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.689716 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.689991 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.690267 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.691864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.692153 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.692440 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.701281 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.704559 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.708090 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.710250 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.710939 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.712551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.712848 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.713139 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.713452 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.716652 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.718366 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.720491 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.720765 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.720938 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.721082 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.722512 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.725789 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.726081 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.726470 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.726764 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.728122 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.729704 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.732826 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.733131 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.733518 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.733803 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.736656 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.736969 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.737252 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.743326 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.743620 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.743898 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.744962 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.745239 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.745517 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.745797 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.746069 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.746441 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.746726 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.747008 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.747294 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.747568 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.747857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.748120 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.748387 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.748658 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.751680 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 01:12:50.751953 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.752228 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.752516 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.752792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.753182 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.753455 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.753723 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.753992 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.754266 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.754538 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.754805 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.755073 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.755340 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 01:12:50.787360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56541369f9c0 pid: 73678 (default app) Aug 27 01:12:50.790732 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07619a32-5d91-4209-922a-a9cc1c3dd25d None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:12:50.791034 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07619a32-5d91-4209-922a-a9cc1c3dd25d None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:12:50.791314 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07619a32-5d91-4209-922a-a9cc1c3dd25d None None] PATH_INFO: `/v3` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:12:50.792781 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56541369f9c0 pid: 73679 (default app) Aug 27 01:12:50.795481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 792 bytes} [Fri Aug 27 01:12:50 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:12:59.266850 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8679b1-6bd3-48d0-8098-fe8bdd0ff5be None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:12:59.267364 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8679b1-6bd3-48d0-8098-fe8bdd0ff5be None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:12:59.267447 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8679b1-6bd3-48d0-8098-fe8bdd0ff5be None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:12:59.272478 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:12:59 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:12:59.278456 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b768b88-39e7-49c9-a57f-faa4f89d72ac None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:12:59.278821 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b768b88-39e7-49c9-a57f-faa4f89d72ac None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:12:59.279008 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b768b88-39e7-49c9-a57f-faa4f89d72ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:12:59.309681 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG oslo_db.sqlalchemy.engines [None req-8b768b88-39e7-49c9-a57f-faa4f89d72ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 01:12:59.503765 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG passlib.handlers.bcrypt [None req-8b768b88-39e7-49c9-a57f-faa4f89d72ac None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73678) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 27 01:12:59.504180 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG passlib.handlers.bcrypt [None req-8b768b88-39e7-49c9-a57f-faa4f89d72ac None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73678) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 27 01:12:59.558821 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-8b768b88-39e7-49c9-a57f-faa4f89d72ac None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:12:59.560357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-8b768b88-39e7-49c9-a57f-faa4f89d72ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:12:59.703753 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:12:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:12:59.837823 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8679b1-6bd3-48d0-8098-fe8bdd0ff5be None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:12:59.871078 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG oslo_db.sqlalchemy.engines [None req-7b8679b1-6bd3-48d0-8098-fe8bdd0ff5be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 01:13:00.002353 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8679b1-6bd3-48d0-8098-fe8bdd0ff5be None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:00.006632 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da38ac-e1a4-49be-9e38-f2d5c6a0c008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:00.007290 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da38ac-e1a4-49be-9e38-f2d5c6a0c008 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:00.007579 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da38ac-e1a4-49be-9e38-f2d5c6a0c008 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:00.007856 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da38ac-e1a4-49be-9e38-f2d5c6a0c008 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:00.016516 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da38ac-e1a4-49be-9e38-f2d5c6a0c008 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:00.066814 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.common.rbac_enforcer.enforcer [None req-69da38ac-e1a4-49be-9e38-f2d5c6a0c008 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 27 01:13:00.067155 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da38ac-e1a4-49be-9e38-f2d5c6a0c008 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:00.076391 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:12:59 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:00.083315 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b768b88-39e7-49c9-a57f-faa4f89d72ac None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:00.097378 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b768b88-39e7-49c9-a57f-faa4f89d72ac None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:00.101741 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca633c4b-a996-4446-a530-da4bb989c312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:00.102819 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca633c4b-a996-4446-a530-da4bb989c312 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:00.103104 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca633c4b-a996-4446-a530-da4bb989c312 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:00.103385 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca633c4b-a996-4446-a530-da4bb989c312 admin admin] PATH_INFO: `/v3/projects/e9904079a3e94900bd545a99cd672ff0` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:00.104955 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca633c4b-a996-4446-a530-da4bb989c312 admin admin] RBAC: Authorizing `identity:get_project(project_id=e9904079a3e94900bd545a99cd672ff0)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:00.161115 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ca633c4b-a996-4446-a530-da4bb989c312 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 27 01:13:00.161451 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca633c4b-a996-4446-a530-da4bb989c312 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:00.167635 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:00 2021] GET /identity/v3/projects/e9904079a3e94900bd545a99cd672ff0 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:02.297716 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec2c40-f967-4204-a366-e1b10d118a37 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:02.298345 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec2c40-f967-4204-a366-e1b10d118a37 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:02.298345 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec2c40-f967-4204-a366-e1b10d118a37 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:02.302932 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:02 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:13:02.308961 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f61959-89af-4790-9120-3246012e4328 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:02.309367 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f61959-89af-4790-9120-3246012e4328 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:02.309525 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f61959-89af-4790-9120-3246012e4328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:02.329582 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-a5f61959-89af-4790-9120-3246012e4328 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:02.331106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a5f61959-89af-4790-9120-3246012e4328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:02.339137 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:02.362852 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec2c40-f967-4204-a366-e1b10d118a37 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:02.375497 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec2c40-f967-4204-a366-e1b10d118a37 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:02.379649 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e5081-58a3-4568-8637-aa858caa3e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:02.380271 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e5081-58a3-4568-8637-aa858caa3e87 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:02.380549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e5081-58a3-4568-8637-aa858caa3e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:02.380822 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e5081-58a3-4568-8637-aa858caa3e87 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:02.388211 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e5081-58a3-4568-8637-aa858caa3e87 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:02.389996 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e5081-58a3-4568-8637-aa858caa3e87 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:02.399102 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:02.407337 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f61959-89af-4790-9120-3246012e4328 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:02.417392 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f61959-89af-4790-9120-3246012e4328 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:02.422602 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264e3a3-21d3-4bca-85ff-e144960f620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:02.423506 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264e3a3-21d3-4bca-85ff-e144960f620e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:02.423787 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264e3a3-21d3-4bca-85ff-e144960f620e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:02.424061 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264e3a3-21d3-4bca-85ff-e144960f620e admin admin] PATH_INFO: `/v3/users/d64df7fb530c43779ba7cb0d2f2adf99` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:02.425458 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264e3a3-21d3-4bca-85ff-e144960f620e admin admin] RBAC: Authorizing `identity:get_user(user_id=d64df7fb530c43779ba7cb0d2f2adf99)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:02.427271 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264e3a3-21d3-4bca-85ff-e144960f620e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:02.428853 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:02 2021] GET /identity/v3/users/d64df7fb530c43779ba7cb0d2f2adf99 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:04.600563 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02da8b-0a2a-41a6-9698-06651000e130 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:04.601118 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02da8b-0a2a-41a6-9698-06651000e130 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:04.601198 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02da8b-0a2a-41a6-9698-06651000e130 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:04.602892 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:04.608700 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d01e1-7ad8-45f4-94a8-d7480d4d493f None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:04.609706 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d01e1-7ad8-45f4-94a8-d7480d4d493f None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:04.609793 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d01e1-7ad8-45f4-94a8-d7480d4d493f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:04.627471 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-290d01e1-7ad8-45f4-94a8-d7480d4d493f None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:04.628644 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-290d01e1-7ad8-45f4-94a8-d7480d4d493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:04.635955 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 6/11] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:04.642380 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f14aa-fb8a-4688-baa2-992b017cedc8 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:04.642666 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f14aa-fb8a-4688-baa2-992b017cedc8 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:04.642939 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f14aa-fb8a-4688-baa2-992b017cedc8 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:04.644631 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 6/12] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:13:04.650264 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f694348-4442-47a7-aa08-0c010d2a99fc None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:04.650552 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f694348-4442-47a7-aa08-0c010d2a99fc None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:04.650825 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f694348-4442-47a7-aa08-0c010d2a99fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:04.659354 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f14aa-fb8a-4688-baa2-992b017cedc8 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:04.668334 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-0f694348-4442-47a7-aa08-0c010d2a99fc None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:04.669520 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-0f694348-4442-47a7-aa08-0c010d2a99fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:04.670923 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f14aa-fb8a-4688-baa2-992b017cedc8 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:04.675651 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5f1f4-efc6-4e83-8aaa-4d98309628c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:04.676410 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5f1f4-efc6-4e83-8aaa-4d98309628c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:04.676686 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5f1f4-efc6-4e83-8aaa-4d98309628c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:04.676990 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5f1f4-efc6-4e83-8aaa-4d98309628c1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:04.678149 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:04.697620 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5f1f4-efc6-4e83-8aaa-4d98309628c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:04.701548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f694348-4442-47a7-aa08-0c010d2a99fc None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:04.704932 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-a2c5f1f4-efc6-4e83-8aaa-4d98309628c1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:13:04.706166 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:13:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:13:04.710923 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f694348-4442-47a7-aa08-0c010d2a99fc None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:04.712558 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5f1f4-efc6-4e83-8aaa-4d98309628c1 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:04.715773 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83a92c-2787-403a-bcd4-22f92830b7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:04.716417 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83a92c-2787-403a-bcd4-22f92830b7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:04.716698 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83a92c-2787-403a-bcd4-22f92830b7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:04.717007 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83a92c-2787-403a-bcd4-22f92830b7a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:04.722163 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5f1f4-efc6-4e83-8aaa-4d98309628c1 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:04.725036 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83a92c-2787-403a-bcd4-22f92830b7a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:04.726574 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b4e54-fff9-427a-9a7b-094d910a84f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:04.726805 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83a92c-2787-403a-bcd4-22f92830b7a8 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:04.727195 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b4e54-fff9-427a-9a7b-094d910a84f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:04.727476 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b4e54-fff9-427a-9a7b-094d910a84f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:04.727749 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b4e54-fff9-427a-9a7b-094d910a84f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:04.728481 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b4e54-fff9-427a-9a7b-094d910a84f4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:04.728781 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b4e54-fff9-427a-9a7b-094d910a84f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:04.730517 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING py.warnings [None req-7a8b4e54-fff9-427a-9a7b-094d910a84f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:04.730517 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: warnings.warn(msg) Aug 27 01:13:04.730517 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: Aug 27 01:13:04.731406 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b4e54-fff9-427a-9a7b-094d910a84f4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:04.736352 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 8/15] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:04 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:13:04.742289 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83a92c-2787-403a-bcd4-22f92830b7a8 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:04.746277 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 8/16] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:04.750917 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83a92c-2787-403a-bcd4-22f92830b7a8 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:04.753222 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b4e54-fff9-427a-9a7b-094d910a84f4 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:04.755366 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f835d7a-fde9-471f-8e32-4c512864c5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:04.756128 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f835d7a-fde9-471f-8e32-4c512864c5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:04.756408 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f835d7a-fde9-471f-8e32-4c512864c5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:04.756679 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f835d7a-fde9-471f-8e32-4c512864c5e9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:04.757869 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f835d7a-fde9-471f-8e32-4c512864c5e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:04.759553 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f835d7a-fde9-471f-8e32-4c512864c5e9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:04.761259 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:04 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:04.762367 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b4e54-fff9-427a-9a7b-094d910a84f4 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:04.768147 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dd9b2-8168-4c52-a045-e8ab83febdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:04.769086 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dd9b2-8168-4c52-a045-e8ab83febdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:04.769375 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dd9b2-8168-4c52-a045-e8ab83febdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:04.769655 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dd9b2-8168-4c52-a045-e8ab83febdc7 admin admin] PATH_INFO: `/v3/users/d64df7fb530c43779ba7cb0d2f2adf99` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:04.771505 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9dd9b2-8168-4c52-a045-e8ab83febdc7 admin admin] RBAC: Authorizing `identity:get_user(user_id=d64df7fb530c43779ba7cb0d2f2adf99)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:04.773424 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9dd9b2-8168-4c52-a045-e8ab83febdc7 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:04.775155 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:04 2021] GET /identity/v3/users/d64df7fb530c43779ba7cb0d2f2adf99 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:04.782818 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f835d7a-fde9-471f-8e32-4c512864c5e9 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:04.793054 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f835d7a-fde9-471f-8e32-4c512864c5e9 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:04.798124 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bed6e-a42d-42e8-ba9f-3f6676af4933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:04.799030 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bed6e-a42d-42e8-ba9f-3f6676af4933 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:04.799379 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bed6e-a42d-42e8-ba9f-3f6676af4933 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:04.799718 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bed6e-a42d-42e8-ba9f-3f6676af4933 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:04.801086 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bed6e-a42d-42e8-ba9f-3f6676af4933 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:04.803385 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bed6e-a42d-42e8-ba9f-3f6676af4933 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:04.805063 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:04 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:04.812197 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dd9b2-8168-4c52-a045-e8ab83febdc7 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:04.822790 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dd9b2-8168-4c52-a045-e8ab83febdc7 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:04.827238 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbae28-a798-497e-9876-a66d5c182f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:04.828423 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbae28-a798-497e-9876-a66d5c182f72 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:04.828968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbae28-a798-497e-9876-a66d5c182f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:04.829040 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbae28-a798-497e-9876-a66d5c182f72 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:04.829831 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbae28-a798-497e-9876-a66d5c182f72 admin admin] RBAC: Adding query filter params (role.id=faadc5010ffb447ba5280e491c2ea2f5, scope.domain.id=default, user.id=d64df7fb530c43779ba7cb0d2f2adf99) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:04.830149 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbae28-a798-497e-9876-a66d5c182f72 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:04.831172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING py.warnings [None req-50cbae28-a798-497e-9876-a66d5c182f72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:04.831172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: warnings.warn(msg) Aug 27 01:13:04.831172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: Aug 27 01:13:04.832635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbae28-a798-497e-9876-a66d5c182f72 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:04.842057 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 10/20] 10.222.0.25 () {56 vars in 1344 bytes} [Fri Aug 27 01:13:04 2021] GET /identity/v3/role_assignments?user.id=d64df7fb530c43779ba7cb0d2f2adf99&scope.domain.id=default&role.id=faadc5010ffb447ba5280e491c2ea2f5 => generated 233 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:07.280465 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07682b-a9a9-48e6-b1af-aef40effe933 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:07.282162 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07682b-a9a9-48e6-b1af-aef40effe933 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:07.282653 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07682b-a9a9-48e6-b1af-aef40effe933 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:07.284963 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 11/21] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:07 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:07.295290 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb051-4f7f-4e3c-9e94-8bf5a2048404 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:07.296313 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb051-4f7f-4e3c-9e94-8bf5a2048404 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:07.297081 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb051-4f7f-4e3c-9e94-8bf5a2048404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:07.309950 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0eade-79d0-4d5e-8b24-a0f2bdf38456 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:07.310575 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0eade-79d0-4d5e-8b24-a0f2bdf38456 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:07.311053 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0eade-79d0-4d5e-8b24-a0f2bdf38456 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:07.314056 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 12/22] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:07.319640 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44afaf8-7969-4c49-a94a-b984319bcd4c None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:07.320146 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44afaf8-7969-4c49-a94a-b984319bcd4c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:07.320690 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44afaf8-7969-4c49-a94a-b984319bcd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:07.345837 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-b44afaf8-7969-4c49-a94a-b984319bcd4c None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:07.347372 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-b44afaf8-7969-4c49-a94a-b984319bcd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:07.351429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG passlib.handlers.bcrypt [None req-ba2eb051-4f7f-4e3c-9e94-8bf5a2048404 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73679) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 27 01:13:07.351934 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG passlib.handlers.bcrypt [None req-ba2eb051-4f7f-4e3c-9e94-8bf5a2048404 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73679) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 27 01:13:07.360490 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 13/23] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:07.401323 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44afaf8-7969-4c49-a94a-b984319bcd4c None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:07.416872 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44afaf8-7969-4c49-a94a-b984319bcd4c None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:07.422147 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-ba2eb051-4f7f-4e3c-9e94-8bf5a2048404 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:07.423814 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ba2eb051-4f7f-4e3c-9e94-8bf5a2048404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:07.433625 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686235b-7cce-4b20-9265-f689cc4f2a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:07.434809 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686235b-7cce-4b20-9265-f689cc4f2a5e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:07.435289 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686235b-7cce-4b20-9265-f689cc4f2a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:07.435755 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686235b-7cce-4b20-9265-f689cc4f2a5e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:07.455319 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686235b-7cce-4b20-9265-f689cc4f2a5e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:07.470892 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-5686235b-7cce-4b20-9265-f689cc4f2a5e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:13:07.472361 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 14/24] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:13:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:13:07.478845 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686235b-7cce-4b20-9265-f689cc4f2a5e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:07.491284 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 11/25] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:07.494836 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686235b-7cce-4b20-9265-f689cc4f2a5e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:07.510006 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a692838-831d-400c-9ae1-41e26a287cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:07.510954 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a692838-831d-400c-9ae1-41e26a287cfc admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:07.511427 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a692838-831d-400c-9ae1-41e26a287cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:07.511891 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a692838-831d-400c-9ae1-41e26a287cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:07.512871 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a692838-831d-400c-9ae1-41e26a287cfc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:07.513371 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a692838-831d-400c-9ae1-41e26a287cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:07.515452 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING py.warnings [None req-6a692838-831d-400c-9ae1-41e26a287cfc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:07.515452 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: warnings.warn(msg) Aug 27 01:13:07.515452 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: Aug 27 01:13:07.516707 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a692838-831d-400c-9ae1-41e26a287cfc admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:07.537320 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 15/26] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:07.537859 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eb051-4f7f-4e3c-9e94-8bf5a2048404 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:07.546009 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a692838-831d-400c-9ae1-41e26a287cfc admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:07.552264 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eb051-4f7f-4e3c-9e94-8bf5a2048404 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:07.556577 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a692838-831d-400c-9ae1-41e26a287cfc admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:07.569553 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918aeda-1071-4112-94f8-562c2751b9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:07.570724 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918aeda-1071-4112-94f8-562c2751b9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:07.571008 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918aeda-1071-4112-94f8-562c2751b9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:07.571282 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918aeda-1071-4112-94f8-562c2751b9b5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:07.573642 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfb1e2-9b0e-43d9-b504-907f1e52e262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:07.574553 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfb1e2-9b0e-43d9-b504-907f1e52e262 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:07.574837 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfb1e2-9b0e-43d9-b504-907f1e52e262 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:07.575109 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfb1e2-9b0e-43d9-b504-907f1e52e262 admin admin] PATH_INFO: `/v3/users/d64df7fb530c43779ba7cb0d2f2adf99` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:07.576493 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfb1e2-9b0e-43d9-b504-907f1e52e262 admin admin] RBAC: Authorizing `identity:get_user(user_id=d64df7fb530c43779ba7cb0d2f2adf99)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:07.579103 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfb1e2-9b0e-43d9-b504-907f1e52e262 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:07.581489 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 16/27] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:07 2021] GET /identity/v3/users/d64df7fb530c43779ba7cb0d2f2adf99 => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:07.587120 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfb1e2-9b0e-43d9-b504-907f1e52e262 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:07.603015 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfb1e2-9b0e-43d9-b504-907f1e52e262 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:07.609750 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918aeda-1071-4112-94f8-562c2751b9b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:07.611737 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918aeda-1071-4112-94f8-562c2751b9b5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:07.622314 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fdf7f-b634-4ba2-a273-b3d90f55a843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:07.623123 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fdf7f-b634-4ba2-a273-b3d90f55a843 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:07.623409 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fdf7f-b634-4ba2-a273-b3d90f55a843 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:07.623691 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fdf7f-b634-4ba2-a273-b3d90f55a843 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:07.629674 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047fdf7f-b634-4ba2-a273-b3d90f55a843 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:07.631421 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047fdf7f-b634-4ba2-a273-b3d90f55a843 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:07.633463 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 17/28] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:07 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:07.638194 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-9918aeda-1071-4112-94f8-562c2751b9b5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:07.639087 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fdf7f-b634-4ba2-a273-b3d90f55a843 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:07.639679 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 12/29] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:07.646150 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918aeda-1071-4112-94f8-562c2751b9b5 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:07.654526 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fdf7f-b634-4ba2-a273-b3d90f55a843 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:07.662411 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918aeda-1071-4112-94f8-562c2751b9b5 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:07.670803 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c64399-5124-4808-921a-7fe661de356d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:07.671998 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c64399-5124-4808-921a-7fe661de356d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:07.672278 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c64399-5124-4808-921a-7fe661de356d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:07.672554 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c64399-5124-4808-921a-7fe661de356d admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:07.673305 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c64399-5124-4808-921a-7fe661de356d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:07.673510 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3b182-fe75-48f6-af61-140170bdaa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:07.673636 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c64399-5124-4808-921a-7fe661de356d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:07.674404 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3b182-fe75-48f6-af61-140170bdaa13 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:07.674599 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING py.warnings [None req-40c64399-5124-4808-921a-7fe661de356d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:07.674599 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: warnings.warn(msg) Aug 27 01:13:07.674599 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: Aug 27 01:13:07.674781 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3b182-fe75-48f6-af61-140170bdaa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:07.674946 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3b182-fe75-48f6-af61-140170bdaa13 admin admin] PATH_INFO: `/v3/domains/default/users/d64df7fb530c43779ba7cb0d2f2adf99/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:07.675520 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c64399-5124-4808-921a-7fe661de356d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:07.677078 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3b182-fe75-48f6-af61-140170bdaa13 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d64df7fb530c43779ba7cb0d2f2adf99, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:07.678090 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING py.warnings [None req-c8b3b182-fe75-48f6-af61-140170bdaa13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:07.678090 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: warnings.warn(msg) Aug 27 01:13:07.678090 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: Aug 27 01:13:07.680102 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3b182-fe75-48f6-af61-140170bdaa13 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:07.698998 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 13/30] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:07.700097 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbe71e-a901-4654-9a36-87cf4a7fb61f None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:07.700384 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbe71e-a901-4654-9a36-87cf4a7fb61f None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:07.700661 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbe71e-a901-4654-9a36-87cf4a7fb61f None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:07.703103 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 14/31] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:07.708864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020dd08-c629-4980-a892-9f8e3e031371 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:07.709159 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020dd08-c629-4980-a892-9f8e3e031371 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:07.709435 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020dd08-c629-4980-a892-9f8e3e031371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:07.730812 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-f020dd08-c629-4980-a892-9f8e3e031371 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:07.732046 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-f020dd08-c629-4980-a892-9f8e3e031371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:07.745055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 15/32] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:07.746060 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020dd08-c629-4980-a892-9f8e3e031371 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:07.756591 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020dd08-c629-4980-a892-9f8e3e031371 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:07.767721 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7984b8-d976-4e7a-a453-fa5ba4e740b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:07.768413 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7984b8-d976-4e7a-a453-fa5ba4e740b8 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:07.768706 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7984b8-d976-4e7a-a453-fa5ba4e740b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:07.769058 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7984b8-d976-4e7a-a453-fa5ba4e740b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:07.770023 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7984b8-d976-4e7a-a453-fa5ba4e740b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:07.771059 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING py.warnings [None req-0a7984b8-d976-4e7a-a453-fa5ba4e740b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:07.771059 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: warnings.warn(msg) Aug 27 01:13:07.771059 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: Aug 27 01:13:07.772301 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7984b8-d976-4e7a-a453-fa5ba4e740b8 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:08.048270 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 18/33] 10.222.0.25 () {58 vars in 1383 bytes} [Fri Aug 27 01:13:07 2021] PUT /identity/v3/domains/default/users/d64df7fb530c43779ba7cb0d2f2adf99/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:13:08.049501 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3b182-fe75-48f6-af61-140170bdaa13 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:08.145765 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3b182-fe75-48f6-af61-140170bdaa13 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:08.154801 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ea11b-c98c-4b34-8b66-321f5553c9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:08.156256 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ea11b-c98c-4b34-8b66-321f5553c9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:08.156740 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ea11b-c98c-4b34-8b66-321f5553c9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:08.157253 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ea11b-c98c-4b34-8b66-321f5553c9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:08.158228 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ea11b-c98c-4b34-8b66-321f5553c9b6 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:08.159731 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING py.warnings [None req-7a8ea11b-c98c-4b34-8b66-321f5553c9b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:08.159731 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: warnings.warn(msg) Aug 27 01:13:08.159731 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: Aug 27 01:13:08.160995 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ea11b-c98c-4b34-8b66-321f5553c9b6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:08.169277 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 16/34] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 01:13:07 2021] POST /identity/v3/projects => generated 301 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:13:08.308432 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 19/35] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:13:08 2021] POST /identity/v3/roles => generated 219 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:13:08.334838 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e0fa4-ced0-4592-9b81-de8d85e62d4f None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:08.335370 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e0fa4-ced0-4592-9b81-de8d85e62d4f None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:08.335443 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e0fa4-ced0-4592-9b81-de8d85e62d4f None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:08.337259 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 17/36] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:08.344200 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f4317-3140-44af-84e1-52ff7690705e None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:08.344869 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f4317-3140-44af-84e1-52ff7690705e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:08.345441 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f4317-3140-44af-84e1-52ff7690705e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:08.370867 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-8a1f4317-3140-44af-84e1-52ff7690705e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:08.372779 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-8a1f4317-3140-44af-84e1-52ff7690705e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:08.466440 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 20/37] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:08.510351 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e0fa4-ced0-4592-9b81-de8d85e62d4f None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:08.530793 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e0fa4-ced0-4592-9b81-de8d85e62d4f None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:08.538589 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3c428-2ecc-41a0-a0b9-8551c561cfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:08.539653 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3c428-2ecc-41a0-a0b9-8551c561cfec admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:08.540176 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3c428-2ecc-41a0-a0b9-8551c561cfec admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:08.540655 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3c428-2ecc-41a0-a0b9-8551c561cfec admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:08.541648 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3c428-2ecc-41a0-a0b9-8551c561cfec admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:08.543058 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING py.warnings [None req-64d3c428-2ecc-41a0-a0b9-8551c561cfec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:08.543058 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: warnings.warn(msg) Aug 27 01:13:08.543058 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: Aug 27 01:13:08.544331 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3c428-2ecc-41a0-a0b9-8551c561cfec admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:08.635689 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 18/38] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:13:08 2021] POST /identity/v3/roles => generated 225 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:13:08.752631 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cd1ed-5980-42c6-a80a-618b203b9985 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:08.752631 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cd1ed-5980-42c6-a80a-618b203b9985 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:08.752631 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cd1ed-5980-42c6-a80a-618b203b9985 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:08.752631 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 21/39] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:08.759880 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04483723-8112-4c5c-b984-e301e6cff1e3 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:08.760243 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04483723-8112-4c5c-b984-e301e6cff1e3 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:08.760543 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04483723-8112-4c5c-b984-e301e6cff1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:08.782055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-04483723-8112-4c5c-b984-e301e6cff1e3 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:08.783741 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-04483723-8112-4c5c-b984-e301e6cff1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:08.795166 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 19/40] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:08.823842 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cd1ed-5980-42c6-a80a-618b203b9985 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:08.837822 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cd1ed-5980-42c6-a80a-618b203b9985 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:08.844503 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be9c7e-fe93-497a-a15d-076867845b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:08.845327 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be9c7e-fe93-497a-a15d-076867845b22 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:08.845610 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be9c7e-fe93-497a-a15d-076867845b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:08.845882 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be9c7e-fe93-497a-a15d-076867845b22 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:08.848348 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be9c7e-fe93-497a-a15d-076867845b22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:08.850093 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be9c7e-fe93-497a-a15d-076867845b22 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:08.851873 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 22/41] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:08.858514 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04483723-8112-4c5c-b984-e301e6cff1e3 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:08.861746 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a237d5-6141-468e-8e1f-bc1c65fe8856 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:08.862038 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a237d5-6141-468e-8e1f-bc1c65fe8856 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:08.862322 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a237d5-6141-468e-8e1f-bc1c65fe8856 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:08.864060 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 23/42] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:13:08.870107 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04483723-8112-4c5c-b984-e301e6cff1e3 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:08.870239 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe6940-84d3-4990-b420-2d66da2d88e5 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:08.870470 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe6940-84d3-4990-b420-2d66da2d88e5 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:08.870760 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe6940-84d3-4990-b420-2d66da2d88e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:08.876772 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fa0b9-4d0f-45eb-8cfa-f209b0f6a68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:08.878019 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fa0b9-4d0f-45eb-8cfa-f209b0f6a68e admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:08.879537 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fa0b9-4d0f-45eb-8cfa-f209b0f6a68e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:08.880080 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fa0b9-4d0f-45eb-8cfa-f209b0f6a68e admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:08.881064 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fa0b9-4d0f-45eb-8cfa-f209b0f6a68e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:08.883294 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fa0b9-4d0f-45eb-8cfa-f209b0f6a68e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:08.892118 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-a3fe6940-84d3-4990-b420-2d66da2d88e5 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:08.892118 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a3fe6940-84d3-4990-b420-2d66da2d88e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:08.904786 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 24/43] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:08.930287 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe6940-84d3-4990-b420-2d66da2d88e5 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:08.939515 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe6940-84d3-4990-b420-2d66da2d88e5 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:08.944193 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c569dd-ca3c-4cf7-91a4-e16a144a6035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:08.944978 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c569dd-ca3c-4cf7-91a4-e16a144a6035 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:08.945296 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c569dd-ca3c-4cf7-91a4-e16a144a6035 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:08.945610 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c569dd-ca3c-4cf7-91a4-e16a144a6035 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:08.946440 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c569dd-ca3c-4cf7-91a4-e16a144a6035 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:08.948047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c569dd-ca3c-4cf7-91a4-e16a144a6035 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:08.978661 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 20/44] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 01:13:08 2021] POST /identity/v3/projects => generated 312 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:13:09.024088 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 25/45] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:13:08 2021] POST /identity/v3/roles => generated 223 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:13:10.544623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b706de4-9b03-4186-85da-a94708691fb1 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:10.545156 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b706de4-9b03-4186-85da-a94708691fb1 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:10.545235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b706de4-9b03-4186-85da-a94708691fb1 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:10.548079 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 21/46] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:10.553983 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb177c5d-08d7-473f-8624-03ca8f41a780 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:10.554374 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb177c5d-08d7-473f-8624-03ca8f41a780 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:10.554549 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb177c5d-08d7-473f-8624-03ca8f41a780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:10.572993 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-bb177c5d-08d7-473f-8624-03ca8f41a780 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:10.574176 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-bb177c5d-08d7-473f-8624-03ca8f41a780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:10.629668 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 26/47] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:10.653640 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b706de4-9b03-4186-85da-a94708691fb1 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:10.665486 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b706de4-9b03-4186-85da-a94708691fb1 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:10.669741 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15068ecf-d25a-4bd2-9ace-d2278134c040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:10.670466 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15068ecf-d25a-4bd2-9ace-d2278134c040 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:10.670753 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15068ecf-d25a-4bd2-9ace-d2278134c040 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:10.671536 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15068ecf-d25a-4bd2-9ace-d2278134c040 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:10.682365 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15068ecf-d25a-4bd2-9ace-d2278134c040 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:10.689792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-15068ecf-d25a-4bd2-9ace-d2278134c040 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:13:10.690978 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 22/48] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:13:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:10.697271 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb177c5d-08d7-473f-8624-03ca8f41a780 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:10.707028 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb177c5d-08d7-473f-8624-03ca8f41a780 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:10.711417 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d23560-6550-4e65-8063-343a58b96d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:10.712075 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d23560-6550-4e65-8063-343a58b96d91 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:10.712358 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d23560-6550-4e65-8063-343a58b96d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:10.712634 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d23560-6550-4e65-8063-343a58b96d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:10.713419 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d23560-6550-4e65-8063-343a58b96d91 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:10.713725 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d23560-6550-4e65-8063-343a58b96d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:10.715380 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d23560-6550-4e65-8063-343a58b96d91 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:10.724175 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 27/49] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:10.730198 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15068ecf-d25a-4bd2-9ace-d2278134c040 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:10.740777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15068ecf-d25a-4bd2-9ace-d2278134c040 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:10.745315 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f42a6-fe1a-428d-93ec-4ee3ac69377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:10.746203 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f42a6-fe1a-428d-93ec-4ee3ac69377c admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:10.746490 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f42a6-fe1a-428d-93ec-4ee3ac69377c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:10.746766 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f42a6-fe1a-428d-93ec-4ee3ac69377c admin admin] PATH_INFO: `/v3/users/d64df7fb530c43779ba7cb0d2f2adf99` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:10.748206 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f42a6-fe1a-428d-93ec-4ee3ac69377c admin admin] RBAC: Authorizing `identity:get_user(user_id=d64df7fb530c43779ba7cb0d2f2adf99)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:10.750875 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f42a6-fe1a-428d-93ec-4ee3ac69377c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:10.752479 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 23/50] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:10 2021] GET /identity/v3/users/d64df7fb530c43779ba7cb0d2f2adf99 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:10.759109 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d23560-6550-4e65-8063-343a58b96d91 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:10.769226 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d23560-6550-4e65-8063-343a58b96d91 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:10.773659 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72420c-f5a1-455a-865f-18b7fcb68bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:10.774444 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72420c-f5a1-455a-865f-18b7fcb68bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:10.774730 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72420c-f5a1-455a-865f-18b7fcb68bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:10.775010 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72420c-f5a1-455a-865f-18b7fcb68bb2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:10.776186 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72420c-f5a1-455a-865f-18b7fcb68bb2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:10.777926 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72420c-f5a1-455a-865f-18b7fcb68bb2 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:10.779502 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 28/51] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:10.785825 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f42a6-fe1a-428d-93ec-4ee3ac69377c admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:10.795608 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f42a6-fe1a-428d-93ec-4ee3ac69377c admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:10.800888 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966ccd2-731d-40c7-bcb5-dd17b9cf1996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:10.801551 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966ccd2-731d-40c7-bcb5-dd17b9cf1996 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:10.801840 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966ccd2-731d-40c7-bcb5-dd17b9cf1996 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:10.802120 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966ccd2-731d-40c7-bcb5-dd17b9cf1996 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:10.802957 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966ccd2-731d-40c7-bcb5-dd17b9cf1996 admin admin] RBAC: Adding query filter params (role.id=faadc5010ffb447ba5280e491c2ea2f5, scope.domain.id=default, user.id=d64df7fb530c43779ba7cb0d2f2adf99) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:10.803271 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966ccd2-731d-40c7-bcb5-dd17b9cf1996 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:10.805165 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966ccd2-731d-40c7-bcb5-dd17b9cf1996 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:10.811091 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 24/52] 10.222.0.25 () {56 vars in 1344 bytes} [Fri Aug 27 01:13:10 2021] GET /identity/v3/role_assignments?user.id=d64df7fb530c43779ba7cb0d2f2adf99&scope.domain.id=default&role.id=faadc5010ffb447ba5280e491c2ea2f5 => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:11.144300 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d56c4e-863f-44f5-8e76-a11891a3455a None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:11.144593 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d56c4e-863f-44f5-8e76-a11891a3455a None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:11.144905 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d56c4e-863f-44f5-8e76-a11891a3455a None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:11.146698 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 29/53] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:11.152590 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf3328-bc93-4e32-9733-d7084073f217 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:11.152916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf3328-bc93-4e32-9733-d7084073f217 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:11.153201 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf3328-bc93-4e32-9733-d7084073f217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:11.176021 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-fbbf3328-bc93-4e32-9733-d7084073f217 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:11.177241 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-fbbf3328-bc93-4e32-9733-d7084073f217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:11.184745 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 25/54] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:11.208895 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d56c4e-863f-44f5-8e76-a11891a3455a None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:11.221600 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d56c4e-863f-44f5-8e76-a11891a3455a None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:11.225833 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285ad0d-9840-4fdf-84ff-c48f3723e1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:11.226611 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285ad0d-9840-4fdf-84ff-c48f3723e1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:11.226898 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285ad0d-9840-4fdf-84ff-c48f3723e1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:11.227178 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285ad0d-9840-4fdf-84ff-c48f3723e1e7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:11.228342 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285ad0d-9840-4fdf-84ff-c48f3723e1e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:11.230053 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285ad0d-9840-4fdf-84ff-c48f3723e1e7 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:11.231607 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 30/55] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:11 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:11.237838 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf3328-bc93-4e32-9733-d7084073f217 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:11.246399 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf3328-bc93-4e32-9733-d7084073f217 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:11.250710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a4b12-2a66-4c76-9f2b-cf3bfd18a2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:11.251349 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a4b12-2a66-4c76-9f2b-cf3bfd18a2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:11.251630 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a4b12-2a66-4c76-9f2b-cf3bfd18a2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:11.251904 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a4b12-2a66-4c76-9f2b-cf3bfd18a2f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:11.252611 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a4b12-2a66-4c76-9f2b-cf3bfd18a2f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:11.254545 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a4b12-2a66-4c76-9f2b-cf3bfd18a2f3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:11.343988 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 26/56] 10.222.0.25 () {60 vars in 1162 bytes} [Fri Aug 27 01:13:11 2021] POST /identity/v3/projects => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:13:13.474211 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73836e-a167-493f-b477-1a77799f6d6d None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:13.474762 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73836e-a167-493f-b477-1a77799f6d6d None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:13.474762 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73836e-a167-493f-b477-1a77799f6d6d None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:13.476516 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 31/57] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:13.482339 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746014c5-2f30-4da3-9ff0-35b107a99c0b None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:13.482733 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746014c5-2f30-4da3-9ff0-35b107a99c0b None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:13.482903 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746014c5-2f30-4da3-9ff0-35b107a99c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:13.501732 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-746014c5-2f30-4da3-9ff0-35b107a99c0b None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:13.502921 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-746014c5-2f30-4da3-9ff0-35b107a99c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:13.568647 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 27/58] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:13.593941 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73836e-a167-493f-b477-1a77799f6d6d None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:13.605753 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73836e-a167-493f-b477-1a77799f6d6d None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:13.610869 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8266174-de73-4946-9671-fd560118e8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:13.611673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8266174-de73-4946-9671-fd560118e8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:13.611958 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8266174-de73-4946-9671-fd560118e8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:13.612237 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8266174-de73-4946-9671-fd560118e8b1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:13.613426 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8266174-de73-4946-9671-fd560118e8b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:13.615104 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8266174-de73-4946-9671-fd560118e8b1 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:13.616646 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 32/59] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:13.622086 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746014c5-2f30-4da3-9ff0-35b107a99c0b None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:13.631321 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746014c5-2f30-4da3-9ff0-35b107a99c0b None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:13.635707 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268144fe-5711-4084-b5ab-895e6389560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:13.636358 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268144fe-5711-4084-b5ab-895e6389560f admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:13.636645 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268144fe-5711-4084-b5ab-895e6389560f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:13.636959 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268144fe-5711-4084-b5ab-895e6389560f admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:13.637670 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268144fe-5711-4084-b5ab-895e6389560f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:13.638669 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING py.warnings [None req-268144fe-5711-4084-b5ab-895e6389560f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:13.638669 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: warnings.warn(msg) Aug 27 01:13:13.638669 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: Aug 27 01:13:13.639917 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268144fe-5711-4084-b5ab-895e6389560f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:13.742526 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 28/60] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 01:13:13 2021] POST /identity/v3/users => generated 275 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:13:17.146477 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81591c8e-569a-41eb-affa-b09de21363c9 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.147502 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81591c8e-569a-41eb-affa-b09de21363c9 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.148000 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81591c8e-569a-41eb-affa-b09de21363c9 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.152056 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 33/61] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:17 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:17.157987 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da789409-2ecd-42a0-adc3-6d308cdff0d6 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.158436 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da789409-2ecd-42a0-adc3-6d308cdff0d6 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.158618 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da789409-2ecd-42a0-adc3-6d308cdff0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.193919 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-da789409-2ecd-42a0-adc3-6d308cdff0d6 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:17.195184 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-da789409-2ecd-42a0-adc3-6d308cdff0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:17.206602 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 29/62] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:17.245995 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81591c8e-569a-41eb-affa-b09de21363c9 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.263153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81591c8e-569a-41eb-affa-b09de21363c9 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.274799 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a5603-af92-46c9-bb16-a7ee776691cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.275627 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a5603-af92-46c9-bb16-a7ee776691cc admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.275921 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a5603-af92-46c9-bb16-a7ee776691cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.276196 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a5603-af92-46c9-bb16-a7ee776691cc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.291937 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a5603-af92-46c9-bb16-a7ee776691cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:17.299064 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e1e22-6d76-46ba-8cd8-1d50a99e0d9b None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.299357 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e1e22-6d76-46ba-8cd8-1d50a99e0d9b None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.299640 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e1e22-6d76-46ba-8cd8-1d50a99e0d9b None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.301523 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 30/63] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:13:17.304683 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-bb8a5603-af92-46c9-bb16-a7ee776691cc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 01:13:17.306043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 34/64] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:17.307483 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f756366-8eca-4892-b71f-05fa3bf22806 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.307777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f756366-8eca-4892-b71f-05fa3bf22806 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.308073 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f756366-8eca-4892-b71f-05fa3bf22806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.315741 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a5603-af92-46c9-bb16-a7ee776691cc admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.335487 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-6f756366-8eca-4892-b71f-05fa3bf22806 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:17.336701 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-6f756366-8eca-4892-b71f-05fa3bf22806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:17.339737 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a5603-af92-46c9-bb16-a7ee776691cc admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.348774 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff3287-7185-4b23-9b48-3b47cbca3267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.349525 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff3287-7185-4b23-9b48-3b47cbca3267 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.349813 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff3287-7185-4b23-9b48-3b47cbca3267 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.350097 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff3287-7185-4b23-9b48-3b47cbca3267 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.350857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff3287-7185-4b23-9b48-3b47cbca3267 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:17.351168 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff3287-7185-4b23-9b48-3b47cbca3267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:17.356617 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff3287-7185-4b23-9b48-3b47cbca3267 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:17.362171 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 31/65] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:17.369082 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72936e6-dffb-4605-a8e3-cbbc82504462 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.369380 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72936e6-dffb-4605-a8e3-cbbc82504462 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.369667 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72936e6-dffb-4605-a8e3-cbbc82504462 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.371636 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 32/66] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:17.381551 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818dd38-988b-4551-9498-299b4d2f95d2 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.381839 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818dd38-988b-4551-9498-299b4d2f95d2 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.382123 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818dd38-988b-4551-9498-299b4d2f95d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.391089 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 35/67] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:17.394260 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff3287-7185-4b23-9b48-3b47cbca3267 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.406107 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff3287-7185-4b23-9b48-3b47cbca3267 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.406886 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b818dd38-988b-4551-9498-299b4d2f95d2 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:17.408099 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b818dd38-988b-4551-9498-299b4d2f95d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:17.410781 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d2001-4e3c-4e10-93dc-198672ea26eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.411773 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d2001-4e3c-4e10-93dc-198672ea26eb admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.412060 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d2001-4e3c-4e10-93dc-198672ea26eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.412337 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d2001-4e3c-4e10-93dc-198672ea26eb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.416192 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 33/68] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:17.417047 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818dd38-988b-4551-9498-299b4d2f95d2 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.427666 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818dd38-988b-4551-9498-299b4d2f95d2 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.432228 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189bac0-cb8a-4d35-96f0-74d69f48850c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.432440 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d2001-4e3c-4e10-93dc-198672ea26eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:17.433126 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189bac0-cb8a-4d35-96f0-74d69f48850c admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.433411 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189bac0-cb8a-4d35-96f0-74d69f48850c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.433690 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189bac0-cb8a-4d35-96f0-74d69f48850c admin admin] PATH_INFO: `/v3/users/690677d9b18f42639d78f5d0dd911adc` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.448632 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-e24d2001-4e3c-4e10-93dc-198672ea26eb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 01:13:17.450092 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 36/69] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:17.457071 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d2001-4e3c-4e10-93dc-198672ea26eb admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.462090 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189bac0-cb8a-4d35-96f0-74d69f48850c admin admin] RBAC: Authorizing `identity:get_user(user_id=690677d9b18f42639d78f5d0dd911adc)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:17.464220 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189bac0-cb8a-4d35-96f0-74d69f48850c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:17.466452 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 34/70] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/users/690677d9b18f42639d78f5d0dd911adc => generated 275 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:17.467301 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189bac0-cb8a-4d35-96f0-74d69f48850c admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.472431 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d2001-4e3c-4e10-93dc-198672ea26eb admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.478485 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fe653-2cf7-4135-a535-c6ca54d5e121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.479819 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fe653-2cf7-4135-a535-c6ca54d5e121 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.480113 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fe653-2cf7-4135-a535-c6ca54d5e121 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.480399 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fe653-2cf7-4135-a535-c6ca54d5e121 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.481551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fe653-2cf7-4135-a535-c6ca54d5e121 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:17.481870 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fe653-2cf7-4135-a535-c6ca54d5e121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:17.483813 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189bac0-cb8a-4d35-96f0-74d69f48850c admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.484095 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fe653-2cf7-4135-a535-c6ca54d5e121 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:17.489530 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc229be-a0da-49e2-9e46-4056c2eb609f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.491105 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc229be-a0da-49e2-9e46-4056c2eb609f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.491461 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc229be-a0da-49e2-9e46-4056c2eb609f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.492038 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc229be-a0da-49e2-9e46-4056c2eb609f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.494362 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 37/71] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:17.495321 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fe653-2cf7-4135-a535-c6ca54d5e121 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.507546 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fe653-2cf7-4135-a535-c6ca54d5e121 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.511781 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc229be-a0da-49e2-9e46-4056c2eb609f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:17.512990 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceeb636-c9f6-4e76-907d-13f7991d3901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.513664 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeb636-c9f6-4e76-907d-13f7991d3901 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.513950 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeb636-c9f6-4e76-907d-13f7991d3901 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.514234 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeb636-c9f6-4e76-907d-13f7991d3901 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.518758 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-1fc229be-a0da-49e2-9e46-4056c2eb609f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:13:17.520447 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 35/72] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:17.523670 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceeb636-c9f6-4e76-907d-13f7991d3901 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:17.525340 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc229be-a0da-49e2-9e46-4056c2eb609f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.525541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceeb636-c9f6-4e76-907d-13f7991d3901 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:17.536281 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 38/73] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:17.536539 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc229be-a0da-49e2-9e46-4056c2eb609f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.541013 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceeb636-c9f6-4e76-907d-13f7991d3901 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.545382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8e4bc-9a8a-46b2-8c8d-aff85aff0920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.547081 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8e4bc-9a8a-46b2-8c8d-aff85aff0920 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.547436 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8e4bc-9a8a-46b2-8c8d-aff85aff0920 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.547725 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8e4bc-9a8a-46b2-8c8d-aff85aff0920 admin admin] PATH_INFO: `/v3/users/690677d9b18f42639d78f5d0dd911adc` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.549089 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8e4bc-9a8a-46b2-8c8d-aff85aff0920 admin admin] RBAC: Authorizing `identity:get_user(user_id=690677d9b18f42639d78f5d0dd911adc)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:17.550725 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceeb636-c9f6-4e76-907d-13f7991d3901 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.551263 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8e4bc-9a8a-46b2-8c8d-aff85aff0920 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:17.553895 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 36/74] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/users/690677d9b18f42639d78f5d0dd911adc => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:17.554507 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3f20f-bab4-4683-bd9a-74cf7a1221a1 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.554740 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3f20f-bab4-4683-bd9a-74cf7a1221a1 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.555080 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3f20f-bab4-4683-bd9a-74cf7a1221a1 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.556610 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 37/75] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:17.557283 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3f20f-bab4-4683-bd9a-74cf7a1221a1 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.561625 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4ec6a-ee24-45ce-a980-cc9c33bffb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.562542 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4ec6a-ee24-45ce-a980-cc9c33bffb72 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.563026 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4ec6a-ee24-45ce-a980-cc9c33bffb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.563513 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4ec6a-ee24-45ce-a980-cc9c33bffb72 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.564458 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4ec6a-ee24-45ce-a980-cc9c33bffb72 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:17.564996 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4ec6a-ee24-45ce-a980-cc9c33bffb72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:17.566817 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4ec6a-ee24-45ce-a980-cc9c33bffb72 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:17.570628 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3f20f-bab4-4683-bd9a-74cf7a1221a1 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.574987 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2e15a-88bd-4fc5-a2a0-8c14ed6ceba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.576000 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2e15a-88bd-4fc5-a2a0-8c14ed6ceba9 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.576101 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 39/76] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:17.576181 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2e15a-88bd-4fc5-a2a0-8c14ed6ceba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.576365 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2e15a-88bd-4fc5-a2a0-8c14ed6ceba9 admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.576726 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4ec6a-ee24-45ce-a980-cc9c33bffb72 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.578206 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2e15a-88bd-4fc5-a2a0-8c14ed6ceba9 admin admin] RBAC: Authorizing `identity:get_project(project_id=966196fad6e9467e93b5762e459a1d84)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:17.580257 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2e15a-88bd-4fc5-a2a0-8c14ed6ceba9 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:17.584889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 38/77] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/projects/966196fad6e9467e93b5762e459a1d84 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:17.584889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2da46f-2e83-47a2-867f-8bd56f60eb80 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.584889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2da46f-2e83-47a2-867f-8bd56f60eb80 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.584889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2da46f-2e83-47a2-867f-8bd56f60eb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.587908 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4ec6a-ee24-45ce-a980-cc9c33bffb72 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.592298 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf109852-e90e-47b4-907d-b8609ac4c6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.594180 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf109852-e90e-47b4-907d-b8609ac4c6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.594474 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf109852-e90e-47b4-907d-b8609ac4c6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.594761 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf109852-e90e-47b4-907d-b8609ac4c6c4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.601726 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-0f2da46f-2e83-47a2-867f-8bd56f60eb80 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:17.602769 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf109852-e90e-47b4-907d-b8609ac4c6c4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:17.602949 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-0f2da46f-2e83-47a2-867f-8bd56f60eb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:17.604552 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf109852-e90e-47b4-907d-b8609ac4c6c4 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:17.610582 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 39/78] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:17.611808 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc2fe1-eb4d-467d-9b57-740d2dec94ea None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.612099 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc2fe1-eb4d-467d-9b57-740d2dec94ea None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.612377 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc2fe1-eb4d-467d-9b57-740d2dec94ea None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.614073 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 40/79] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:17.614176 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 40/80] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:17.619232 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc2fe1-eb4d-467d-9b57-740d2dec94ea None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.619341 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf109852-e90e-47b4-907d-b8609ac4c6c4 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.623606 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf109852-e90e-47b4-907d-b8609ac4c6c4 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.628621 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec28c36-fe42-40e6-832b-f83752c77c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.629500 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec28c36-fe42-40e6-832b-f83752c77c22 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.629789 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec28c36-fe42-40e6-832b-f83752c77c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.630078 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec28c36-fe42-40e6-832b-f83752c77c22 admin admin] PATH_INFO: `/v3/users/d64df7fb530c43779ba7cb0d2f2adf99` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.631269 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec28c36-fe42-40e6-832b-f83752c77c22 admin admin] RBAC: Authorizing `identity:get_user(user_id=d64df7fb530c43779ba7cb0d2f2adf99)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:17.633106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec28c36-fe42-40e6-832b-f83752c77c22 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:17.634784 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 41/81] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/users/d64df7fb530c43779ba7cb0d2f2adf99 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:17.634900 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc2fe1-eb4d-467d-9b57-740d2dec94ea None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.635587 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec28c36-fe42-40e6-832b-f83752c77c22 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.639236 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40090fa-499f-4235-b949-83855614eae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.640531 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40090fa-499f-4235-b949-83855614eae3 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.640817 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40090fa-499f-4235-b949-83855614eae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.641135 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40090fa-499f-4235-b949-83855614eae3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.641960 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40090fa-499f-4235-b949-83855614eae3 admin admin] RBAC: Adding query filter params (role.id=681adf4aa4c14ac7a9ce4ac1c261cf93, scope.project.id=966196fad6e9467e93b5762e459a1d84, user.id=690677d9b18f42639d78f5d0dd911adc) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:17.642273 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40090fa-499f-4235-b949-83855614eae3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:17.644134 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40090fa-499f-4235-b949-83855614eae3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:17.646059 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec28c36-fe42-40e6-832b-f83752c77c22 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.649613 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 41/82] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/role_assignments?user.id=690677d9b18f42639d78f5d0dd911adc&scope.project.id=966196fad6e9467e93b5762e459a1d84&role.id=681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:17.650507 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfba2c-58ee-4735-852e-4b2bb269e552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.650825 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869c852-7580-41a8-ab6c-2fb4c85fe8f2 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.651118 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869c852-7580-41a8-ab6c-2fb4c85fe8f2 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.651381 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfba2c-58ee-4735-852e-4b2bb269e552 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.651476 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869c852-7580-41a8-ab6c-2fb4c85fe8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.651672 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfba2c-58ee-4735-852e-4b2bb269e552 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.651949 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfba2c-58ee-4735-852e-4b2bb269e552 admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.653171 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfba2c-58ee-4735-852e-4b2bb269e552 admin admin] RBAC: Authorizing `identity:get_project(project_id=966196fad6e9467e93b5762e459a1d84)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:17.655516 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfba2c-58ee-4735-852e-4b2bb269e552 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:17.668756 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 42/83] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/projects/966196fad6e9467e93b5762e459a1d84 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:17.668756 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfba2c-58ee-4735-852e-4b2bb269e552 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.670662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfba2c-58ee-4735-852e-4b2bb269e552 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.678102 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da06d73-87a0-47cc-bb4b-4c6200720428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.678974 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da06d73-87a0-47cc-bb4b-4c6200720428 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.679222 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da06d73-87a0-47cc-bb4b-4c6200720428 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.679513 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da06d73-87a0-47cc-bb4b-4c6200720428 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.680899 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da06d73-87a0-47cc-bb4b-4c6200720428 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:17.682628 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da06d73-87a0-47cc-bb4b-4c6200720428 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:17.683745 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-5869c852-7580-41a8-ab6c-2fb4c85fe8f2 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:17.684481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 43/84] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:17.690583 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-5869c852-7580-41a8-ab6c-2fb4c85fe8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:17.690792 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da06d73-87a0-47cc-bb4b-4c6200720428 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.694025 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 42/85] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:17.694689 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869c852-7580-41a8-ab6c-2fb4c85fe8f2 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.697096 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da06d73-87a0-47cc-bb4b-4c6200720428 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.701816 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86dbb89-f0b9-4f76-863e-3a258d8a0224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.703836 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dbb89-f0b9-4f76-863e-3a258d8a0224 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.704231 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dbb89-f0b9-4f76-863e-3a258d8a0224 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.704803 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dbb89-f0b9-4f76-863e-3a258d8a0224 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.705299 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869c852-7580-41a8-ab6c-2fb4c85fe8f2 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.710341 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db6013-aaae-4538-a412-5c16d6f5a9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.711032 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db6013-aaae-4538-a412-5c16d6f5a9bc admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.711320 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db6013-aaae-4538-a412-5c16d6f5a9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.711602 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db6013-aaae-4538-a412-5c16d6f5a9bc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.712457 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db6013-aaae-4538-a412-5c16d6f5a9bc admin admin] RBAC: Adding query filter params (role.id=5ce68b651d084d388f8528d29fab2530, scope.project.id=966196fad6e9467e93b5762e459a1d84, user.id=690677d9b18f42639d78f5d0dd911adc) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:17.712776 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db6013-aaae-4538-a412-5c16d6f5a9bc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:17.714749 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db6013-aaae-4538-a412-5c16d6f5a9bc admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:17.718548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86dbb89-f0b9-4f76-863e-3a258d8a0224 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:17.720563 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86dbb89-f0b9-4f76-863e-3a258d8a0224 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:17.721196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 43/86] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/role_assignments?user.id=690677d9b18f42639d78f5d0dd911adc&scope.project.id=966196fad6e9467e93b5762e459a1d84&role.id=5ce68b651d084d388f8528d29fab2530 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:17.722026 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db6013-aaae-4538-a412-5c16d6f5a9bc admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.732074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db6013-aaae-4538-a412-5c16d6f5a9bc admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.732440 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 44/87] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:17.736954 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86dbb89-f0b9-4f76-863e-3a258d8a0224 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.739345 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3809c6c-e6b7-4442-9ff8-26db91326e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.740045 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3809c6c-e6b7-4442-9ff8-26db91326e33 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.740334 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3809c6c-e6b7-4442-9ff8-26db91326e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.740617 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3809c6c-e6b7-4442-9ff8-26db91326e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.741399 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3809c6c-e6b7-4442-9ff8-26db91326e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:17.743494 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3809c6c-e6b7-4442-9ff8-26db91326e33 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:17.749500 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86dbb89-f0b9-4f76-863e-3a258d8a0224 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.756584 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbecaf-96a3-475e-b143-c812f0e02793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.758000 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbecaf-96a3-475e-b143-c812f0e02793 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.758436 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbecaf-96a3-475e-b143-c812f0e02793 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.758825 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbecaf-96a3-475e-b143-c812f0e02793 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.774129 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbecaf-96a3-475e-b143-c812f0e02793 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:17.782476 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-60dbecaf-96a3-475e-b143-c812f0e02793 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 01:13:17.784073 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 45/88] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:13:17.785955 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbecaf-96a3-475e-b143-c812f0e02793 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.797383 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbecaf-96a3-475e-b143-c812f0e02793 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.802139 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f413e-715e-4463-a5cc-8535995b7a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.803041 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f413e-715e-4463-a5cc-8535995b7a5b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.803325 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f413e-715e-4463-a5cc-8535995b7a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.803600 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f413e-715e-4463-a5cc-8535995b7a5b admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.805074 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f413e-715e-4463-a5cc-8535995b7a5b admin admin] RBAC: Authorizing `identity:get_project(project_id=966196fad6e9467e93b5762e459a1d84)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:17.807223 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f413e-715e-4463-a5cc-8535995b7a5b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:17.809327 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 46/89] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/projects/966196fad6e9467e93b5762e459a1d84 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:17.809963 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f413e-715e-4463-a5cc-8535995b7a5b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.821572 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f413e-715e-4463-a5cc-8535995b7a5b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.826197 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e86d1f-ae5b-4abc-89a2-68261e9e8237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.829113 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86d1f-ae5b-4abc-89a2-68261e9e8237 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.829113 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86d1f-ae5b-4abc-89a2-68261e9e8237 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.829113 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86d1f-ae5b-4abc-89a2-68261e9e8237 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.829113 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e86d1f-ae5b-4abc-89a2-68261e9e8237 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:17.829113 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e86d1f-ae5b-4abc-89a2-68261e9e8237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:17.830716 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e86d1f-ae5b-4abc-89a2-68261e9e8237 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:17.840642 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 47/90] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:17.848056 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e86d1f-ae5b-4abc-89a2-68261e9e8237 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.859098 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e86d1f-ae5b-4abc-89a2-68261e9e8237 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.863964 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03965d4b-c416-4d38-936a-e23ba37000f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.864670 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03965d4b-c416-4d38-936a-e23ba37000f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.864981 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03965d4b-c416-4d38-936a-e23ba37000f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.865260 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03965d4b-c416-4d38-936a-e23ba37000f1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.866110 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03965d4b-c416-4d38-936a-e23ba37000f1 admin admin] RBAC: Adding query filter params (role.id=faadc5010ffb447ba5280e491c2ea2f5, scope.project.id=966196fad6e9467e93b5762e459a1d84, user.id=d64df7fb530c43779ba7cb0d2f2adf99) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:17.866414 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03965d4b-c416-4d38-936a-e23ba37000f1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:17.867532 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING py.warnings [None req-03965d4b-c416-4d38-936a-e23ba37000f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:17.867532 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: warnings.warn(msg) Aug 27 01:13:17.867532 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: Aug 27 01:13:17.868721 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03965d4b-c416-4d38-936a-e23ba37000f1 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:17.881028 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 48/91] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/role_assignments?user.id=d64df7fb530c43779ba7cb0d2f2adf99&scope.project.id=966196fad6e9467e93b5762e459a1d84&role.id=faadc5010ffb447ba5280e491c2ea2f5 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:17.881028 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03965d4b-c416-4d38-936a-e23ba37000f1 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.896424 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 44/92] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 01:13:17 2021] POST /identity/v3/projects => generated 302 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:13:17.898597 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03965d4b-c416-4d38-936a-e23ba37000f1 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.968922 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee862d3-bbfb-4746-8956-803d3535dc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:17.969795 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee862d3-bbfb-4746-8956-803d3535dc8d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:17.970082 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee862d3-bbfb-4746-8956-803d3535dc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:17.970355 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee862d3-bbfb-4746-8956-803d3535dc8d admin admin] PATH_INFO: `/v3/users/690677d9b18f42639d78f5d0dd911adc` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:17.971712 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee862d3-bbfb-4746-8956-803d3535dc8d admin admin] RBAC: Authorizing `identity:get_user(user_id=690677d9b18f42639d78f5d0dd911adc)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:17.974009 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee862d3-bbfb-4746-8956-803d3535dc8d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:17.975895 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 49/93] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/users/690677d9b18f42639d78f5d0dd911adc => generated 275 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:17.982922 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3809c6c-e6b7-4442-9ff8-26db91326e33 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:17.993866 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3809c6c-e6b7-4442-9ff8-26db91326e33 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:17.998759 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbad39f-f8f5-46b2-9d67-80a06cd21a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:18.000112 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbad39f-f8f5-46b2-9d67-80a06cd21a4a admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:18.000496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbad39f-f8f5-46b2-9d67-80a06cd21a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:18.000779 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbad39f-f8f5-46b2-9d67-80a06cd21a4a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:18.010160 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbad39f-f8f5-46b2-9d67-80a06cd21a4a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:18.012097 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbad39f-f8f5-46b2-9d67-80a06cd21a4a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:18.022997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 45/94] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:17 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:18.029828 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee862d3-bbfb-4746-8956-803d3535dc8d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:18.040480 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee862d3-bbfb-4746-8956-803d3535dc8d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:18.045362 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a517ef-007e-4380-b15a-47a4a14d891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:18.047016 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a517ef-007e-4380-b15a-47a4a14d891e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:18.047301 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a517ef-007e-4380-b15a-47a4a14d891e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:18.047560 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a517ef-007e-4380-b15a-47a4a14d891e admin admin] PATH_INFO: `/v3/projects/ef38c7434f314bc8a24b592fc7de21d5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:18.048938 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a517ef-007e-4380-b15a-47a4a14d891e admin admin] RBAC: Authorizing `identity:get_project(project_id=ef38c7434f314bc8a24b592fc7de21d5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:18.051081 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a517ef-007e-4380-b15a-47a4a14d891e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:18.053220 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 50/95] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:18 2021] GET /identity/v3/projects/ef38c7434f314bc8a24b592fc7de21d5 => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:18.060067 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbad39f-f8f5-46b2-9d67-80a06cd21a4a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:18.069654 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbad39f-f8f5-46b2-9d67-80a06cd21a4a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:18.074244 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6feb717-85cd-4fe2-8ec0-bce039b2fad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:18.074926 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6feb717-85cd-4fe2-8ec0-bce039b2fad6 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:18.075199 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6feb717-85cd-4fe2-8ec0-bce039b2fad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:18.075477 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6feb717-85cd-4fe2-8ec0-bce039b2fad6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:18.076318 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6feb717-85cd-4fe2-8ec0-bce039b2fad6 admin admin] RBAC: Adding query filter params (role.id=681adf4aa4c14ac7a9ce4ac1c261cf93, scope.project.id=ef38c7434f314bc8a24b592fc7de21d5, user.id=690677d9b18f42639d78f5d0dd911adc) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:18.076634 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6feb717-85cd-4fe2-8ec0-bce039b2fad6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:18.079251 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6feb717-85cd-4fe2-8ec0-bce039b2fad6 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:18.085924 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 46/96] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:18 2021] GET /identity/v3/role_assignments?user.id=690677d9b18f42639d78f5d0dd911adc&scope.project.id=ef38c7434f314bc8a24b592fc7de21d5&role.id=681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:20.231012 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dd167-5d0f-478d-89d0-1850af60068c None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.231555 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dd167-5d0f-478d-89d0-1850af60068c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.231555 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dd167-5d0f-478d-89d0-1850af60068c None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.234027 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 51/97] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:20.240704 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f9306-23cb-4306-8809-ad2930e292b5 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.241247 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f9306-23cb-4306-8809-ad2930e292b5 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.241348 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f9306-23cb-4306-8809-ad2930e292b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.266989 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-a02f9306-23cb-4306-8809-ad2930e292b5 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:20.268213 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a02f9306-23cb-4306-8809-ad2930e292b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:20.276110 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 47/98] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:20.301387 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15dd167-5d0f-478d-89d0-1850af60068c None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:20.314604 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15dd167-5d0f-478d-89d0-1850af60068c None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:20.319283 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f179d1b-86d0-4606-99ab-312a2d846b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:20.320206 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f179d1b-86d0-4606-99ab-312a2d846b21 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.322196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ceb3b-3948-4f5f-834d-5db063f989c2 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.322482 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ceb3b-3948-4f5f-834d-5db063f989c2 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.322758 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ceb3b-3948-4f5f-834d-5db063f989c2 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.324522 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 48/99] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:13:20.324636 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f179d1b-86d0-4606-99ab-312a2d846b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.325031 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f179d1b-86d0-4606-99ab-312a2d846b21 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.331310 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58af26-3a6f-4a06-88b8-de06991d4936 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.331602 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58af26-3a6f-4a06-88b8-de06991d4936 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.331878 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58af26-3a6f-4a06-88b8-de06991d4936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.352494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f179d1b-86d0-4606-99ab-312a2d846b21 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:20.359882 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-5f179d1b-86d0-4606-99ab-312a2d846b21 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 01:13:20.369784 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 52/100] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:20.370749 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-ee58af26-3a6f-4a06-88b8-de06991d4936 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:20.371949 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ee58af26-3a6f-4a06-88b8-de06991d4936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:20.378945 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f179d1b-86d0-4606-99ab-312a2d846b21 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:20.386071 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 49/101] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 27 01:13:20.399139 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f179d1b-86d0-4606-99ab-312a2d846b21 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:20.409187 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a03dea-4571-435d-b396-27fdc53a000e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:20.409891 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a03dea-4571-435d-b396-27fdc53a000e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.410175 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a03dea-4571-435d-b396-27fdc53a000e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.410450 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a03dea-4571-435d-b396-27fdc53a000e admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.411219 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a03dea-4571-435d-b396-27fdc53a000e admin admin] RBAC: Adding query filter params (name=member) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:20.411525 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a03dea-4571-435d-b396-27fdc53a000e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:20.413219 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a03dea-4571-435d-b396-27fdc53a000e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:20.428790 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 53/102] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 01:13:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:20.434942 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58af26-3a6f-4a06-88b8-de06991d4936 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:20.442542 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a03dea-4571-435d-b396-27fdc53a000e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:20.449686 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58af26-3a6f-4a06-88b8-de06991d4936 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:20.459179 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a03dea-4571-435d-b396-27fdc53a000e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:20.460898 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf47c1c-559f-4ba4-8a12-a7228c0b0f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:20.461779 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf47c1c-559f-4ba4-8a12-a7228c0b0f3b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.462064 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf47c1c-559f-4ba4-8a12-a7228c0b0f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.462340 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf47c1c-559f-4ba4-8a12-a7228c0b0f3b admin admin] PATH_INFO: `/v3/users/690677d9b18f42639d78f5d0dd911adc` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.463793 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf47c1c-559f-4ba4-8a12-a7228c0b0f3b admin admin] RBAC: Authorizing `identity:get_user(user_id=690677d9b18f42639d78f5d0dd911adc)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:20.466113 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf47c1c-559f-4ba4-8a12-a7228c0b0f3b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:20.468027 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 50/103] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:20 2021] GET /identity/v3/users/690677d9b18f42639d78f5d0dd911adc => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:20.472333 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728adc0e-179a-42b8-b6a5-7be2f70cfafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:20.474371 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf47c1c-559f-4ba4-8a12-a7228c0b0f3b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:20.474768 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728adc0e-179a-42b8-b6a5-7be2f70cfafe admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.475058 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728adc0e-179a-42b8-b6a5-7be2f70cfafe admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.475336 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728adc0e-179a-42b8-b6a5-7be2f70cfafe admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.485658 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf47c1c-559f-4ba4-8a12-a7228c0b0f3b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:20.489307 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728adc0e-179a-42b8-b6a5-7be2f70cfafe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:20.490075 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5f9d4-970e-4e9f-9dad-03b79deaa1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:20.490921 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5f9d4-970e-4e9f-9dad-03b79deaa1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.491203 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5f9d4-970e-4e9f-9dad-03b79deaa1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.491478 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5f9d4-970e-4e9f-9dad-03b79deaa1a5 admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.492713 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5f9d4-970e-4e9f-9dad-03b79deaa1a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=966196fad6e9467e93b5762e459a1d84)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:20.494853 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5f9d4-970e-4e9f-9dad-03b79deaa1a5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:20.496518 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 51/104] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:20 2021] GET /identity/v3/projects/966196fad6e9467e93b5762e459a1d84 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:20.498053 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70491a-32f4-4ada-abcc-cf5658f7e13b None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.498346 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70491a-32f4-4ada-abcc-cf5658f7e13b None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.498445 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-728adc0e-179a-42b8-b6a5-7be2f70cfafe admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 01:13:20.498623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70491a-32f4-4ada-abcc-cf5658f7e13b None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.500318 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 54/105] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:13:20 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:13:20.503349 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728adc0e-179a-42b8-b6a5-7be2f70cfafe admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:20.505340 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 52/106] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:20 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:20.507297 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70491a-32f4-4ada-abcc-cf5658f7e13b None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:20.516045 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728adc0e-179a-42b8-b6a5-7be2f70cfafe admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:20.520466 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d47bb8-a1cb-440d-af17-1ca3f0ab932d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:20.521562 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d47bb8-a1cb-440d-af17-1ca3f0ab932d admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.521845 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d47bb8-a1cb-440d-af17-1ca3f0ab932d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.522123 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d47bb8-a1cb-440d-af17-1ca3f0ab932d admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84/users/690677d9b18f42639d78f5d0dd911adc/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.524074 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d47bb8-a1cb-440d-af17-1ca3f0ab932d admin admin] RBAC: Authorizing `identity:create_grant(project_id=966196fad6e9467e93b5762e459a1d84, user_id=690677d9b18f42639d78f5d0dd911adc, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:20.527029 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d47bb8-a1cb-440d-af17-1ca3f0ab932d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:20.527603 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70491a-32f4-4ada-abcc-cf5658f7e13b None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:20.533165 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34fca3-850e-44c2-9210-0ec0677905b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:20.533970 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34fca3-850e-44c2-9210-0ec0677905b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.534341 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34fca3-850e-44c2-9210-0ec0677905b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.534731 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34fca3-850e-44c2-9210-0ec0677905b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.535575 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34fca3-850e-44c2-9210-0ec0677905b4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:20.535956 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34fca3-850e-44c2-9210-0ec0677905b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:20.537646 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34fca3-850e-44c2-9210-0ec0677905b4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:20.546608 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 53/107] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:20 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:20.552573 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd223b-f53e-4b80-93e2-21ea7a49c1b4 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.552573 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd223b-f53e-4b80-93e2-21ea7a49c1b4 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.552573 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd223b-f53e-4b80-93e2-21ea7a49c1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.569561 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-e9fd223b-f53e-4b80-93e2-21ea7a49c1b4 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:20.570795 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e9fd223b-f53e-4b80-93e2-21ea7a49c1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:20.578608 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 54/108] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:20.579168 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd223b-f53e-4b80-93e2-21ea7a49c1b4 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:20.594692 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd223b-f53e-4b80-93e2-21ea7a49c1b4 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:20.600027 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e684ba-4322-4e69-a9fe-cf0074fca00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:20.601436 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e684ba-4322-4e69-a9fe-cf0074fca00c admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.601907 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e684ba-4322-4e69-a9fe-cf0074fca00c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.602187 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e684ba-4322-4e69-a9fe-cf0074fca00c admin admin] PATH_INFO: `/v3/users/690677d9b18f42639d78f5d0dd911adc` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.603453 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e684ba-4322-4e69-a9fe-cf0074fca00c admin admin] RBAC: Authorizing `identity:get_user(user_id=690677d9b18f42639d78f5d0dd911adc)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:20.605922 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e684ba-4322-4e69-a9fe-cf0074fca00c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:20.607703 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 55/109] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:20 2021] GET /identity/v3/users/690677d9b18f42639d78f5d0dd911adc => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:20.613689 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e684ba-4322-4e69-a9fe-cf0074fca00c admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:20.626118 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 55/110] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:13:20 2021] PUT /identity/v3/projects/966196fad6e9467e93b5762e459a1d84/users/690677d9b18f42639d78f5d0dd911adc/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:13:20.627015 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d47bb8-a1cb-440d-af17-1ca3f0ab932d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:20.627602 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e684ba-4322-4e69-a9fe-cf0074fca00c admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:20.697950 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdf161-c608-4abe-aa7b-234161f8d273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:20.698838 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdf161-c608-4abe-aa7b-234161f8d273 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.699121 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdf161-c608-4abe-aa7b-234161f8d273 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.699399 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdf161-c608-4abe-aa7b-234161f8d273 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.709634 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d47bb8-a1cb-440d-af17-1ca3f0ab932d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:20.712612 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffdf161-c608-4abe-aa7b-234161f8d273 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:20.715350 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3ff83-16e0-42de-a621-d440fce8c660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:20.719215 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3ff83-16e0-42de-a621-d440fce8c660 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.719215 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3ff83-16e0-42de-a621-d440fce8c660 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.719215 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3ff83-16e0-42de-a621-d440fce8c660 admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.719215 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3ff83-16e0-42de-a621-d440fce8c660 admin admin] RBAC: Authorizing `identity:get_project(project_id=966196fad6e9467e93b5762e459a1d84)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:20.721102 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-3ffdf161-c608-4abe-aa7b-234161f8d273 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:13:20.722168 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3ff83-16e0-42de-a621-d440fce8c660 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:20.722618 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 56/111] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:13:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:20.724557 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 56/112] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:20 2021] GET /identity/v3/projects/966196fad6e9467e93b5762e459a1d84 => generated 298 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:20.732004 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdf161-c608-4abe-aa7b-234161f8d273 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:20.736180 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3ff83-16e0-42de-a621-d440fce8c660 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:20.743916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdf161-c608-4abe-aa7b-234161f8d273 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:20.756161 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3ff83-16e0-42de-a621-d440fce8c660 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:20.757081 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e6376-6171-412e-b376-8b5aa4fb7d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:20.758003 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e6376-6171-412e-b376-8b5aa4fb7d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.758432 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e6376-6171-412e-b376-8b5aa4fb7d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.758712 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e6376-6171-412e-b376-8b5aa4fb7d8f admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84/users/690677d9b18f42639d78f5d0dd911adc/roles/5ce68b651d084d388f8528d29fab2530` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.762684 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e6376-6171-412e-b376-8b5aa4fb7d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=966196fad6e9467e93b5762e459a1d84, user_id=690677d9b18f42639d78f5d0dd911adc, role_id=5ce68b651d084d388f8528d29fab2530)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:20.763720 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING py.warnings [None req-f44e6376-6171-412e-b376-8b5aa4fb7d8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:20.763720 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: warnings.warn(msg) Aug 27 01:13:20.763720 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: Aug 27 01:13:20.766541 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e6376-6171-412e-b376-8b5aa4fb7d8f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:20.772642 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fa3b0-280f-4290-a9d1-0881bfd7e6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:20.773499 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fa3b0-280f-4290-a9d1-0881bfd7e6af admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.773784 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fa3b0-280f-4290-a9d1-0881bfd7e6af admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.774059 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fa3b0-280f-4290-a9d1-0881bfd7e6af admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.775097 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fa3b0-280f-4290-a9d1-0881bfd7e6af admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:20.775408 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fa3b0-280f-4290-a9d1-0881bfd7e6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:20.777070 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fa3b0-280f-4290-a9d1-0881bfd7e6af admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:20.791435 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 57/113] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:20.802004 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fa3b0-280f-4290-a9d1-0881bfd7e6af admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:20.813286 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fa3b0-280f-4290-a9d1-0881bfd7e6af admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:20.818452 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabba71d-d0ef-4026-9608-783e80c2bf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:20.819341 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabba71d-d0ef-4026-9608-783e80c2bf42 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.819627 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabba71d-d0ef-4026-9608-783e80c2bf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.819904 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabba71d-d0ef-4026-9608-783e80c2bf42 admin admin] PATH_INFO: `/v3/users/d64df7fb530c43779ba7cb0d2f2adf99` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.821232 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabba71d-d0ef-4026-9608-783e80c2bf42 admin admin] RBAC: Authorizing `identity:get_user(user_id=d64df7fb530c43779ba7cb0d2f2adf99)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:20.824294 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabba71d-d0ef-4026-9608-783e80c2bf42 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:20.826233 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 58/114] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:20 2021] GET /identity/v3/users/d64df7fb530c43779ba7cb0d2f2adf99 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:20.828071 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9de768-b6e8-4bfc-a510-1b2f160efcda None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.828359 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9de768-b6e8-4bfc-a510-1b2f160efcda None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.834098 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9de768-b6e8-4bfc-a510-1b2f160efcda None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.835298 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 59/115] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:20 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:20.836146 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9de768-b6e8-4bfc-a510-1b2f160efcda None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:20.855563 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9de768-b6e8-4bfc-a510-1b2f160efcda None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:20.860889 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da166b-439d-45f4-a836-093ed1edecf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:20.861922 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da166b-439d-45f4-a836-093ed1edecf0 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.862212 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da166b-439d-45f4-a836-093ed1edecf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.862505 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da166b-439d-45f4-a836-093ed1edecf0 admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.863798 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da166b-439d-45f4-a836-093ed1edecf0 admin admin] RBAC: Authorizing `identity:get_project(project_id=966196fad6e9467e93b5762e459a1d84)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:20.865916 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da166b-439d-45f4-a836-093ed1edecf0 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:20.867639 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 60/116] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:20 2021] GET /identity/v3/projects/966196fad6e9467e93b5762e459a1d84 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:20.868810 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcc173-b5c1-4357-98b8-e7e3e772c5d8 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.869171 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcc173-b5c1-4357-98b8-e7e3e772c5d8 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.869549 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcc173-b5c1-4357-98b8-e7e3e772c5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.884960 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 57/117] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:13:20 2021] PUT /identity/v3/projects/966196fad6e9467e93b5762e459a1d84/users/690677d9b18f42639d78f5d0dd911adc/roles/5ce68b651d084d388f8528d29fab2530 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:13:20.886454 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e6376-6171-412e-b376-8b5aa4fb7d8f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:20.888865 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-80fcc173-b5c1-4357-98b8-e7e3e772c5d8 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:20.890862 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-80fcc173-b5c1-4357-98b8-e7e3e772c5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:20.971936 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 61/118] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:20.981304 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e6376-6171-412e-b376-8b5aa4fb7d8f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:20.992087 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b7ab0-67e2-4e4c-86ad-2fc8e10bba61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:20.993483 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b7ab0-67e2-4e4c-86ad-2fc8e10bba61 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:20.993973 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b7ab0-67e2-4e4c-86ad-2fc8e10bba61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:20.994467 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b7ab0-67e2-4e4c-86ad-2fc8e10bba61 admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84/users/d64df7fb530c43779ba7cb0d2f2adf99/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:20.996890 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b7ab0-67e2-4e4c-86ad-2fc8e10bba61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=966196fad6e9467e93b5762e459a1d84, user_id=d64df7fb530c43779ba7cb0d2f2adf99, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:20.998000 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcc173-b5c1-4357-98b8-e7e3e772c5d8 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:21.005845 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b7ab0-67e2-4e4c-86ad-2fc8e10bba61 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:21.011422 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcc173-b5c1-4357-98b8-e7e3e772c5d8 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:21.019995 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff009ae3-1db7-47dc-8bdc-8f513d160521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:21.021152 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff009ae3-1db7-47dc-8bdc-8f513d160521 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:21.021445 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff009ae3-1db7-47dc-8bdc-8f513d160521 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:21.021805 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff009ae3-1db7-47dc-8bdc-8f513d160521 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:21.035505 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff009ae3-1db7-47dc-8bdc-8f513d160521 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:21.043164 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-ff009ae3-1db7-47dc-8bdc-8f513d160521 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 01:13:21.044428 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 62/119] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:13:21.052029 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff009ae3-1db7-47dc-8bdc-8f513d160521 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:21.064899 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff009ae3-1db7-47dc-8bdc-8f513d160521 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:21.069732 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcfa3a-bb08-498c-a530-6cbef9ed5609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:21.070421 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcfa3a-bb08-498c-a530-6cbef9ed5609 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:21.070746 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcfa3a-bb08-498c-a530-6cbef9ed5609 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:21.071027 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcfa3a-bb08-498c-a530-6cbef9ed5609 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:21.071795 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fcfa3a-bb08-498c-a530-6cbef9ed5609 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:21.072106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fcfa3a-bb08-498c-a530-6cbef9ed5609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:21.073948 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fcfa3a-bb08-498c-a530-6cbef9ed5609 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:21.084579 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 63/120] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 01:13:21 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:21.086016 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b96a60-5b34-4e65-ad61-7709a96732d5 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:21.086309 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b96a60-5b34-4e65-ad61-7709a96732d5 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:21.086589 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b96a60-5b34-4e65-ad61-7709a96732d5 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:21.090611 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 64/121] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:21.096794 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ba1a4-11a3-4f93-bdc4-e9e506cbc7fc None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:21.097403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ba1a4-11a3-4f93-bdc4-e9e506cbc7fc None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:21.097874 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ba1a4-11a3-4f93-bdc4-e9e506cbc7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:21.099035 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 58/122] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:13:20 2021] PUT /identity/v3/projects/966196fad6e9467e93b5762e459a1d84/users/d64df7fb530c43779ba7cb0d2f2adf99/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:13:21.100129 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b7ab0-67e2-4e4c-86ad-2fc8e10bba61 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:21.120008 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-999ba1a4-11a3-4f93-bdc4-e9e506cbc7fc None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:21.121642 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-999ba1a4-11a3-4f93-bdc4-e9e506cbc7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:21.185208 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b7ab0-67e2-4e4c-86ad-2fc8e10bba61 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:21.195637 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef2f07-0878-47f9-950a-a8997b7d7328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:21.197963 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef2f07-0878-47f9-950a-a8997b7d7328 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:21.198592 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef2f07-0878-47f9-950a-a8997b7d7328 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:21.199067 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef2f07-0878-47f9-950a-a8997b7d7328 admin admin] PATH_INFO: `/v3/users/690677d9b18f42639d78f5d0dd911adc` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:21.201439 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef2f07-0878-47f9-950a-a8997b7d7328 admin admin] RBAC: Authorizing `identity:get_user(user_id=690677d9b18f42639d78f5d0dd911adc)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:21.204427 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef2f07-0878-47f9-950a-a8997b7d7328 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:21.206672 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 59/123] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:21 2021] GET /identity/v3/users/690677d9b18f42639d78f5d0dd911adc => generated 275 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:21.211933 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 65/124] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:21.213339 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef2f07-0878-47f9-950a-a8997b7d7328 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:21.230269 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef2f07-0878-47f9-950a-a8997b7d7328 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:21.237005 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ba1a4-11a3-4f93-bdc4-e9e506cbc7fc None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:21.239129 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267c487-3af1-491e-aaa3-d243877a316e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:21.240187 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267c487-3af1-491e-aaa3-d243877a316e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:21.240481 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267c487-3af1-491e-aaa3-d243877a316e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:21.240765 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267c487-3af1-491e-aaa3-d243877a316e admin admin] PATH_INFO: `/v3/projects/ef38c7434f314bc8a24b592fc7de21d5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:21.245689 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267c487-3af1-491e-aaa3-d243877a316e admin admin] RBAC: Authorizing `identity:get_project(project_id=ef38c7434f314bc8a24b592fc7de21d5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:21.246497 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ba1a4-11a3-4f93-bdc4-e9e506cbc7fc None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:21.247810 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267c487-3af1-491e-aaa3-d243877a316e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:21.250040 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 60/125] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:21 2021] GET /identity/v3/projects/ef38c7434f314bc8a24b592fc7de21d5 => generated 312 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:21.251610 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242231da-7649-4558-a18d-472b9293efab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:21.252555 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242231da-7649-4558-a18d-472b9293efab admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:21.252904 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242231da-7649-4558-a18d-472b9293efab admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:21.253235 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242231da-7649-4558-a18d-472b9293efab admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:21.254413 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242231da-7649-4558-a18d-472b9293efab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:21.256148 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267c487-3af1-491e-aaa3-d243877a316e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:21.256315 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242231da-7649-4558-a18d-472b9293efab admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:21.258054 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 66/126] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:21.264023 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242231da-7649-4558-a18d-472b9293efab admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:21.275307 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267c487-3af1-491e-aaa3-d243877a316e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:21.276296 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242231da-7649-4558-a18d-472b9293efab admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:21.281461 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f225fb6-d17f-4dcb-9243-07173e3a5034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:21.282293 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f225fb6-d17f-4dcb-9243-07173e3a5034 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:21.282668 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f225fb6-d17f-4dcb-9243-07173e3a5034 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:21.282951 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f225fb6-d17f-4dcb-9243-07173e3a5034 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:21.283743 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f225fb6-d17f-4dcb-9243-07173e3a5034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:21.284903 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING py.warnings [None req-3f225fb6-d17f-4dcb-9243-07173e3a5034 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:21.284903 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: warnings.warn(msg) Aug 27 01:13:21.284903 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: Aug 27 01:13:21.286282 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f225fb6-d17f-4dcb-9243-07173e3a5034 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:21.293554 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0827bb3-3f2f-444a-b732-ed3f65d07167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:21.294473 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0827bb3-3f2f-444a-b732-ed3f65d07167 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:21.294760 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0827bb3-3f2f-444a-b732-ed3f65d07167 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:21.295038 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0827bb3-3f2f-444a-b732-ed3f65d07167 admin admin] PATH_INFO: `/v3/projects/ef38c7434f314bc8a24b592fc7de21d5/users/690677d9b18f42639d78f5d0dd911adc/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:21.297767 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0827bb3-3f2f-444a-b732-ed3f65d07167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef38c7434f314bc8a24b592fc7de21d5, user_id=690677d9b18f42639d78f5d0dd911adc, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:21.300447 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0827bb3-3f2f-444a-b732-ed3f65d07167 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:21.398318 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 67/127] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 01:13:21 2021] POST /identity/v3/users => generated 283 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:13:21.403145 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 61/128] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:13:21 2021] PUT /identity/v3/projects/ef38c7434f314bc8a24b592fc7de21d5/users/690677d9b18f42639d78f5d0dd911adc/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:13:23.286161 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360b0d9-641f-4719-a848-a9398c76a560 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:23.287185 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360b0d9-641f-4719-a848-a9398c76a560 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:23.287677 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360b0d9-641f-4719-a848-a9398c76a560 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:23.289729 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 68/129] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:23.296589 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfefd7c-bf16-4732-a61d-8f3392a1701e None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:23.297522 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfefd7c-bf16-4732-a61d-8f3392a1701e None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:23.298009 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfefd7c-bf16-4732-a61d-8f3392a1701e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:23.322475 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-1bfefd7c-bf16-4732-a61d-8f3392a1701e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:23.324024 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1bfefd7c-bf16-4732-a61d-8f3392a1701e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:23.395708 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 62/130] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:23.426559 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360b0d9-641f-4719-a848-a9398c76a560 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:23.442801 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360b0d9-641f-4719-a848-a9398c76a560 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:23.449457 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e38f79-f325-42b6-8473-12dac77bf255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:23.450509 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e38f79-f325-42b6-8473-12dac77bf255 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:23.450997 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e38f79-f325-42b6-8473-12dac77bf255 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:23.451473 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e38f79-f325-42b6-8473-12dac77bf255 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:23.463978 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e38f79-f325-42b6-8473-12dac77bf255 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:23.471291 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-47e38f79-f325-42b6-8473-12dac77bf255 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 01:13:23.472744 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 69/131] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:23.479409 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfefd7c-bf16-4732-a61d-8f3392a1701e None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:23.489519 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfefd7c-bf16-4732-a61d-8f3392a1701e None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:23.498343 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db47481-e062-464a-b940-a31e7b46f10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:23.499625 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db47481-e062-464a-b940-a31e7b46f10f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:23.500143 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db47481-e062-464a-b940-a31e7b46f10f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:23.500621 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db47481-e062-464a-b940-a31e7b46f10f admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:23.501609 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db47481-e062-464a-b940-a31e7b46f10f admin admin] RBAC: Adding query filter params (name=member) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:23.502152 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db47481-e062-464a-b940-a31e7b46f10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:23.503969 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db47481-e062-464a-b940-a31e7b46f10f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:23.517393 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 63/132] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 01:13:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:23.523883 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e38f79-f325-42b6-8473-12dac77bf255 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:23.535136 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e38f79-f325-42b6-8473-12dac77bf255 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:23.546644 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de64a6-cd3a-4c84-8d82-af6647fd2c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:23.547889 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de64a6-cd3a-4c84-8d82-af6647fd2c16 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:23.548385 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de64a6-cd3a-4c84-8d82-af6647fd2c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:23.548886 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de64a6-cd3a-4c84-8d82-af6647fd2c16 admin admin] PATH_INFO: `/v3/users/690677d9b18f42639d78f5d0dd911adc` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:23.550482 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de64a6-cd3a-4c84-8d82-af6647fd2c16 admin admin] RBAC: Authorizing `identity:get_user(user_id=690677d9b18f42639d78f5d0dd911adc)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:23.553047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de64a6-cd3a-4c84-8d82-af6647fd2c16 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:23.555446 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 70/133] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:23 2021] GET /identity/v3/users/690677d9b18f42639d78f5d0dd911adc => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:23.562395 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db47481-e062-464a-b940-a31e7b46f10f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:23.574196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db47481-e062-464a-b940-a31e7b46f10f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:23.585218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bc5c4-f8e0-49c4-bf5c-a7307acb2649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:23.585900 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bc5c4-f8e0-49c4-bf5c-a7307acb2649 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:23.586185 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bc5c4-f8e0-49c4-bf5c-a7307acb2649 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:23.586463 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bc5c4-f8e0-49c4-bf5c-a7307acb2649 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:23.600570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1bc5c4-f8e0-49c4-bf5c-a7307acb2649 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:23.602435 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1bc5c4-f8e0-49c4-bf5c-a7307acb2649 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:23.614992 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 64/134] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:23.621343 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de64a6-cd3a-4c84-8d82-af6647fd2c16 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:23.638095 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de64a6-cd3a-4c84-8d82-af6647fd2c16 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:23.647816 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc5919-991a-4084-a840-f1910a97c68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:23.648994 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc5919-991a-4084-a840-f1910a97c68c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:23.649504 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc5919-991a-4084-a840-f1910a97c68c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:23.649981 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc5919-991a-4084-a840-f1910a97c68c admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:23.653434 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc5919-991a-4084-a840-f1910a97c68c admin admin] RBAC: Authorizing `identity:get_project(project_id=966196fad6e9467e93b5762e459a1d84)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:23.656026 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc5919-991a-4084-a840-f1910a97c68c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:23.658071 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 71/135] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:23 2021] GET /identity/v3/projects/966196fad6e9467e93b5762e459a1d84 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:23.664815 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bc5c4-f8e0-49c4-bf5c-a7307acb2649 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:23.677875 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bc5c4-f8e0-49c4-bf5c-a7307acb2649 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:23.684960 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53413199-42e8-4234-8f39-7e0150bbd7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:23.685621 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53413199-42e8-4234-8f39-7e0150bbd7cd admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:23.685903 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53413199-42e8-4234-8f39-7e0150bbd7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:23.686783 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53413199-42e8-4234-8f39-7e0150bbd7cd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:23.687883 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53413199-42e8-4234-8f39-7e0150bbd7cd admin admin] RBAC: Adding query filter params (role.id=681adf4aa4c14ac7a9ce4ac1c261cf93, scope.project.id=966196fad6e9467e93b5762e459a1d84, user.id=690677d9b18f42639d78f5d0dd911adc) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:23.688197 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53413199-42e8-4234-8f39-7e0150bbd7cd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:23.690072 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53413199-42e8-4234-8f39-7e0150bbd7cd admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:23.701772 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 65/136] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:23 2021] GET /identity/v3/role_assignments?user.id=690677d9b18f42639d78f5d0dd911adc&scope.project.id=966196fad6e9467e93b5762e459a1d84&role.id=681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:23.751404 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23244470-85c7-4248-aaba-ca9afc08b90c None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:23.751989 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23244470-85c7-4248-aaba-ca9afc08b90c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:23.752449 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23244470-85c7-4248-aaba-ca9afc08b90c None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:23.754866 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 72/137] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:23.761132 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d7439-5e2d-488b-9cfa-b8bd4209e312 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:23.761451 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d7439-5e2d-488b-9cfa-b8bd4209e312 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:23.761704 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d7439-5e2d-488b-9cfa-b8bd4209e312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:23.785967 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-4f9d7439-5e2d-488b-9cfa-b8bd4209e312 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:23.787547 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-4f9d7439-5e2d-488b-9cfa-b8bd4209e312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:23.799110 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 66/138] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:23.855953 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23244470-85c7-4248-aaba-ca9afc08b90c None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:23.871518 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23244470-85c7-4248-aaba-ca9afc08b90c None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:23.878382 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07962d8a-5f79-45da-b05b-f8bf90f51fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:23.879630 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07962d8a-5f79-45da-b05b-f8bf90f51fcb admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:23.880139 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07962d8a-5f79-45da-b05b-f8bf90f51fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:23.880687 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07962d8a-5f79-45da-b05b-f8bf90f51fcb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:23.894322 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07962d8a-5f79-45da-b05b-f8bf90f51fcb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:23.902144 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-07962d8a-5f79-45da-b05b-f8bf90f51fcb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 01:13:23.903670 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 73/139] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:13:23 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:23.910718 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d7439-5e2d-488b-9cfa-b8bd4209e312 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:23.921081 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d7439-5e2d-488b-9cfa-b8bd4209e312 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:23.929216 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98991017-7238-46d5-af54-703ba6ff9d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:23.930192 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98991017-7238-46d5-af54-703ba6ff9d64 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:23.930697 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98991017-7238-46d5-af54-703ba6ff9d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:23.931175 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98991017-7238-46d5-af54-703ba6ff9d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:23.932138 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98991017-7238-46d5-af54-703ba6ff9d64 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:23.932690 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98991017-7238-46d5-af54-703ba6ff9d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:23.934620 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98991017-7238-46d5-af54-703ba6ff9d64 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:23.948666 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 67/140] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:23 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:23.955279 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07962d8a-5f79-45da-b05b-f8bf90f51fcb admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:23.969693 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07962d8a-5f79-45da-b05b-f8bf90f51fcb admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:23.975030 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d0fff-09f3-42f2-a203-b8107495a87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:23.976289 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d0fff-09f3-42f2-a203-b8107495a87d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:23.976785 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d0fff-09f3-42f2-a203-b8107495a87d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:23.977325 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d0fff-09f3-42f2-a203-b8107495a87d admin admin] PATH_INFO: `/v3/users/690677d9b18f42639d78f5d0dd911adc` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:23.980051 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d0fff-09f3-42f2-a203-b8107495a87d admin admin] RBAC: Authorizing `identity:get_user(user_id=690677d9b18f42639d78f5d0dd911adc)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:23.982580 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d0fff-09f3-42f2-a203-b8107495a87d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:23.985151 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 74/141] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:23 2021] GET /identity/v3/users/690677d9b18f42639d78f5d0dd911adc => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:23.991412 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98991017-7238-46d5-af54-703ba6ff9d64 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:24.002930 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98991017-7238-46d5-af54-703ba6ff9d64 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:24.008111 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d2201-d68b-4420-8ecd-de11d0f2b8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:24.009085 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d2201-d68b-4420-8ecd-de11d0f2b8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:24.009628 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d2201-d68b-4420-8ecd-de11d0f2b8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:24.010148 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d2201-d68b-4420-8ecd-de11d0f2b8c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:24.020802 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d2201-d68b-4420-8ecd-de11d0f2b8c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:24.023063 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d2201-d68b-4420-8ecd-de11d0f2b8c5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:24.031295 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93a852-d526-4116-a103-42e4893a8175 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:24.031825 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93a852-d526-4116-a103-42e4893a8175 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:24.032354 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93a852-d526-4116-a103-42e4893a8175 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:24.034571 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 75/142] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:13:24.038983 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 68/143] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:24.043782 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596158f-15ca-4261-81b1-18b7e0b0be10 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:24.044077 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596158f-15ca-4261-81b1-18b7e0b0be10 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:24.044566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596158f-15ca-4261-81b1-18b7e0b0be10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:24.054008 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d2201-d68b-4420-8ecd-de11d0f2b8c5 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:24.072310 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d2201-d68b-4420-8ecd-de11d0f2b8c5 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:24.074895 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-3596158f-15ca-4261-81b1-18b7e0b0be10 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:24.079179 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-3596158f-15ca-4261-81b1-18b7e0b0be10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:24.081331 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d96a7c-8320-4a93-8fee-f816a820feef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:24.082261 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d96a7c-8320-4a93-8fee-f816a820feef admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:24.082550 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d96a7c-8320-4a93-8fee-f816a820feef admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:24.082972 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d96a7c-8320-4a93-8fee-f816a820feef admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:24.084255 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d96a7c-8320-4a93-8fee-f816a820feef admin admin] RBAC: Authorizing `identity:get_project(project_id=966196fad6e9467e93b5762e459a1d84)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:24.086632 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d96a7c-8320-4a93-8fee-f816a820feef admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:24.088870 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 69/144] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:24 2021] GET /identity/v3/projects/966196fad6e9467e93b5762e459a1d84 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:24.095581 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d96a7c-8320-4a93-8fee-f816a820feef admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:24.098432 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 76/145] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:24.107575 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d96a7c-8320-4a93-8fee-f816a820feef admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:24.114174 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879b57d-b7f6-4522-84da-f8a7e886a9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:24.114840 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879b57d-b7f6-4522-84da-f8a7e886a9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:24.115184 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879b57d-b7f6-4522-84da-f8a7e886a9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:24.115468 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879b57d-b7f6-4522-84da-f8a7e886a9c3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:24.116420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879b57d-b7f6-4522-84da-f8a7e886a9c3 admin admin] RBAC: Adding query filter params (role.id=5ce68b651d084d388f8528d29fab2530, scope.project.id=966196fad6e9467e93b5762e459a1d84, user.id=690677d9b18f42639d78f5d0dd911adc) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:24.116739 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879b57d-b7f6-4522-84da-f8a7e886a9c3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:24.119511 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879b57d-b7f6-4522-84da-f8a7e886a9c3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:24.127608 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 70/146] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:24 2021] GET /identity/v3/role_assignments?user.id=690677d9b18f42639d78f5d0dd911adc&scope.project.id=966196fad6e9467e93b5762e459a1d84&role.id=5ce68b651d084d388f8528d29fab2530 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:24.179949 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596158f-15ca-4261-81b1-18b7e0b0be10 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:24.190627 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596158f-15ca-4261-81b1-18b7e0b0be10 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:24.201017 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf30a9-11eb-4939-87e3-2e4fc5a8010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:24.202378 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf30a9-11eb-4939-87e3-2e4fc5a8010a admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:24.202665 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf30a9-11eb-4939-87e3-2e4fc5a8010a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:24.202945 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf30a9-11eb-4939-87e3-2e4fc5a8010a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:24.225555 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf30a9-11eb-4939-87e3-2e4fc5a8010a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:24.232509 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-cacf30a9-11eb-4939-87e3-2e4fc5a8010a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:13:24.234340 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 77/147] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:13:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:24.240896 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879b57d-b7f6-4522-84da-f8a7e886a9c3 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:24.259173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879b57d-b7f6-4522-84da-f8a7e886a9c3 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:24.266376 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268af8b-2349-43c8-ad0a-9e165bad711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:24.267105 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268af8b-2349-43c8-ad0a-9e165bad711a admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:24.267395 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268af8b-2349-43c8-ad0a-9e165bad711a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:24.267758 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268af8b-2349-43c8-ad0a-9e165bad711a admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:24.268526 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268af8b-2349-43c8-ad0a-9e165bad711a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:24.268855 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268af8b-2349-43c8-ad0a-9e165bad711a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:24.270568 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268af8b-2349-43c8-ad0a-9e165bad711a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:24.286989 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 71/148] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:24.293490 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf30a9-11eb-4939-87e3-2e4fc5a8010a admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:24.310327 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf30a9-11eb-4939-87e3-2e4fc5a8010a admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:24.321371 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cb08e-3d78-435d-bc51-4a269aa436c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:24.322279 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cb08e-3d78-435d-bc51-4a269aa436c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:24.322560 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cb08e-3d78-435d-bc51-4a269aa436c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:24.322836 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cb08e-3d78-435d-bc51-4a269aa436c9 admin admin] PATH_INFO: `/v3/users/d64df7fb530c43779ba7cb0d2f2adf99` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:24.329778 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cb08e-3d78-435d-bc51-4a269aa436c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=d64df7fb530c43779ba7cb0d2f2adf99)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:24.331916 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cb08e-3d78-435d-bc51-4a269aa436c9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:24.333931 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 78/149] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:24 2021] GET /identity/v3/users/d64df7fb530c43779ba7cb0d2f2adf99 => generated 247 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:24.339957 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268af8b-2349-43c8-ad0a-9e165bad711a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:24.354030 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268af8b-2349-43c8-ad0a-9e165bad711a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:24.362663 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61b6c1-92f5-48b7-9146-408e997f2da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:24.363394 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61b6c1-92f5-48b7-9146-408e997f2da5 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:24.363686 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61b6c1-92f5-48b7-9146-408e997f2da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:24.363970 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61b6c1-92f5-48b7-9146-408e997f2da5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:24.377030 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61b6c1-92f5-48b7-9146-408e997f2da5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:24.378896 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61b6c1-92f5-48b7-9146-408e997f2da5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:24.394764 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 72/150] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:24.401208 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cb08e-3d78-435d-bc51-4a269aa436c9 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:24.417223 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cb08e-3d78-435d-bc51-4a269aa436c9 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:24.422276 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b2f47-9f2a-48cf-8961-b88b59a79b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:24.423211 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b2f47-9f2a-48cf-8961-b88b59a79b80 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:24.423546 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b2f47-9f2a-48cf-8961-b88b59a79b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:24.423826 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b2f47-9f2a-48cf-8961-b88b59a79b80 admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:24.425137 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b2f47-9f2a-48cf-8961-b88b59a79b80 admin admin] RBAC: Authorizing `identity:get_project(project_id=966196fad6e9467e93b5762e459a1d84)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:24.427447 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b2f47-9f2a-48cf-8961-b88b59a79b80 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:24.429293 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 79/151] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:24 2021] GET /identity/v3/projects/966196fad6e9467e93b5762e459a1d84 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:24.436729 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61b6c1-92f5-48b7-9146-408e997f2da5 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:24.446635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61b6c1-92f5-48b7-9146-408e997f2da5 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:24.451378 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d47d7-befc-4918-9681-8038f1b72bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:24.452254 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d47d7-befc-4918-9681-8038f1b72bdb admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:24.452678 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d47d7-befc-4918-9681-8038f1b72bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:24.453004 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d47d7-befc-4918-9681-8038f1b72bdb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:24.453909 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d47d7-befc-4918-9681-8038f1b72bdb admin admin] RBAC: Adding query filter params (role.id=faadc5010ffb447ba5280e491c2ea2f5, scope.project.id=966196fad6e9467e93b5762e459a1d84, user.id=d64df7fb530c43779ba7cb0d2f2adf99) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:24.454234 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d47d7-befc-4918-9681-8038f1b72bdb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:24.456542 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d47d7-befc-4918-9681-8038f1b72bdb admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:24.465802 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 73/152] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:24 2021] GET /identity/v3/role_assignments?user.id=d64df7fb530c43779ba7cb0d2f2adf99&scope.project.id=966196fad6e9467e93b5762e459a1d84&role.id=faadc5010ffb447ba5280e491c2ea2f5 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:25.077589 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2498621-e0b1-4363-8fae-7343084c014e None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:25.077873 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2498621-e0b1-4363-8fae-7343084c014e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:25.078154 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2498621-e0b1-4363-8fae-7343084c014e None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:25.080121 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 80/153] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:25.086807 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac82ca-c0df-4fe2-9e57-5815a6b8f01b None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:25.087102 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac82ca-c0df-4fe2-9e57-5815a6b8f01b None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:25.087384 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac82ca-c0df-4fe2-9e57-5815a6b8f01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:25.108886 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-01ac82ca-c0df-4fe2-9e57-5815a6b8f01b None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:25.110108 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-01ac82ca-c0df-4fe2-9e57-5815a6b8f01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:25.124582 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 74/154] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:25.165200 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dc86b-14cf-4abb-916e-d16d2ffe0009 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:25.165524 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dc86b-14cf-4abb-916e-d16d2ffe0009 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:25.165758 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dc86b-14cf-4abb-916e-d16d2ffe0009 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:25.167530 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 81/155] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:25.168598 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac82ca-c0df-4fe2-9e57-5815a6b8f01b None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:25.173267 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684febd4-51f9-47fd-9f6c-9f090e6e4b12 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:25.173553 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684febd4-51f9-47fd-9f6c-9f090e6e4b12 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:25.173832 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684febd4-51f9-47fd-9f6c-9f090e6e4b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:25.195295 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac82ca-c0df-4fe2-9e57-5815a6b8f01b None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:25.200557 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-684febd4-51f9-47fd-9f6c-9f090e6e4b12 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:25.203062 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-684febd4-51f9-47fd-9f6c-9f090e6e4b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:25.209202 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b854bd-57aa-415a-b29e-5db865d168b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:25.210026 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b854bd-57aa-415a-b29e-5db865d168b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:25.210313 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b854bd-57aa-415a-b29e-5db865d168b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:25.210587 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b854bd-57aa-415a-b29e-5db865d168b5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:25.225333 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 82/156] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:25.237916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b854bd-57aa-415a-b29e-5db865d168b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:25.244664 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-18b854bd-57aa-415a-b29e-5db865d168b5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 01:13:25.246126 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 75/157] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:25 2021] GET /identity/v3/roles/member => generated 84 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:25.253229 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684febd4-51f9-47fd-9f6c-9f090e6e4b12 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:25.259834 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b854bd-57aa-415a-b29e-5db865d168b5 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:25.268520 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684febd4-51f9-47fd-9f6c-9f090e6e4b12 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:25.269686 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b854bd-57aa-415a-b29e-5db865d168b5 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:25.277434 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7befa-a2ee-41b7-ad06-3fce97277af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:25.278106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7befa-a2ee-41b7-ad06-3fce97277af9 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:25.278389 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7befa-a2ee-41b7-ad06-3fce97277af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:25.278663 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7befa-a2ee-41b7-ad06-3fce97277af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:25.279411 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7befa-a2ee-41b7-ad06-3fce97277af9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:25.280304 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7befa-a2ee-41b7-ad06-3fce97277af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:25.280899 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb35f39-3c37-450b-961f-802861ddd85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:25.281837 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb35f39-3c37-450b-961f-802861ddd85d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:25.282121 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb35f39-3c37-450b-961f-802861ddd85d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:25.282219 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7befa-a2ee-41b7-ad06-3fce97277af9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:25.282394 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb35f39-3c37-450b-961f-802861ddd85d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:25.294384 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 83/158] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 01:13:25 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:25.301745 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7befa-a2ee-41b7-ad06-3fce97277af9 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:25.312892 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb35f39-3c37-450b-961f-802861ddd85d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:25.319710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-ccb35f39-3c37-450b-961f-802861ddd85d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 01:13:25.321171 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 76/159] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:25 2021] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:13:25.327350 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7befa-a2ee-41b7-ad06-3fce97277af9 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:25.331150 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb35f39-3c37-450b-961f-802861ddd85d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:25.333388 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef19fc-bce4-435c-9d8c-2a63d51328e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:25.334250 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef19fc-bce4-435c-9d8c-2a63d51328e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:25.334534 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef19fc-bce4-435c-9d8c-2a63d51328e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:25.334810 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef19fc-bce4-435c-9d8c-2a63d51328e7 admin admin] PATH_INFO: `/v3/users/2a86b090883647269b0da4a4ef5fc47b` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:25.355243 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb35f39-3c37-450b-961f-802861ddd85d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:25.360297 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef19fc-bce4-435c-9d8c-2a63d51328e7 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a86b090883647269b0da4a4ef5fc47b)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:25.362512 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef19fc-bce4-435c-9d8c-2a63d51328e7 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:25.364237 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 84/160] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:25 2021] GET /identity/v3/users/2a86b090883647269b0da4a4ef5fc47b => generated 283 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:25.370919 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ee947-8908-440d-a6cc-5a6e49ecce5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:25.371617 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ee947-8908-440d-a6cc-5a6e49ecce5f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:25.371904 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ee947-8908-440d-a6cc-5a6e49ecce5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:25.372185 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ee947-8908-440d-a6cc-5a6e49ecce5f admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:25.372977 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ee947-8908-440d-a6cc-5a6e49ecce5f admin admin] RBAC: Adding query filter params (name=member) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:25.373294 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ee947-8908-440d-a6cc-5a6e49ecce5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:25.375512 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ee947-8908-440d-a6cc-5a6e49ecce5f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:25.378024 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef19fc-bce4-435c-9d8c-2a63d51328e7 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:25.395540 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef19fc-bce4-435c-9d8c-2a63d51328e7 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:25.398297 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 77/161] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 01:13:25 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:25.406344 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5a8ea-c844-49ed-82d4-64f341a04e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:25.407003 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5a8ea-c844-49ed-82d4-64f341a04e80 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:25.407284 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5a8ea-c844-49ed-82d4-64f341a04e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:25.407559 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5a8ea-c844-49ed-82d4-64f341a04e80 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:25.409537 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ee947-8908-440d-a6cc-5a6e49ecce5f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:25.416373 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5a8ea-c844-49ed-82d4-64f341a04e80 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:25.418153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5a8ea-c844-49ed-82d4-64f341a04e80 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:25.428628 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 85/162] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:25.431318 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ee947-8908-440d-a6cc-5a6e49ecce5f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:25.435415 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5a8ea-c844-49ed-82d4-64f341a04e80 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:25.442561 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0c893-a7bb-4666-89f6-24fabe0bdd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:25.443762 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0c893-a7bb-4666-89f6-24fabe0bdd38 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:25.444217 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0c893-a7bb-4666-89f6-24fabe0bdd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:25.444675 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0c893-a7bb-4666-89f6-24fabe0bdd38 admin admin] PATH_INFO: `/v3/users/690677d9b18f42639d78f5d0dd911adc` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:25.447146 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0c893-a7bb-4666-89f6-24fabe0bdd38 admin admin] RBAC: Authorizing `identity:get_user(user_id=690677d9b18f42639d78f5d0dd911adc)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:25.450740 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0c893-a7bb-4666-89f6-24fabe0bdd38 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:25.453148 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5a8ea-c844-49ed-82d4-64f341a04e80 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:25.456624 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 78/163] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:25 2021] GET /identity/v3/users/690677d9b18f42639d78f5d0dd911adc => generated 275 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:25.463111 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3beab88-9ef5-4b13-bf85-782aa2f64fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:25.464230 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3beab88-9ef5-4b13-bf85-782aa2f64fbc admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:25.464716 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3beab88-9ef5-4b13-bf85-782aa2f64fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:25.465183 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3beab88-9ef5-4b13-bf85-782aa2f64fbc admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:25.466605 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3beab88-9ef5-4b13-bf85-782aa2f64fbc admin admin] RBAC: Authorizing `identity:get_project(project_id=2094d4b288d94b69a3989eda8c1f1660)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:25.469570 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3beab88-9ef5-4b13-bf85-782aa2f64fbc admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:25.472190 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0c893-a7bb-4666-89f6-24fabe0bdd38 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:25.472875 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 86/164] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:25 2021] GET /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:25.479881 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3beab88-9ef5-4b13-bf85-782aa2f64fbc admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:25.494871 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0c893-a7bb-4666-89f6-24fabe0bdd38 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:25.497897 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3beab88-9ef5-4b13-bf85-782aa2f64fbc admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:25.506956 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff0105-fef9-425b-b567-552fff1e666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:25.507228 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5b293-8a3e-4b7d-838a-856968cd14ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:25.508455 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff0105-fef9-425b-b567-552fff1e666c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:25.508937 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5b293-8a3e-4b7d-838a-856968cd14ba admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:25.509428 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff0105-fef9-425b-b567-552fff1e666c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:25.509865 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5b293-8a3e-4b7d-838a-856968cd14ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:25.510303 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff0105-fef9-425b-b567-552fff1e666c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:25.510765 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5b293-8a3e-4b7d-838a-856968cd14ba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:25.511756 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff0105-fef9-425b-b567-552fff1e666c admin admin] RBAC: Adding query filter params (role.id=681adf4aa4c14ac7a9ce4ac1c261cf93, scope.project.id=2094d4b288d94b69a3989eda8c1f1660, user.id=2a86b090883647269b0da4a4ef5fc47b) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:25.513203 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff0105-fef9-425b-b567-552fff1e666c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:25.519872 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff0105-fef9-425b-b567-552fff1e666c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:25.527567 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5b293-8a3e-4b7d-838a-856968cd14ba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:25.529450 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 87/165] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:25 2021] GET /identity/v3/role_assignments?user.id=2a86b090883647269b0da4a4ef5fc47b&scope.project.id=2094d4b288d94b69a3989eda8c1f1660&role.id=681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:25.531689 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5b293-8a3e-4b7d-838a-856968cd14ba admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:25.542301 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 79/166] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:13:25.550872 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff0105-fef9-425b-b567-552fff1e666c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:25.561377 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff0105-fef9-425b-b567-552fff1e666c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:25.566272 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0dc79-e385-4175-9b20-afbc7a38ab96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:25.567474 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0dc79-e385-4175-9b20-afbc7a38ab96 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:25.567994 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0dc79-e385-4175-9b20-afbc7a38ab96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:25.568481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0dc79-e385-4175-9b20-afbc7a38ab96 admin admin] PATH_INFO: `/v3/projects/ef38c7434f314bc8a24b592fc7de21d5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:25.569878 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0dc79-e385-4175-9b20-afbc7a38ab96 admin admin] RBAC: Authorizing `identity:get_project(project_id=ef38c7434f314bc8a24b592fc7de21d5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:25.572180 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0dc79-e385-4175-9b20-afbc7a38ab96 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:25.574145 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 88/167] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:25 2021] GET /identity/v3/projects/ef38c7434f314bc8a24b592fc7de21d5 => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:25.581951 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5b293-8a3e-4b7d-838a-856968cd14ba admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:25.591420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5b293-8a3e-4b7d-838a-856968cd14ba admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:25.596720 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb4984-a7d7-4c54-99fb-a0f375626340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:25.597739 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb4984-a7d7-4c54-99fb-a0f375626340 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:25.598241 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb4984-a7d7-4c54-99fb-a0f375626340 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:25.598712 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb4984-a7d7-4c54-99fb-a0f375626340 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:25.599728 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb4984-a7d7-4c54-99fb-a0f375626340 admin admin] RBAC: Adding query filter params (role.id=681adf4aa4c14ac7a9ce4ac1c261cf93, scope.project.id=ef38c7434f314bc8a24b592fc7de21d5, user.id=690677d9b18f42639d78f5d0dd911adc) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:25.600231 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb4984-a7d7-4c54-99fb-a0f375626340 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:25.602406 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb4984-a7d7-4c54-99fb-a0f375626340 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:25.610300 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 80/168] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:25 2021] GET /identity/v3/role_assignments?user.id=690677d9b18f42639d78f5d0dd911adc&scope.project.id=ef38c7434f314bc8a24b592fc7de21d5&role.id=681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:26.043316 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d84ed-8a5b-4399-997d-4ff6aeaa0908 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:26.043676 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d84ed-8a5b-4399-997d-4ff6aeaa0908 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:26.043866 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d84ed-8a5b-4399-997d-4ff6aeaa0908 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:26.045903 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 89/169] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:26.052546 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40c983-90d2-40df-931e-75ef1354e2d8 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:26.052847 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40c983-90d2-40df-931e-75ef1354e2d8 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:26.053138 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40c983-90d2-40df-931e-75ef1354e2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:26.076120 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-7c40c983-90d2-40df-931e-75ef1354e2d8 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:26.078001 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-7c40c983-90d2-40df-931e-75ef1354e2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:26.091624 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 81/170] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:26.117387 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d84ed-8a5b-4399-997d-4ff6aeaa0908 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:26.138481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d84ed-8a5b-4399-997d-4ff6aeaa0908 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:26.143609 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382cebd-d1c1-4af8-9d94-680dea3b346b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:26.144402 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382cebd-d1c1-4af8-9d94-680dea3b346b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:26.144682 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382cebd-d1c1-4af8-9d94-680dea3b346b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:26.144986 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382cebd-d1c1-4af8-9d94-680dea3b346b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:26.161954 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382cebd-d1c1-4af8-9d94-680dea3b346b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:26.169040 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-8382cebd-d1c1-4af8-9d94-680dea3b346b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:13:26.171079 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 90/171] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:13:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:26.177593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40c983-90d2-40df-931e-75ef1354e2d8 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:26.193231 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40c983-90d2-40df-931e-75ef1354e2d8 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:26.198213 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873747e3-3f03-42e1-8e9d-2d96786575db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:26.198880 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873747e3-3f03-42e1-8e9d-2d96786575db admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:26.199171 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873747e3-3f03-42e1-8e9d-2d96786575db admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:26.199445 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873747e3-3f03-42e1-8e9d-2d96786575db admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:26.200191 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873747e3-3f03-42e1-8e9d-2d96786575db admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:26.200503 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873747e3-3f03-42e1-8e9d-2d96786575db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:26.203288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873747e3-3f03-42e1-8e9d-2d96786575db admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:26.215504 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 82/172] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:26.222960 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382cebd-d1c1-4af8-9d94-680dea3b346b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:26.233551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382cebd-d1c1-4af8-9d94-680dea3b346b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:26.237984 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a584fc-f4ed-495e-b449-08f4c2e63c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:26.238904 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a584fc-f4ed-495e-b449-08f4c2e63c4d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:26.239257 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a584fc-f4ed-495e-b449-08f4c2e63c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:26.239599 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a584fc-f4ed-495e-b449-08f4c2e63c4d admin admin] PATH_INFO: `/v3/users/d64df7fb530c43779ba7cb0d2f2adf99` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:26.240864 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a584fc-f4ed-495e-b449-08f4c2e63c4d admin admin] RBAC: Authorizing `identity:get_user(user_id=d64df7fb530c43779ba7cb0d2f2adf99)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:26.242743 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a584fc-f4ed-495e-b449-08f4c2e63c4d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:26.244568 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 91/173] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:26 2021] GET /identity/v3/users/d64df7fb530c43779ba7cb0d2f2adf99 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:26.251307 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873747e3-3f03-42e1-8e9d-2d96786575db admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:26.261052 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873747e3-3f03-42e1-8e9d-2d96786575db admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:26.265723 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cf92b-540a-4759-a5ac-c338c42a8c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:26.266354 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cf92b-540a-4759-a5ac-c338c42a8c5d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:26.266639 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cf92b-540a-4759-a5ac-c338c42a8c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:26.266913 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cf92b-540a-4759-a5ac-c338c42a8c5d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:26.274840 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cf92b-540a-4759-a5ac-c338c42a8c5d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:26.276570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cf92b-540a-4759-a5ac-c338c42a8c5d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:26.285455 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 83/174] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:26.291702 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a584fc-f4ed-495e-b449-08f4c2e63c4d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:26.302076 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a584fc-f4ed-495e-b449-08f4c2e63c4d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:26.306532 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331f066-e6c9-483c-8127-2cd960b34b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:26.307387 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331f066-e6c9-483c-8127-2cd960b34b7b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:26.307671 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331f066-e6c9-483c-8127-2cd960b34b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:26.307948 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331f066-e6c9-483c-8127-2cd960b34b7b admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:26.309163 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331f066-e6c9-483c-8127-2cd960b34b7b admin admin] RBAC: Authorizing `identity:get_project(project_id=2094d4b288d94b69a3989eda8c1f1660)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:26.311624 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331f066-e6c9-483c-8127-2cd960b34b7b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:26.313395 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 92/175] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:26 2021] GET /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:26.319777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cf92b-540a-4759-a5ac-c338c42a8c5d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:26.329308 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cf92b-540a-4759-a5ac-c338c42a8c5d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:26.334084 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50566054-5a4f-41e4-a04b-16426f3b1308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:26.334730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50566054-5a4f-41e4-a04b-16426f3b1308 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:26.335013 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50566054-5a4f-41e4-a04b-16426f3b1308 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:26.335287 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50566054-5a4f-41e4-a04b-16426f3b1308 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:26.336110 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50566054-5a4f-41e4-a04b-16426f3b1308 admin admin] RBAC: Adding query filter params (role.id=faadc5010ffb447ba5280e491c2ea2f5, scope.project.id=2094d4b288d94b69a3989eda8c1f1660, user.id=d64df7fb530c43779ba7cb0d2f2adf99) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:26.336420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50566054-5a4f-41e4-a04b-16426f3b1308 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:26.338297 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50566054-5a4f-41e4-a04b-16426f3b1308 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:26.343873 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 84/176] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:26 2021] GET /identity/v3/role_assignments?user.id=d64df7fb530c43779ba7cb0d2f2adf99&scope.project.id=2094d4b288d94b69a3989eda8c1f1660&role.id=faadc5010ffb447ba5280e491c2ea2f5 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:26.466183 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5dd30-041f-48f4-806c-356c36096684 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:26.466508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5dd30-041f-48f4-806c-356c36096684 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:26.466741 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5dd30-041f-48f4-806c-356c36096684 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:26.469006 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 93/177] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:26.475310 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3fd19-a95e-4654-8b42-cd2f1d91daca None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:26.475809 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3fd19-a95e-4654-8b42-cd2f1d91daca None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:26.475880 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3fd19-a95e-4654-8b42-cd2f1d91daca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:26.495387 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-d6b3fd19-a95e-4654-8b42-cd2f1d91daca None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:26.496606 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d6b3fd19-a95e-4654-8b42-cd2f1d91daca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:26.505378 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 85/178] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:26.529544 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5dd30-041f-48f4-806c-356c36096684 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:26.542600 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5dd30-041f-48f4-806c-356c36096684 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:26.548137 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283b815-4a0c-47be-84ad-7da691d49029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:26.549058 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283b815-4a0c-47be-84ad-7da691d49029 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:26.549341 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283b815-4a0c-47be-84ad-7da691d49029 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:26.549664 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283b815-4a0c-47be-84ad-7da691d49029 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:26.550863 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283b815-4a0c-47be-84ad-7da691d49029 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:26.552641 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283b815-4a0c-47be-84ad-7da691d49029 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:26.554259 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 94/179] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:26 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:26.560495 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3fd19-a95e-4654-8b42-cd2f1d91daca None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:26.570710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3fd19-a95e-4654-8b42-cd2f1d91daca None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:26.576185 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b84b8-10fd-4ef5-befd-d2699f153958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:26.578095 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b84b8-10fd-4ef5-befd-d2699f153958 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:26.578389 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b84b8-10fd-4ef5-befd-d2699f153958 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:26.578668 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b84b8-10fd-4ef5-befd-d2699f153958 admin admin] PATH_INFO: `/v3/groups` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:26.579381 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b84b8-10fd-4ef5-befd-d2699f153958 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:26.580393 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING py.warnings [None req-f54b84b8-10fd-4ef5-befd-d2699f153958 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:26.580393 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: warnings.warn(msg) Aug 27 01:13:26.580393 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: Aug 27 01:13:26.581880 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b84b8-10fd-4ef5-befd-d2699f153958 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:26.670812 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 86/180] 10.222.0.25 () {60 vars in 1156 bytes} [Fri Aug 27 01:13:26 2021] POST /identity/v3/groups => generated 229 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:13:26.733734 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1578cbe-5452-49c1-9031-3b91f3c947ae None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:26.734174 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1578cbe-5452-49c1-9031-3b91f3c947ae None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:26.734551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1578cbe-5452-49c1-9031-3b91f3c947ae None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:26.736531 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 95/181] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:26.743260 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd0ca3-41d6-4107-b3f9-946ad662e467 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:26.743753 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd0ca3-41d6-4107-b3f9-946ad662e467 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:26.744232 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd0ca3-41d6-4107-b3f9-946ad662e467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:26.764042 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-1afd0ca3-41d6-4107-b3f9-946ad662e467 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:26.766667 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1afd0ca3-41d6-4107-b3f9-946ad662e467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:26.776224 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 87/182] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:26.838421 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1578cbe-5452-49c1-9031-3b91f3c947ae None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:26.859914 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1578cbe-5452-49c1-9031-3b91f3c947ae None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:26.865811 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3cc9a-2783-4c3a-b182-56e6b7c406e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:26.866736 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3cc9a-2783-4c3a-b182-56e6b7c406e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:26.867147 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3cc9a-2783-4c3a-b182-56e6b7c406e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:26.867514 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3cc9a-2783-4c3a-b182-56e6b7c406e7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:26.880297 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3cc9a-2783-4c3a-b182-56e6b7c406e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:26.887779 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-3da3cc9a-2783-4c3a-b182-56e6b7c406e7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 01:13:26.889341 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 96/183] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:13:26 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:26.905210 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd0ca3-41d6-4107-b3f9-946ad662e467 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:26.912277 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd0ca3-41d6-4107-b3f9-946ad662e467 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:26.923673 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf03cc-f2b8-46ec-a901-85a205324c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:26.924560 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf03cc-f2b8-46ec-a901-85a205324c4a admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:26.928095 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf03cc-f2b8-46ec-a901-85a205324c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:26.928603 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf03cc-f2b8-46ec-a901-85a205324c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:26.929576 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf03cc-f2b8-46ec-a901-85a205324c4a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:26.930030 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf03cc-f2b8-46ec-a901-85a205324c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:26.933786 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf03cc-f2b8-46ec-a901-85a205324c4a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:26.954542 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 88/184] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:26 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:26.963205 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3cc9a-2783-4c3a-b182-56e6b7c406e7 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:26.986038 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3cc9a-2783-4c3a-b182-56e6b7c406e7 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:26.990721 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb4765-d340-43c0-98dc-e1693dd3f98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:26.991724 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb4765-d340-43c0-98dc-e1693dd3f98d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:26.997074 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb4765-d340-43c0-98dc-e1693dd3f98d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:26.997475 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb4765-d340-43c0-98dc-e1693dd3f98d admin admin] PATH_INFO: `/v3/users/2a86b090883647269b0da4a4ef5fc47b` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:26.999337 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb4765-d340-43c0-98dc-e1693dd3f98d admin admin] RBAC: Authorizing `identity:get_user(user_id=2a86b090883647269b0da4a4ef5fc47b)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:27.001643 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb4765-d340-43c0-98dc-e1693dd3f98d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:27.003700 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 97/185] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:26 2021] GET /identity/v3/users/2a86b090883647269b0da4a4ef5fc47b => generated 283 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:27.009937 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf03cc-f2b8-46ec-a901-85a205324c4a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:27.020048 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf03cc-f2b8-46ec-a901-85a205324c4a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:27.031779 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fabe0b-5c3c-4a58-be9a-12c1d3597810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:27.033248 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fabe0b-5c3c-4a58-be9a-12c1d3597810 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:27.034486 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fabe0b-5c3c-4a58-be9a-12c1d3597810 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:27.035965 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fabe0b-5c3c-4a58-be9a-12c1d3597810 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:27.053076 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fabe0b-5c3c-4a58-be9a-12c1d3597810 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:27.057795 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fabe0b-5c3c-4a58-be9a-12c1d3597810 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:27.076534 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 89/186] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:27.083377 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb4765-d340-43c0-98dc-e1693dd3f98d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:27.102138 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb4765-d340-43c0-98dc-e1693dd3f98d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:27.106962 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37250809-189e-439a-b365-e76905d40de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:27.108643 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37250809-189e-439a-b365-e76905d40de4 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:27.109092 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37250809-189e-439a-b365-e76905d40de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:27.109529 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37250809-189e-439a-b365-e76905d40de4 admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:27.110899 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37250809-189e-439a-b365-e76905d40de4 admin admin] RBAC: Authorizing `identity:get_project(project_id=2094d4b288d94b69a3989eda8c1f1660)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:27.113215 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37250809-189e-439a-b365-e76905d40de4 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:27.115864 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 98/187] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:27 2021] GET /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:27.122479 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fabe0b-5c3c-4a58-be9a-12c1d3597810 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:27.137573 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fabe0b-5c3c-4a58-be9a-12c1d3597810 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:27.143145 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e238188-b9bd-4e60-a621-341f8fd8e330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:27.144514 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e238188-b9bd-4e60-a621-341f8fd8e330 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:27.144970 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e238188-b9bd-4e60-a621-341f8fd8e330 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:27.145726 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e238188-b9bd-4e60-a621-341f8fd8e330 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:27.147400 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e238188-b9bd-4e60-a621-341f8fd8e330 admin admin] RBAC: Adding query filter params (role.id=5ce68b651d084d388f8528d29fab2530, scope.project.id=2094d4b288d94b69a3989eda8c1f1660, user.id=2a86b090883647269b0da4a4ef5fc47b) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:27.147958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e238188-b9bd-4e60-a621-341f8fd8e330 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:27.150262 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e238188-b9bd-4e60-a621-341f8fd8e330 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:27.161683 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 90/188] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:27 2021] GET /identity/v3/role_assignments?user.id=2a86b090883647269b0da4a4ef5fc47b&scope.project.id=2094d4b288d94b69a3989eda8c1f1660&role.id=5ce68b651d084d388f8528d29fab2530 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:27.945688 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019d044-c925-471c-ae53-351c1fedc8b2 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:27.946694 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019d044-c925-471c-ae53-351c1fedc8b2 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:27.947177 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019d044-c925-471c-ae53-351c1fedc8b2 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:27.949176 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 99/189] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:27.956162 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eec195-db1c-4436-8cfa-cc038f06a67d None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:27.956610 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eec195-db1c-4436-8cfa-cc038f06a67d None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:27.956785 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eec195-db1c-4436-8cfa-cc038f06a67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:27.974463 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-09eec195-db1c-4436-8cfa-cc038f06a67d None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:27.975631 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-09eec195-db1c-4436-8cfa-cc038f06a67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:27.984139 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 91/190] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:28.007649 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019d044-c925-471c-ae53-351c1fedc8b2 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:28.020873 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019d044-c925-471c-ae53-351c1fedc8b2 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:28.025621 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0a9e2-80a2-40d7-9ece-60a99c8e3bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:28.026718 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0a9e2-80a2-40d7-9ece-60a99c8e3bef admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:28.027177 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0a9e2-80a2-40d7-9ece-60a99c8e3bef admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:28.027657 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0a9e2-80a2-40d7-9ece-60a99c8e3bef admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:28.040357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0a9e2-80a2-40d7-9ece-60a99c8e3bef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:28.048073 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-18c0a9e2-80a2-40d7-9ece-60a99c8e3bef admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 01:13:28.049841 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 100/191] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:28 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:28.056304 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eec195-db1c-4436-8cfa-cc038f06a67d None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:28.065597 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eec195-db1c-4436-8cfa-cc038f06a67d None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:28.070350 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b773bbe-fd82-4f78-a1b0-1f48f612f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:28.071207 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b773bbe-fd82-4f78-a1b0-1f48f612f1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:28.071657 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b773bbe-fd82-4f78-a1b0-1f48f612f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:28.072121 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b773bbe-fd82-4f78-a1b0-1f48f612f1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:28.073070 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b773bbe-fd82-4f78-a1b0-1f48f612f1e3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:28.073543 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b773bbe-fd82-4f78-a1b0-1f48f612f1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:28.075313 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b773bbe-fd82-4f78-a1b0-1f48f612f1e3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:28.085330 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 92/192] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 01:13:28 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:28.091646 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0a9e2-80a2-40d7-9ece-60a99c8e3bef admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:28.102419 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0a9e2-80a2-40d7-9ece-60a99c8e3bef admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:28.107091 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b1b77-f226-42e8-ab1d-6ff0e24f946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:28.108781 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b1b77-f226-42e8-ab1d-6ff0e24f946c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:28.109336 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b1b77-f226-42e8-ab1d-6ff0e24f946c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:28.109883 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b1b77-f226-42e8-ab1d-6ff0e24f946c admin admin] PATH_INFO: `/v3/users/2a86b090883647269b0da4a4ef5fc47b` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:28.111239 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b1b77-f226-42e8-ab1d-6ff0e24f946c admin admin] RBAC: Authorizing `identity:get_user(user_id=2a86b090883647269b0da4a4ef5fc47b)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:28.113563 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b1b77-f226-42e8-ab1d-6ff0e24f946c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:28.115644 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 101/193] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:28 2021] GET /identity/v3/users/2a86b090883647269b0da4a4ef5fc47b => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:28.121779 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b773bbe-fd82-4f78-a1b0-1f48f612f1e3 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:28.131819 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b773bbe-fd82-4f78-a1b0-1f48f612f1e3 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:28.136462 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb28da-e2ad-4443-b6b4-07ec56ba6b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:28.137542 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb28da-e2ad-4443-b6b4-07ec56ba6b5b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:28.137994 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb28da-e2ad-4443-b6b4-07ec56ba6b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:28.138434 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb28da-e2ad-4443-b6b4-07ec56ba6b5b admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:28.140501 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb28da-e2ad-4443-b6b4-07ec56ba6b5b admin admin] RBAC: Authorizing `identity:get_project(project_id=2094d4b288d94b69a3989eda8c1f1660)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:28.142758 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb28da-e2ad-4443-b6b4-07ec56ba6b5b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:28.144599 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 93/194] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:28 2021] GET /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:28.151376 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b1b77-f226-42e8-ab1d-6ff0e24f946c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:28.262531 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b1b77-f226-42e8-ab1d-6ff0e24f946c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:28.267798 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cfe10-9739-4e12-a571-51f8d6d5d9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:28.268903 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cfe10-9739-4e12-a571-51f8d6d5d9a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:28.269356 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cfe10-9739-4e12-a571-51f8d6d5d9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:28.269799 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cfe10-9739-4e12-a571-51f8d6d5d9a1 admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660/users/2a86b090883647269b0da4a4ef5fc47b/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:28.271911 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761cfe10-9739-4e12-a571-51f8d6d5d9a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2094d4b288d94b69a3989eda8c1f1660, user_id=2a86b090883647269b0da4a4ef5fc47b, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:28.274733 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761cfe10-9739-4e12-a571-51f8d6d5d9a1 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:28.369426 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 102/195] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:13:28 2021] PUT /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660/users/2a86b090883647269b0da4a4ef5fc47b/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:13:28.668357 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d553ea0-b420-4f47-b357-ac3d892e7abd None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:28.668732 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d553ea0-b420-4f47-b357-ac3d892e7abd None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:28.668985 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d553ea0-b420-4f47-b357-ac3d892e7abd None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:28.670885 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 94/196] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:28.678901 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2a4b5-e136-4c11-975b-f010d03b49f3 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:28.679195 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2a4b5-e136-4c11-975b-f010d03b49f3 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:28.679476 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2a4b5-e136-4c11-975b-f010d03b49f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:28.699902 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-2dd2a4b5-e136-4c11-975b-f010d03b49f3 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:28.701148 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-2dd2a4b5-e136-4c11-975b-f010d03b49f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:28.765464 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 103/197] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:28.789888 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d553ea0-b420-4f47-b357-ac3d892e7abd None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:28.802554 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d553ea0-b420-4f47-b357-ac3d892e7abd None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:28.807336 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8c8db-934e-4aa6-9c7a-b0827d95be34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:28.808120 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8c8db-934e-4aa6-9c7a-b0827d95be34 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:28.808404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8c8db-934e-4aa6-9c7a-b0827d95be34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:28.808674 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8c8db-934e-4aa6-9c7a-b0827d95be34 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:28.819171 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8c8db-934e-4aa6-9c7a-b0827d95be34 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:28.826003 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-f2f8c8db-934e-4aa6-9c7a-b0827d95be34 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:13:28.832963 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 95/198] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:13:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:28.835002 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2a4b5-e136-4c11-975b-f010d03b49f3 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:28.845197 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2a4b5-e136-4c11-975b-f010d03b49f3 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:28.849834 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dbde3-ebd2-43d6-b9d1-6e3e4119705a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:28.851404 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dbde3-ebd2-43d6-b9d1-6e3e4119705a admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:28.851760 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dbde3-ebd2-43d6-b9d1-6e3e4119705a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:28.852108 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dbde3-ebd2-43d6-b9d1-6e3e4119705a admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:28.852962 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5dbde3-ebd2-43d6-b9d1-6e3e4119705a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:28.853345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5dbde3-ebd2-43d6-b9d1-6e3e4119705a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:28.855027 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5dbde3-ebd2-43d6-b9d1-6e3e4119705a admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:28.864111 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 104/199] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:28.870082 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8c8db-934e-4aa6-9c7a-b0827d95be34 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:28.881042 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8c8db-934e-4aa6-9c7a-b0827d95be34 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:28.885580 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5701be1-e569-4ce8-b9fd-681dbd2893ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:28.886434 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5701be1-e569-4ce8-b9fd-681dbd2893ad admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:28.886715 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5701be1-e569-4ce8-b9fd-681dbd2893ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:28.886992 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5701be1-e569-4ce8-b9fd-681dbd2893ad admin admin] PATH_INFO: `/v3/users/d64df7fb530c43779ba7cb0d2f2adf99` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:28.888180 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5701be1-e569-4ce8-b9fd-681dbd2893ad admin admin] RBAC: Authorizing `identity:get_user(user_id=d64df7fb530c43779ba7cb0d2f2adf99)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:28.890766 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5701be1-e569-4ce8-b9fd-681dbd2893ad admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:28.892562 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 96/200] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:28 2021] GET /identity/v3/users/d64df7fb530c43779ba7cb0d2f2adf99 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:28.898452 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dbde3-ebd2-43d6-b9d1-6e3e4119705a admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:28.908585 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dbde3-ebd2-43d6-b9d1-6e3e4119705a admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:28.913162 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3ee8e-48b0-46fb-8afd-73bcd9c09852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:28.914013 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3ee8e-48b0-46fb-8afd-73bcd9c09852 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:28.914298 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3ee8e-48b0-46fb-8afd-73bcd9c09852 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:28.914576 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3ee8e-48b0-46fb-8afd-73bcd9c09852 admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:28.915778 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3ee8e-48b0-46fb-8afd-73bcd9c09852 admin admin] RBAC: Authorizing `identity:get_project(project_id=2094d4b288d94b69a3989eda8c1f1660)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:28.917849 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3ee8e-48b0-46fb-8afd-73bcd9c09852 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:28.919863 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 105/201] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:28 2021] GET /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:28.926140 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5701be1-e569-4ce8-b9fd-681dbd2893ad admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:28.936328 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5701be1-e569-4ce8-b9fd-681dbd2893ad admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:28.941380 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47be6f4-6e71-4cc5-86b5-e36a9640c624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:28.942252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47be6f4-6e71-4cc5-86b5-e36a9640c624 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:28.942534 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47be6f4-6e71-4cc5-86b5-e36a9640c624 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:28.942812 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47be6f4-6e71-4cc5-86b5-e36a9640c624 admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660/users/d64df7fb530c43779ba7cb0d2f2adf99/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:28.944780 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47be6f4-6e71-4cc5-86b5-e36a9640c624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2094d4b288d94b69a3989eda8c1f1660, user_id=d64df7fb530c43779ba7cb0d2f2adf99, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:28.947452 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47be6f4-6e71-4cc5-86b5-e36a9640c624 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:29.032365 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 97/202] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:13:28 2021] PUT /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660/users/d64df7fb530c43779ba7cb0d2f2adf99/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:13:29.067724 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992da0e0-40f2-421c-a8cc-90efa4ac447e None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:29.068238 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992da0e0-40f2-421c-a8cc-90efa4ac447e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:29.068487 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992da0e0-40f2-421c-a8cc-90efa4ac447e None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:29.070476 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 106/203] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:29.077077 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4845d-0bff-400a-a830-68341e3f46b8 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:29.077650 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4845d-0bff-400a-a830-68341e3f46b8 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:29.078052 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4845d-0bff-400a-a830-68341e3f46b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:29.098889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-ded4845d-0bff-400a-a830-68341e3f46b8 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:29.100405 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ded4845d-0bff-400a-a830-68341e3f46b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:29.165067 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 98/204] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:29.192740 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992da0e0-40f2-421c-a8cc-90efa4ac447e None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:29.207355 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992da0e0-40f2-421c-a8cc-90efa4ac447e None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:29.211727 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6915b-d97a-4c2e-abdf-fff6593b5308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:29.212780 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6915b-d97a-4c2e-abdf-fff6593b5308 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:29.213189 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6915b-d97a-4c2e-abdf-fff6593b5308 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:29.213566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6915b-d97a-4c2e-abdf-fff6593b5308 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:29.214931 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6915b-d97a-4c2e-abdf-fff6593b5308 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:29.216775 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6915b-d97a-4c2e-abdf-fff6593b5308 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:29.219953 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 107/205] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:29 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:29.226489 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4845d-0bff-400a-a830-68341e3f46b8 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:29.236946 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4845d-0bff-400a-a830-68341e3f46b8 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:29.246641 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e548e-d69b-4b13-9c1f-568a540eab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:29.247639 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e548e-d69b-4b13-9c1f-568a540eab51 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:29.248125 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e548e-d69b-4b13-9c1f-568a540eab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:29.248635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e548e-d69b-4b13-9c1f-568a540eab51 admin admin] PATH_INFO: `/v3/groups` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:29.249730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e548e-d69b-4b13-9c1f-568a540eab51 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:29.251917 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e548e-d69b-4b13-9c1f-568a540eab51 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:29.340054 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 99/206] 10.222.0.25 () {60 vars in 1156 bytes} [Fri Aug 27 01:13:29 2021] POST /identity/v3/groups => generated 226 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:13:29.483493 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce761e-7ece-4a73-8650-d08604f322e7 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:29.483747 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce761e-7ece-4a73-8650-d08604f322e7 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:29.484033 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce761e-7ece-4a73-8650-d08604f322e7 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:29.486170 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 108/207] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:29.492568 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55859a35-fbfe-476c-aded-c26366213412 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:29.492874 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55859a35-fbfe-476c-aded-c26366213412 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:29.493167 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55859a35-fbfe-476c-aded-c26366213412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:29.512590 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-55859a35-fbfe-476c-aded-c26366213412 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:29.514423 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-55859a35-fbfe-476c-aded-c26366213412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:29.523450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 100/208] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:29.547654 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce761e-7ece-4a73-8650-d08604f322e7 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:29.560193 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce761e-7ece-4a73-8650-d08604f322e7 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:29.565181 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216567bf-8884-4e97-af48-102ef2be70df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:29.565978 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216567bf-8884-4e97-af48-102ef2be70df admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:29.566299 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216567bf-8884-4e97-af48-102ef2be70df admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:29.566566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216567bf-8884-4e97-af48-102ef2be70df admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:29.578173 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216567bf-8884-4e97-af48-102ef2be70df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:29.585896 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-216567bf-8884-4e97-af48-102ef2be70df admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 01:13:29.587170 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 109/209] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:13:29 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:29.594101 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55859a35-fbfe-476c-aded-c26366213412 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:29.603214 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55859a35-fbfe-476c-aded-c26366213412 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:29.609387 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1430d-a5ac-48a0-b098-75624aa461fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:29.610220 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1430d-a5ac-48a0-b098-75624aa461fa admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:29.610645 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1430d-a5ac-48a0-b098-75624aa461fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:29.610926 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1430d-a5ac-48a0-b098-75624aa461fa admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:29.611749 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1430d-a5ac-48a0-b098-75624aa461fa admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:29.612107 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1430d-a5ac-48a0-b098-75624aa461fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:29.613788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1430d-a5ac-48a0-b098-75624aa461fa admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:29.623660 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 101/210] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:29 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:29.630603 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216567bf-8884-4e97-af48-102ef2be70df admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:29.643034 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216567bf-8884-4e97-af48-102ef2be70df admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:29.648760 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbecb7b-e033-439f-9ee3-486aff106b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:29.649723 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbecb7b-e033-439f-9ee3-486aff106b2e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:29.650012 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbecb7b-e033-439f-9ee3-486aff106b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:29.650291 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbecb7b-e033-439f-9ee3-486aff106b2e admin admin] PATH_INFO: `/v3/users/2a86b090883647269b0da4a4ef5fc47b` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:29.651517 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbecb7b-e033-439f-9ee3-486aff106b2e admin admin] RBAC: Authorizing `identity:get_user(user_id=2a86b090883647269b0da4a4ef5fc47b)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:29.653687 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbecb7b-e033-439f-9ee3-486aff106b2e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:29.655721 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 110/211] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:29 2021] GET /identity/v3/users/2a86b090883647269b0da4a4ef5fc47b => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:29.664878 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1430d-a5ac-48a0-b098-75624aa461fa admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:29.676728 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1430d-a5ac-48a0-b098-75624aa461fa admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:29.682736 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a484f1-fec4-40a1-b068-b1b0e163aa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:29.683615 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a484f1-fec4-40a1-b068-b1b0e163aa45 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:29.683898 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a484f1-fec4-40a1-b068-b1b0e163aa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:29.684168 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a484f1-fec4-40a1-b068-b1b0e163aa45 admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:29.689636 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a484f1-fec4-40a1-b068-b1b0e163aa45 admin admin] RBAC: Authorizing `identity:get_project(project_id=2094d4b288d94b69a3989eda8c1f1660)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:29.691702 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a484f1-fec4-40a1-b068-b1b0e163aa45 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:29.693797 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 102/212] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:29 2021] GET /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:29.709838 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbecb7b-e033-439f-9ee3-486aff106b2e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:29.710876 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbecb7b-e033-439f-9ee3-486aff106b2e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:29.718989 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8505c9-1a76-4658-a41b-179d7efce612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:29.719870 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8505c9-1a76-4658-a41b-179d7efce612 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:29.720155 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8505c9-1a76-4658-a41b-179d7efce612 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:29.720432 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8505c9-1a76-4658-a41b-179d7efce612 admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660/users/2a86b090883647269b0da4a4ef5fc47b/roles/5ce68b651d084d388f8528d29fab2530` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:29.725396 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8505c9-1a76-4658-a41b-179d7efce612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2094d4b288d94b69a3989eda8c1f1660, user_id=2a86b090883647269b0da4a4ef5fc47b, role_id=5ce68b651d084d388f8528d29fab2530)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:29.728385 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8505c9-1a76-4658-a41b-179d7efce612 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:29.803271 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 111/213] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:13:29 2021] PUT /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660/users/2a86b090883647269b0da4a4ef5fc47b/roles/5ce68b651d084d388f8528d29fab2530 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:13:30.872476 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584e109-ec3e-4265-9a8c-c01a8da96f48 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:30.872993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584e109-ec3e-4265-9a8c-c01a8da96f48 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:30.873066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584e109-ec3e-4265-9a8c-c01a8da96f48 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:30.875315 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 103/214] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:30.881913 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fab9c-f5e1-42ea-a4ca-d0a6dd842a1d None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:30.882354 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fab9c-f5e1-42ea-a4ca-d0a6dd842a1d None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:30.882526 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fab9c-f5e1-42ea-a4ca-d0a6dd842a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:30.905907 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-4f3fab9c-f5e1-42ea-a4ca-d0a6dd842a1d None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:30.907124 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-4f3fab9c-f5e1-42ea-a4ca-d0a6dd842a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:30.986107 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 112/215] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:31.026525 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584e109-ec3e-4265-9a8c-c01a8da96f48 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:31.043038 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584e109-ec3e-4265-9a8c-c01a8da96f48 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:31.048873 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6088a8-ac2b-471e-a094-3460b7109fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:31.049702 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6088a8-ac2b-471e-a094-3460b7109fbb admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:31.049990 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6088a8-ac2b-471e-a094-3460b7109fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:31.050245 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6088a8-ac2b-471e-a094-3460b7109fbb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:31.065734 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6088a8-ac2b-471e-a094-3460b7109fbb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:31.072528 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-7d6088a8-ac2b-471e-a094-3460b7109fbb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 01:13:31.074110 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 104/216] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:31.081589 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fab9c-f5e1-42ea-a4ca-d0a6dd842a1d None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:31.094033 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fab9c-f5e1-42ea-a4ca-d0a6dd842a1d None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:31.103818 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4d2d2-852c-4703-8536-586230942906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:31.104494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4d2d2-852c-4703-8536-586230942906 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:31.104776 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4d2d2-852c-4703-8536-586230942906 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:31.105078 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4d2d2-852c-4703-8536-586230942906 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:31.105837 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4d2d2-852c-4703-8536-586230942906 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:31.106142 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4d2d2-852c-4703-8536-586230942906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:31.107800 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4d2d2-852c-4703-8536-586230942906 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:31.121305 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 113/217] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 01:13:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:31.127775 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6088a8-ac2b-471e-a094-3460b7109fbb admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:31.142389 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6088a8-ac2b-471e-a094-3460b7109fbb admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:31.152775 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84db41a-d435-48e0-b9f2-9c1c656b28b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:31.153659 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84db41a-d435-48e0-b9f2-9c1c656b28b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:31.153933 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84db41a-d435-48e0-b9f2-9c1c656b28b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:31.154203 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84db41a-d435-48e0-b9f2-9c1c656b28b4 admin admin] PATH_INFO: `/v3/users/2a86b090883647269b0da4a4ef5fc47b` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:31.161574 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84db41a-d435-48e0-b9f2-9c1c656b28b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a86b090883647269b0da4a4ef5fc47b)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:31.163714 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84db41a-d435-48e0-b9f2-9c1c656b28b4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:31.165674 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 105/218] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:31 2021] GET /identity/v3/users/2a86b090883647269b0da4a4ef5fc47b => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:31.172420 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4d2d2-852c-4703-8536-586230942906 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:31.186396 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4d2d2-852c-4703-8536-586230942906 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:31.197298 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fab0fe-38d6-4690-a69b-bf0ecae7cd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:31.197957 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fab0fe-38d6-4690-a69b-bf0ecae7cd26 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:31.198243 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fab0fe-38d6-4690-a69b-bf0ecae7cd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:31.198524 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fab0fe-38d6-4690-a69b-bf0ecae7cd26 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:31.212630 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fab0fe-38d6-4690-a69b-bf0ecae7cd26 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:31.214422 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fab0fe-38d6-4690-a69b-bf0ecae7cd26 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:31.228143 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 114/219] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:31.234678 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84db41a-d435-48e0-b9f2-9c1c656b28b4 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:31.250465 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84db41a-d435-48e0-b9f2-9c1c656b28b4 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:31.261531 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2056f-b6d7-48c8-b130-2ad6104fbe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:31.262799 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2056f-b6d7-48c8-b130-2ad6104fbe31 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:31.262799 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2056f-b6d7-48c8-b130-2ad6104fbe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:31.263094 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2056f-b6d7-48c8-b130-2ad6104fbe31 admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:31.269603 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2056f-b6d7-48c8-b130-2ad6104fbe31 admin admin] RBAC: Authorizing `identity:get_project(project_id=2094d4b288d94b69a3989eda8c1f1660)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:31.271663 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2056f-b6d7-48c8-b130-2ad6104fbe31 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:31.273417 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 106/220] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:31 2021] GET /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:31.280966 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fab0fe-38d6-4690-a69b-bf0ecae7cd26 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:31.299758 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fab0fe-38d6-4690-a69b-bf0ecae7cd26 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:31.308938 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940f0d3-0115-4ac9-b637-a65862a3f2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:31.309600 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f0d3-0115-4ac9-b637-a65862a3f2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:31.309883 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f0d3-0115-4ac9-b637-a65862a3f2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:31.310162 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f0d3-0115-4ac9-b637-a65862a3f2d3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:31.311819 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940f0d3-0115-4ac9-b637-a65862a3f2d3 admin admin] RBAC: Adding query filter params (role.id=681adf4aa4c14ac7a9ce4ac1c261cf93, scope.project.id=2094d4b288d94b69a3989eda8c1f1660, user.id=2a86b090883647269b0da4a4ef5fc47b) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:31.312131 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940f0d3-0115-4ac9-b637-a65862a3f2d3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:31.314010 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940f0d3-0115-4ac9-b637-a65862a3f2d3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:31.323730 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 115/221] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:31 2021] GET /identity/v3/role_assignments?user.id=2a86b090883647269b0da4a4ef5fc47b&scope.project.id=2094d4b288d94b69a3989eda8c1f1660&role.id=681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:32.028184 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c41e9e-826d-4ee1-aeff-0661bc0ff996 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:32.028898 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c41e9e-826d-4ee1-aeff-0661bc0ff996 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:32.028898 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c41e9e-826d-4ee1-aeff-0661bc0ff996 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:32.031730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 107/222] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:32.037994 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121d9f5-4021-46fb-9357-3e89ba6c7571 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:32.038544 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121d9f5-4021-46fb-9357-3e89ba6c7571 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:32.038731 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121d9f5-4021-46fb-9357-3e89ba6c7571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:32.059479 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-a121d9f5-4021-46fb-9357-3e89ba6c7571 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:32.061266 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a121d9f5-4021-46fb-9357-3e89ba6c7571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:32.075494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 116/223] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:32.106419 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c41e9e-826d-4ee1-aeff-0661bc0ff996 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:32.126467 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c41e9e-826d-4ee1-aeff-0661bc0ff996 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:32.132380 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc02279-8340-4fc1-9151-b1c017fcf2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:32.133218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc02279-8340-4fc1-9151-b1c017fcf2bb admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:32.133496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc02279-8340-4fc1-9151-b1c017fcf2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:32.133765 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc02279-8340-4fc1-9151-b1c017fcf2bb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:32.153762 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc02279-8340-4fc1-9151-b1c017fcf2bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:32.161204 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-1bc02279-8340-4fc1-9151-b1c017fcf2bb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:13:32.162735 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 108/224] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:13:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:32.169731 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121d9f5-4021-46fb-9357-3e89ba6c7571 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:32.182039 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121d9f5-4021-46fb-9357-3e89ba6c7571 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:32.193705 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d046c0-6214-4997-80ae-601594a6d886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:32.194443 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d046c0-6214-4997-80ae-601594a6d886 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:32.194735 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d046c0-6214-4997-80ae-601594a6d886 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:32.195014 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d046c0-6214-4997-80ae-601594a6d886 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:32.195776 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d046c0-6214-4997-80ae-601594a6d886 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:32.196087 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d046c0-6214-4997-80ae-601594a6d886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:32.197715 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d046c0-6214-4997-80ae-601594a6d886 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:32.213565 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 117/225] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:32.220703 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc02279-8340-4fc1-9151-b1c017fcf2bb admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:32.234830 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc02279-8340-4fc1-9151-b1c017fcf2bb admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:32.247201 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e0e22-7fcf-4888-a14a-8eb005d7fdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:32.248098 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e0e22-7fcf-4888-a14a-8eb005d7fdd6 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:32.248944 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e0e22-7fcf-4888-a14a-8eb005d7fdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:32.249217 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e0e22-7fcf-4888-a14a-8eb005d7fdd6 admin admin] PATH_INFO: `/v3/users/d64df7fb530c43779ba7cb0d2f2adf99` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:32.253794 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e0e22-7fcf-4888-a14a-8eb005d7fdd6 admin admin] RBAC: Authorizing `identity:get_user(user_id=d64df7fb530c43779ba7cb0d2f2adf99)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:32.255626 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e0e22-7fcf-4888-a14a-8eb005d7fdd6 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:32.257694 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 109/226] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:32 2021] GET /identity/v3/users/d64df7fb530c43779ba7cb0d2f2adf99 => generated 247 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:32.263870 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d046c0-6214-4997-80ae-601594a6d886 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:32.276649 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d046c0-6214-4997-80ae-601594a6d886 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:32.284630 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5d75c-60ba-44fd-b9d1-a2b2d8a17d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:32.285256 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5d75c-60ba-44fd-b9d1-a2b2d8a17d89 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:32.285596 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5d75c-60ba-44fd-b9d1-a2b2d8a17d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:32.285984 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5d75c-60ba-44fd-b9d1-a2b2d8a17d89 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:32.300575 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5d75c-60ba-44fd-b9d1-a2b2d8a17d89 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:32.302502 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5d75c-60ba-44fd-b9d1-a2b2d8a17d89 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:32.318812 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 118/227] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:32.325127 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e0e22-7fcf-4888-a14a-8eb005d7fdd6 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:32.347757 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e0e22-7fcf-4888-a14a-8eb005d7fdd6 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:32.356945 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d4024-de56-42cf-ae75-4698ed9f37c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:32.357865 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d4024-de56-42cf-ae75-4698ed9f37c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:32.358141 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d4024-de56-42cf-ae75-4698ed9f37c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:32.358412 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d4024-de56-42cf-ae75-4698ed9f37c7 admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:32.365304 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9abd3c-a68a-4d8e-bab3-6b45819d5f0a None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:32.365612 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d4024-de56-42cf-ae75-4698ed9f37c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=2094d4b288d94b69a3989eda8c1f1660)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:32.365780 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9abd3c-a68a-4d8e-bab3-6b45819d5f0a None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:32.365945 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9abd3c-a68a-4d8e-bab3-6b45819d5f0a None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:32.367676 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d4024-de56-42cf-ae75-4698ed9f37c7 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:32.367924 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 119/228] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:32.369674 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 110/229] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:32 2021] GET /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:32.376096 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9abd3c-a68a-4d8e-bab3-6b45819d5f0a None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:32.389369 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924fe23-b04d-47fe-86bb-a9a9984a52f2 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:32.389653 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924fe23-b04d-47fe-86bb-a9a9984a52f2 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:32.390022 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924fe23-b04d-47fe-86bb-a9a9984a52f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:32.398284 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9abd3c-a68a-4d8e-bab3-6b45819d5f0a None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:32.415496 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69effc-bc95-42b3-999d-a22ef3c86f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:32.416214 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69effc-bc95-42b3-999d-a22ef3c86f38 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:32.416500 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69effc-bc95-42b3-999d-a22ef3c86f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:32.416776 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69effc-bc95-42b3-999d-a22ef3c86f38 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:32.419251 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69effc-bc95-42b3-999d-a22ef3c86f38 admin admin] RBAC: Adding query filter params (role.id=faadc5010ffb447ba5280e491c2ea2f5, scope.project.id=2094d4b288d94b69a3989eda8c1f1660, user.id=d64df7fb530c43779ba7cb0d2f2adf99) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:32.419569 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69effc-bc95-42b3-999d-a22ef3c86f38 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:32.424334 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69effc-bc95-42b3-999d-a22ef3c86f38 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:32.437321 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-2924fe23-b04d-47fe-86bb-a9a9984a52f2 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:32.438454 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-2924fe23-b04d-47fe-86bb-a9a9984a52f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:32.441769 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 120/230] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:32 2021] GET /identity/v3/role_assignments?user.id=d64df7fb530c43779ba7cb0d2f2adf99&scope.project.id=2094d4b288d94b69a3989eda8c1f1660&role.id=faadc5010ffb447ba5280e491c2ea2f5 => generated 608 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:32.452549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 111/231] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:32.520342 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69effc-bc95-42b3-999d-a22ef3c86f38 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:32.534249 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69effc-bc95-42b3-999d-a22ef3c86f38 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:32.541373 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523faec6-5c3e-4e1d-b192-75ade7f48f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:32.542170 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523faec6-5c3e-4e1d-b192-75ade7f48f6c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:32.542455 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523faec6-5c3e-4e1d-b192-75ade7f48f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:32.542730 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523faec6-5c3e-4e1d-b192-75ade7f48f6c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:32.558721 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523faec6-5c3e-4e1d-b192-75ade7f48f6c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:32.566100 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-523faec6-5c3e-4e1d-b192-75ade7f48f6c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 01:13:32.567521 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 121/232] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:32 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:32.574067 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924fe23-b04d-47fe-86bb-a9a9984a52f2 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:32.585549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924fe23-b04d-47fe-86bb-a9a9984a52f2 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:32.593488 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891e46e-4630-471f-beb9-cf13098ae33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:32.594170 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891e46e-4630-471f-beb9-cf13098ae33e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:32.594499 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891e46e-4630-471f-beb9-cf13098ae33e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:32.594778 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891e46e-4630-471f-beb9-cf13098ae33e admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:32.595534 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891e46e-4630-471f-beb9-cf13098ae33e admin admin] RBAC: Adding query filter params (name=member) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:32.595837 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891e46e-4630-471f-beb9-cf13098ae33e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:32.597490 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891e46e-4630-471f-beb9-cf13098ae33e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:32.611752 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 112/233] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 01:13:32 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:32.618152 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523faec6-5c3e-4e1d-b192-75ade7f48f6c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:32.630479 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523faec6-5c3e-4e1d-b192-75ade7f48f6c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:32.645751 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa410df-2d35-4ab9-b60d-ef060a6294a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:32.646756 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa410df-2d35-4ab9-b60d-ef060a6294a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:32.647043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa410df-2d35-4ab9-b60d-ef060a6294a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:32.647327 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa410df-2d35-4ab9-b60d-ef060a6294a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:32.662036 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa410df-2d35-4ab9-b60d-ef060a6294a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:32.663835 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa410df-2d35-4ab9-b60d-ef060a6294a8 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:32.678648 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 122/234] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:32.685315 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891e46e-4630-471f-beb9-cf13098ae33e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:32.702506 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891e46e-4630-471f-beb9-cf13098ae33e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:32.713099 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c061f6e-fb32-4508-81cc-9bee31c47d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:32.714032 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c061f6e-fb32-4508-81cc-9bee31c47d8d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:32.714318 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c061f6e-fb32-4508-81cc-9bee31c47d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:32.714635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c061f6e-fb32-4508-81cc-9bee31c47d8d admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:32.717002 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c061f6e-fb32-4508-81cc-9bee31c47d8d admin admin] RBAC: Authorizing `identity:get_project(project_id=966196fad6e9467e93b5762e459a1d84)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:32.719208 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c061f6e-fb32-4508-81cc-9bee31c47d8d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:32.726377 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 113/235] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:32 2021] GET /identity/v3/projects/966196fad6e9467e93b5762e459a1d84 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:32.733213 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa410df-2d35-4ab9-b60d-ef060a6294a8 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:32.742791 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa410df-2d35-4ab9-b60d-ef060a6294a8 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:32.753562 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275190b-0cac-4996-ba43-26def5d06b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:32.754433 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275190b-0cac-4996-ba43-26def5d06b6c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:32.754714 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275190b-0cac-4996-ba43-26def5d06b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:32.754987 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275190b-0cac-4996-ba43-26def5d06b6c admin admin] PATH_INFO: `/v3/groups/aac072deeef0435383b2e63ff22b9e4c` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:32.769662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275190b-0cac-4996-ba43-26def5d06b6c admin admin] RBAC: Authorizing `identity:get_group(group_id=aac072deeef0435383b2e63ff22b9e4c)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:32.770744 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING py.warnings [None req-e275190b-0cac-4996-ba43-26def5d06b6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:32.770744 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: warnings.warn(msg) Aug 27 01:13:32.770744 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: Aug 27 01:13:32.771947 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275190b-0cac-4996-ba43-26def5d06b6c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:32.773986 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 123/236] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 01:13:32 2021] GET /identity/v3/groups/aac072deeef0435383b2e63ff22b9e4c => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:32.780949 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c061f6e-fb32-4508-81cc-9bee31c47d8d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:32.795767 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c061f6e-fb32-4508-81cc-9bee31c47d8d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:32.805092 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16be58-c786-47c1-b798-7b9fea060be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:32.805827 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16be58-c786-47c1-b798-7b9fea060be0 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:32.806116 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16be58-c786-47c1-b798-7b9fea060be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:32.806448 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16be58-c786-47c1-b798-7b9fea060be0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:32.807311 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16be58-c786-47c1-b798-7b9fea060be0 admin admin] RBAC: Adding query filter params (group.id=aac072deeef0435383b2e63ff22b9e4c, role.id=681adf4aa4c14ac7a9ce4ac1c261cf93, scope.project.id=966196fad6e9467e93b5762e459a1d84) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:32.807672 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16be58-c786-47c1-b798-7b9fea060be0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:32.809954 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16be58-c786-47c1-b798-7b9fea060be0 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:32.819868 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 114/237] 10.222.0.25 () {56 vars in 1398 bytes} [Fri Aug 27 01:13:32 2021] GET /identity/v3/role_assignments?group.id=aac072deeef0435383b2e63ff22b9e4c&scope.project.id=966196fad6e9467e93b5762e459a1d84&role.id=681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:33.285070 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35504567-3325-46c4-9929-12be6775ed85 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:33.285831 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35504567-3325-46c4-9929-12be6775ed85 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:33.285831 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35504567-3325-46c4-9929-12be6775ed85 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:33.287401 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 124/238] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:33.294594 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb60c1-4368-49ac-929c-6b520fcf7d7a None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:33.295679 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb60c1-4368-49ac-929c-6b520fcf7d7a None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:33.295679 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb60c1-4368-49ac-929c-6b520fcf7d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:33.317862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-37cb60c1-4368-49ac-929c-6b520fcf7d7a None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:33.319066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-37cb60c1-4368-49ac-929c-6b520fcf7d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:33.327588 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 115/239] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:33.376036 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35504567-3325-46c4-9929-12be6775ed85 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:33.394591 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35504567-3325-46c4-9929-12be6775ed85 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:33.399168 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030295f4-4106-4b0a-8165-49c0813ab3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:33.399974 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030295f4-4106-4b0a-8165-49c0813ab3cd admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:33.400255 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030295f4-4106-4b0a-8165-49c0813ab3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:33.400529 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030295f4-4106-4b0a-8165-49c0813ab3cd admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:33.418151 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030295f4-4106-4b0a-8165-49c0813ab3cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:33.424653 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-030295f4-4106-4b0a-8165-49c0813ab3cd admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 01:13:33.426215 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 125/240] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:13:33 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:33.432555 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb60c1-4368-49ac-929c-6b520fcf7d7a None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:33.446006 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb60c1-4368-49ac-929c-6b520fcf7d7a None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:33.453465 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54c84d-b433-436e-9d4e-a6f88fd09d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:33.454152 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54c84d-b433-436e-9d4e-a6f88fd09d5f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:33.454430 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54c84d-b433-436e-9d4e-a6f88fd09d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:33.454701 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54c84d-b433-436e-9d4e-a6f88fd09d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:33.455718 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54c84d-b433-436e-9d4e-a6f88fd09d5f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:33.456064 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54c84d-b433-436e-9d4e-a6f88fd09d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:33.457654 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54c84d-b433-436e-9d4e-a6f88fd09d5f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:33.466585 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 116/241] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:33 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:33.473064 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030295f4-4106-4b0a-8165-49c0813ab3cd admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:33.483937 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030295f4-4106-4b0a-8165-49c0813ab3cd admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:33.493013 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae30774-e4f1-491b-afae-9220c469f508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:33.493891 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae30774-e4f1-491b-afae-9220c469f508 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:33.494174 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae30774-e4f1-491b-afae-9220c469f508 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:33.494451 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae30774-e4f1-491b-afae-9220c469f508 admin admin] PATH_INFO: `/v3/users/2a86b090883647269b0da4a4ef5fc47b` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:33.495686 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae30774-e4f1-491b-afae-9220c469f508 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a86b090883647269b0da4a4ef5fc47b)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:33.497857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae30774-e4f1-491b-afae-9220c469f508 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:33.500511 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 126/242] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:13:33 2021] GET /identity/v3/users/2a86b090883647269b0da4a4ef5fc47b => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:33.506757 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54c84d-b433-436e-9d4e-a6f88fd09d5f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:33.517122 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54c84d-b433-436e-9d4e-a6f88fd09d5f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:33.524376 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f49a7-39a9-4664-b0a1-277e93552d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:33.525076 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f49a7-39a9-4664-b0a1-277e93552d19 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:33.525366 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f49a7-39a9-4664-b0a1-277e93552d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:33.525646 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f49a7-39a9-4664-b0a1-277e93552d19 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:33.541314 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f49a7-39a9-4664-b0a1-277e93552d19 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:33.543032 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f49a7-39a9-4664-b0a1-277e93552d19 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:33.560020 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 117/243] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:33.567139 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae30774-e4f1-491b-afae-9220c469f508 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:33.587322 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae30774-e4f1-491b-afae-9220c469f508 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:33.594879 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4f0fa-5662-4b70-869e-93cb08650bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:33.595750 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4f0fa-5662-4b70-869e-93cb08650bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:33.596031 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4f0fa-5662-4b70-869e-93cb08650bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:33.596310 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4f0fa-5662-4b70-869e-93cb08650bf5 admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:33.597546 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4f0fa-5662-4b70-869e-93cb08650bf5 admin admin] RBAC: Authorizing `identity:get_project(project_id=2094d4b288d94b69a3989eda8c1f1660)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:33.599606 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4f0fa-5662-4b70-869e-93cb08650bf5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:33.601531 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 127/244] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:33 2021] GET /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:33.608513 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f49a7-39a9-4664-b0a1-277e93552d19 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:33.621891 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f49a7-39a9-4664-b0a1-277e93552d19 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:33.629607 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a98d56-4489-411a-a297-6298c33db0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:33.630529 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a98d56-4489-411a-a297-6298c33db0fe admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:33.631063 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a98d56-4489-411a-a297-6298c33db0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:33.631577 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a98d56-4489-411a-a297-6298c33db0fe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:33.632623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a98d56-4489-411a-a297-6298c33db0fe admin admin] RBAC: Adding query filter params (role.id=5ce68b651d084d388f8528d29fab2530, scope.project.id=2094d4b288d94b69a3989eda8c1f1660, user.id=2a86b090883647269b0da4a4ef5fc47b) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:33.633171 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a98d56-4489-411a-a297-6298c33db0fe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:33.635324 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a98d56-4489-411a-a297-6298c33db0fe admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:33.645493 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 118/245] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:33 2021] GET /identity/v3/role_assignments?user.id=2a86b090883647269b0da4a4ef5fc47b&scope.project.id=2094d4b288d94b69a3989eda8c1f1660&role.id=5ce68b651d084d388f8528d29fab2530 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:33.659848 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fa4f5-5692-4d02-8641-0ae98733fcf5 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:33.660176 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fa4f5-5692-4d02-8641-0ae98733fcf5 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:33.660403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fa4f5-5692-4d02-8641-0ae98733fcf5 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:33.662216 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 128/246] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:33.668891 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502249d-d15d-4bae-900c-873250bf7115 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:33.669462 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502249d-d15d-4bae-900c-873250bf7115 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:33.670148 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502249d-d15d-4bae-900c-873250bf7115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:33.692664 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-6502249d-d15d-4bae-900c-873250bf7115 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:33.694247 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-6502249d-d15d-4bae-900c-873250bf7115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:33.705998 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 119/247] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:33.750136 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fa4f5-5692-4d02-8641-0ae98733fcf5 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:33.769345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fa4f5-5692-4d02-8641-0ae98733fcf5 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:33.776449 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2178b3-426c-429f-a986-c01ed279145e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:33.777283 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2178b3-426c-429f-a986-c01ed279145e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:33.777562 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2178b3-426c-429f-a986-c01ed279145e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:33.777864 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2178b3-426c-429f-a986-c01ed279145e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:33.794120 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2178b3-426c-429f-a986-c01ed279145e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:33.801898 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-8d2178b3-426c-429f-a986-c01ed279145e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 01:13:33.803126 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 129/248] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:13:33 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:13:33.810455 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502249d-d15d-4bae-900c-873250bf7115 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:33.824485 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502249d-d15d-4bae-900c-873250bf7115 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:33.834250 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a85d26-2d2e-446e-b29a-a75814ffbd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:33.835278 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a85d26-2d2e-446e-b29a-a75814ffbd67 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:33.835757 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a85d26-2d2e-446e-b29a-a75814ffbd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:33.836247 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a85d26-2d2e-446e-b29a-a75814ffbd67 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:33.837307 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a85d26-2d2e-446e-b29a-a75814ffbd67 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:33.837833 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a85d26-2d2e-446e-b29a-a75814ffbd67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:33.839680 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a85d26-2d2e-446e-b29a-a75814ffbd67 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:33.855700 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 120/249] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:33 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:33.863405 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2178b3-426c-429f-a986-c01ed279145e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:33.878057 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2178b3-426c-429f-a986-c01ed279145e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:33.888049 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f34ec-2bdc-49c9-9abd-8b4844574181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:33.889316 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f34ec-2bdc-49c9-9abd-8b4844574181 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:33.889720 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f34ec-2bdc-49c9-9abd-8b4844574181 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:33.889996 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f34ec-2bdc-49c9-9abd-8b4844574181 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:33.901197 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f34ec-2bdc-49c9-9abd-8b4844574181 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:33.902973 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f34ec-2bdc-49c9-9abd-8b4844574181 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:33.918981 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 130/250] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:33.927387 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a85d26-2d2e-446e-b29a-a75814ffbd67 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:33.942363 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a85d26-2d2e-446e-b29a-a75814ffbd67 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:33.952826 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d66827-f317-405b-bbb0-73c93c34f69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:33.954142 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d66827-f317-405b-bbb0-73c93c34f69e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:33.954624 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d66827-f317-405b-bbb0-73c93c34f69e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:33.955094 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d66827-f317-405b-bbb0-73c93c34f69e admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:33.957171 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d66827-f317-405b-bbb0-73c93c34f69e admin admin] RBAC: Authorizing `identity:get_project(project_id=966196fad6e9467e93b5762e459a1d84)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:33.959597 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d66827-f317-405b-bbb0-73c93c34f69e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:33.964978 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 121/251] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:33 2021] GET /identity/v3/projects/966196fad6e9467e93b5762e459a1d84 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:33.969548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f34ec-2bdc-49c9-9abd-8b4844574181 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:33.978699 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f34ec-2bdc-49c9-9abd-8b4844574181 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:33.989268 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af918c02-ed02-41ef-88a1-e3d47458097f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:33.990146 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af918c02-ed02-41ef-88a1-e3d47458097f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:33.990426 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af918c02-ed02-41ef-88a1-e3d47458097f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:33.990707 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af918c02-ed02-41ef-88a1-e3d47458097f admin admin] PATH_INFO: `/v3/groups/aac072deeef0435383b2e63ff22b9e4c` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:33.997797 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af918c02-ed02-41ef-88a1-e3d47458097f admin admin] RBAC: Authorizing `identity:get_group(group_id=aac072deeef0435383b2e63ff22b9e4c)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:34.000012 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af918c02-ed02-41ef-88a1-e3d47458097f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:34.001764 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 131/252] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 01:13:33 2021] GET /identity/v3/groups/aac072deeef0435383b2e63ff22b9e4c => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:34.008903 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d66827-f317-405b-bbb0-73c93c34f69e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:34.021969 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d66827-f317-405b-bbb0-73c93c34f69e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:34.028779 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b57a0-8519-49eb-a9d7-046792b1afe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:34.029974 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b57a0-8519-49eb-a9d7-046792b1afe5 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:34.030523 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b57a0-8519-49eb-a9d7-046792b1afe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:34.031000 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b57a0-8519-49eb-a9d7-046792b1afe5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:34.032060 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b57a0-8519-49eb-a9d7-046792b1afe5 admin admin] RBAC: Adding query filter params (group.id=aac072deeef0435383b2e63ff22b9e4c, role.id=5ce68b651d084d388f8528d29fab2530, scope.project.id=966196fad6e9467e93b5762e459a1d84) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:34.032581 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b57a0-8519-49eb-a9d7-046792b1afe5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:34.038864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b57a0-8519-49eb-a9d7-046792b1afe5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:34.046542 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 122/253] 10.222.0.25 () {56 vars in 1398 bytes} [Fri Aug 27 01:13:34 2021] GET /identity/v3/role_assignments?group.id=aac072deeef0435383b2e63ff22b9e4c&scope.project.id=966196fad6e9467e93b5762e459a1d84&role.id=5ce68b651d084d388f8528d29fab2530 => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:34.374980 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef47fa2-4c75-4bfe-b808-48d6cda0a42e None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:34.375481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef47fa2-4c75-4bfe-b808-48d6cda0a42e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:34.375481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef47fa2-4c75-4bfe-b808-48d6cda0a42e None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:34.377494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 132/254] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:34.388328 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aba9ec-85a7-4ecd-9e63-ace623fe12c0 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:34.389381 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aba9ec-85a7-4ecd-9e63-ace623fe12c0 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:34.389670 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aba9ec-85a7-4ecd-9e63-ace623fe12c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:34.409831 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-27aba9ec-85a7-4ecd-9e63-ace623fe12c0 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:34.411034 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-27aba9ec-85a7-4ecd-9e63-ace623fe12c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:34.423435 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 123/255] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:34.448495 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef47fa2-4c75-4bfe-b808-48d6cda0a42e None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:34.462157 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef47fa2-4c75-4bfe-b808-48d6cda0a42e None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:34.466508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae339b3-c909-4140-9ec6-f8d4cc613c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:34.467833 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae339b3-c909-4140-9ec6-f8d4cc613c74 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:34.468116 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae339b3-c909-4140-9ec6-f8d4cc613c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:34.468387 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae339b3-c909-4140-9ec6-f8d4cc613c74 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:34.480605 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae339b3-c909-4140-9ec6-f8d4cc613c74 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:34.488171 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-fae339b3-c909-4140-9ec6-f8d4cc613c74 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 01:13:34.489777 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 133/256] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:34 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:34.496262 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aba9ec-85a7-4ecd-9e63-ace623fe12c0 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:34.506563 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aba9ec-85a7-4ecd-9e63-ace623fe12c0 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:34.511093 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16c2b5-e41c-4328-8a75-a59449c0a0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:34.511811 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16c2b5-e41c-4328-8a75-a59449c0a0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:34.512094 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16c2b5-e41c-4328-8a75-a59449c0a0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:34.512420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16c2b5-e41c-4328-8a75-a59449c0a0b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:34.513282 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16c2b5-e41c-4328-8a75-a59449c0a0b1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:34.513717 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16c2b5-e41c-4328-8a75-a59449c0a0b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:34.515820 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16c2b5-e41c-4328-8a75-a59449c0a0b1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:34.524914 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 124/257] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 01:13:34 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:34.531370 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae339b3-c909-4140-9ec6-f8d4cc613c74 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:34.541398 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae339b3-c909-4140-9ec6-f8d4cc613c74 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:34.546531 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0e005-99ac-48e3-86fa-bd5aca42aaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:34.547245 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0e005-99ac-48e3-86fa-bd5aca42aaaa admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:34.547508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0e005-99ac-48e3-86fa-bd5aca42aaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:34.547823 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0e005-99ac-48e3-86fa-bd5aca42aaaa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:34.557013 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0e005-99ac-48e3-86fa-bd5aca42aaaa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:34.558795 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0e005-99ac-48e3-86fa-bd5aca42aaaa admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:34.568728 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 134/258] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:34.575151 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16c2b5-e41c-4328-8a75-a59449c0a0b1 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:34.585956 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16c2b5-e41c-4328-8a75-a59449c0a0b1 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:34.590546 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b344783-a51d-4412-a3b2-f6bbe6a5e9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:34.591456 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b344783-a51d-4412-a3b2-f6bbe6a5e9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:34.591850 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b344783-a51d-4412-a3b2-f6bbe6a5e9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:34.592297 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b344783-a51d-4412-a3b2-f6bbe6a5e9f9 admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:34.593540 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b344783-a51d-4412-a3b2-f6bbe6a5e9f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=2094d4b288d94b69a3989eda8c1f1660)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:34.595720 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b344783-a51d-4412-a3b2-f6bbe6a5e9f9 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:34.597519 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 125/259] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:34 2021] GET /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:34.604139 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0e005-99ac-48e3-86fa-bd5aca42aaaa admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:34.614345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0e005-99ac-48e3-86fa-bd5aca42aaaa admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:34.618902 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e7f51-53f5-48b2-a206-cdeab7ead6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:34.619806 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e7f51-53f5-48b2-a206-cdeab7ead6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:34.620140 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e7f51-53f5-48b2-a206-cdeab7ead6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:34.620417 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e7f51-53f5-48b2-a206-cdeab7ead6b1 admin admin] PATH_INFO: `/v3/groups/aac072deeef0435383b2e63ff22b9e4c` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:34.621783 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e7f51-53f5-48b2-a206-cdeab7ead6b1 admin admin] RBAC: Authorizing `identity:get_group(group_id=aac072deeef0435383b2e63ff22b9e4c)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:34.624051 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e7f51-53f5-48b2-a206-cdeab7ead6b1 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:34.626080 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 135/260] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 01:13:34 2021] GET /identity/v3/groups/aac072deeef0435383b2e63ff22b9e4c => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:34.632571 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b344783-a51d-4412-a3b2-f6bbe6a5e9f9 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:34.643493 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b344783-a51d-4412-a3b2-f6bbe6a5e9f9 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:34.648208 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c856e6-40b3-4572-a1ec-4e5fdce40650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:34.648952 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c856e6-40b3-4572-a1ec-4e5fdce40650 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:34.649235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c856e6-40b3-4572-a1ec-4e5fdce40650 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:34.649514 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c856e6-40b3-4572-a1ec-4e5fdce40650 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:34.650390 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c856e6-40b3-4572-a1ec-4e5fdce40650 admin admin] RBAC: Adding query filter params (group.id=aac072deeef0435383b2e63ff22b9e4c, role.id=681adf4aa4c14ac7a9ce4ac1c261cf93, scope.project.id=2094d4b288d94b69a3989eda8c1f1660) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:34.650705 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c856e6-40b3-4572-a1ec-4e5fdce40650 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:34.652632 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c856e6-40b3-4572-a1ec-4e5fdce40650 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:34.658978 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 126/261] 10.222.0.25 () {56 vars in 1398 bytes} [Fri Aug 27 01:13:34 2021] GET /identity/v3/role_assignments?group.id=aac072deeef0435383b2e63ff22b9e4c&scope.project.id=2094d4b288d94b69a3989eda8c1f1660&role.id=681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 260 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:34.910492 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a07b-90b2-4f9a-9461-3096e4b595fe None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:34.910883 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a07b-90b2-4f9a-9461-3096e4b595fe None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:34.911050 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a07b-90b2-4f9a-9461-3096e4b595fe None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:34.913119 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 136/262] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:34.922772 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d7974-7eec-42e1-a741-4286e4d97f7f None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:34.923057 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d7974-7eec-42e1-a741-4286e4d97f7f None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:34.923332 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d7974-7eec-42e1-a741-4286e4d97f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:34.947951 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-8c7d7974-7eec-42e1-a741-4286e4d97f7f None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:34.949174 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8c7d7974-7eec-42e1-a741-4286e4d97f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:34.960590 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 127/263] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:35.002875 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1a07b-90b2-4f9a-9461-3096e4b595fe None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:35.018382 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1a07b-90b2-4f9a-9461-3096e4b595fe None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:35.028737 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abe686-cf86-4511-942c-3e3174f66856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:35.030119 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abe686-cf86-4511-942c-3e3174f66856 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:35.030381 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abe686-cf86-4511-942c-3e3174f66856 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:35.030651 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abe686-cf86-4511-942c-3e3174f66856 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:35.041558 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5abe686-cf86-4511-942c-3e3174f66856 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:35.048597 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-d5abe686-cf86-4511-942c-3e3174f66856 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 01:13:35.050149 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 137/264] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:13:35 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:35.056584 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d7974-7eec-42e1-a741-4286e4d97f7f None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:35.071346 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d7974-7eec-42e1-a741-4286e4d97f7f None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:35.080040 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1df641-f1b0-4e04-aabb-a041acc23365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:35.081043 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1df641-f1b0-4e04-aabb-a041acc23365 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:35.081325 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1df641-f1b0-4e04-aabb-a041acc23365 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:35.081596 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1df641-f1b0-4e04-aabb-a041acc23365 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:35.082423 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1df641-f1b0-4e04-aabb-a041acc23365 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:35.082730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1df641-f1b0-4e04-aabb-a041acc23365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:35.084424 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1df641-f1b0-4e04-aabb-a041acc23365 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:35.100121 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 128/265] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:35 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:35.106823 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abe686-cf86-4511-942c-3e3174f66856 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:35.116911 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abe686-cf86-4511-942c-3e3174f66856 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:35.127323 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eac074-d6c9-4851-80e8-ba14ec01820c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:35.127975 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eac074-d6c9-4851-80e8-ba14ec01820c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:35.128253 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eac074-d6c9-4851-80e8-ba14ec01820c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:35.128526 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eac074-d6c9-4851-80e8-ba14ec01820c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:35.140593 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eac074-d6c9-4851-80e8-ba14ec01820c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:35.142406 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eac074-d6c9-4851-80e8-ba14ec01820c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:35.156331 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 138/266] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:35.161882 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd91dc5-336a-44ad-99fe-4fe9caf90918 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:35.162110 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd91dc5-336a-44ad-99fe-4fe9caf90918 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:35.162372 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd91dc5-336a-44ad-99fe-4fe9caf90918 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:35.162579 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eac074-d6c9-4851-80e8-ba14ec01820c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:35.164143 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 129/267] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:35.170052 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c726e2-4161-4f04-9c87-e1aeb76e7320 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:35.170420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c726e2-4161-4f04-9c87-e1aeb76e7320 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:35.170616 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c726e2-4161-4f04-9c87-e1aeb76e7320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:35.171815 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eac074-d6c9-4851-80e8-ba14ec01820c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:35.182929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def7fda-f3dc-482a-99a2-ab18cc2f9731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:35.183791 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def7fda-f3dc-482a-99a2-ab18cc2f9731 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:35.184119 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def7fda-f3dc-482a-99a2-ab18cc2f9731 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:35.184394 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def7fda-f3dc-482a-99a2-ab18cc2f9731 admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:35.187211 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def7fda-f3dc-482a-99a2-ab18cc2f9731 admin admin] RBAC: Authorizing `identity:get_project(project_id=2094d4b288d94b69a3989eda8c1f1660)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:35.192090 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def7fda-f3dc-482a-99a2-ab18cc2f9731 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:35.194059 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 139/268] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:35 2021] GET /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:35.200824 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def7fda-f3dc-482a-99a2-ab18cc2f9731 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:35.210356 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-e5c726e2-4161-4f04-9c87-e1aeb76e7320 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:35.212978 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e5c726e2-4161-4f04-9c87-e1aeb76e7320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:35.219563 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def7fda-f3dc-482a-99a2-ab18cc2f9731 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:35.229236 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 130/269] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:35.229837 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564aaf5-6093-4dcb-b221-22f9b0a4024b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:35.230649 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564aaf5-6093-4dcb-b221-22f9b0a4024b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:35.230928 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564aaf5-6093-4dcb-b221-22f9b0a4024b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:35.231200 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564aaf5-6093-4dcb-b221-22f9b0a4024b admin admin] PATH_INFO: `/v3/groups/aac072deeef0435383b2e63ff22b9e4c` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:35.237898 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564aaf5-6093-4dcb-b221-22f9b0a4024b admin admin] RBAC: Authorizing `identity:get_group(group_id=aac072deeef0435383b2e63ff22b9e4c)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:35.240818 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564aaf5-6093-4dcb-b221-22f9b0a4024b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:35.242739 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 140/270] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 01:13:35 2021] GET /identity/v3/groups/aac072deeef0435383b2e63ff22b9e4c => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:35.250572 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c726e2-4161-4f04-9c87-e1aeb76e7320 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:35.257541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564aaf5-6093-4dcb-b221-22f9b0a4024b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:35.261474 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c726e2-4161-4f04-9c87-e1aeb76e7320 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:35.273506 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46de811-bc94-4d9b-a2e4-fe4efbbd859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:35.274214 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46de811-bc94-4d9b-a2e4-fe4efbbd859a admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:35.274501 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46de811-bc94-4d9b-a2e4-fe4efbbd859a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:35.274775 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46de811-bc94-4d9b-a2e4-fe4efbbd859a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:35.275602 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46de811-bc94-4d9b-a2e4-fe4efbbd859a admin admin] RBAC: Adding query filter params (group.id=aac072deeef0435383b2e63ff22b9e4c, role.id=5ce68b651d084d388f8528d29fab2530, scope.project.id=2094d4b288d94b69a3989eda8c1f1660) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:35.275913 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46de811-bc94-4d9b-a2e4-fe4efbbd859a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:35.277796 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46de811-bc94-4d9b-a2e4-fe4efbbd859a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:35.280639 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564aaf5-6093-4dcb-b221-22f9b0a4024b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:35.291819 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 131/271] 10.222.0.25 () {56 vars in 1398 bytes} [Fri Aug 27 01:13:35 2021] GET /identity/v3/role_assignments?group.id=aac072deeef0435383b2e63ff22b9e4c&scope.project.id=2094d4b288d94b69a3989eda8c1f1660&role.id=5ce68b651d084d388f8528d29fab2530 => generated 260 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:35.293140 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf898598-8c19-4288-b389-4d9bfc7b0ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:35.293917 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf898598-8c19-4288-b389-4d9bfc7b0ead admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:35.294203 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf898598-8c19-4288-b389-4d9bfc7b0ead admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:35.294484 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf898598-8c19-4288-b389-4d9bfc7b0ead admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:35.308076 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf898598-8c19-4288-b389-4d9bfc7b0ead admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:35.315799 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-cf898598-8c19-4288-b389-4d9bfc7b0ead admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:13:35.317438 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 141/272] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:13:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:35.323508 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46de811-bc94-4d9b-a2e4-fe4efbbd859a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:35.342058 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46de811-bc94-4d9b-a2e4-fe4efbbd859a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:35.347153 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dada5d-0642-4a3d-a100-eb17ca5f8d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:35.347894 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dada5d-0642-4a3d-a100-eb17ca5f8d6d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:35.348173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dada5d-0642-4a3d-a100-eb17ca5f8d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:35.348450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dada5d-0642-4a3d-a100-eb17ca5f8d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:35.349308 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dada5d-0642-4a3d-a100-eb17ca5f8d6d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:35.349615 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dada5d-0642-4a3d-a100-eb17ca5f8d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:35.351225 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dada5d-0642-4a3d-a100-eb17ca5f8d6d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:35.365164 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 132/273] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:35.371578 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf898598-8c19-4288-b389-4d9bfc7b0ead admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:35.387956 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf898598-8c19-4288-b389-4d9bfc7b0ead admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:35.395156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2920b-2287-4839-9031-7913651301c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:35.395156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2920b-2287-4839-9031-7913651301c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:35.395156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2920b-2287-4839-9031-7913651301c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:35.395156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2920b-2287-4839-9031-7913651301c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:35.409907 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2920b-2287-4839-9031-7913651301c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:35.416260 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2920b-2287-4839-9031-7913651301c9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:35.427050 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 142/274] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:35.433366 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dada5d-0642-4a3d-a100-eb17ca5f8d6d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:35.446536 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dada5d-0642-4a3d-a100-eb17ca5f8d6d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:35.458708 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324dfef0-d324-4736-91d9-5b683e887102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:35.459587 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dfef0-d324-4736-91d9-5b683e887102 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:35.459870 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dfef0-d324-4736-91d9-5b683e887102 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:35.460148 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dfef0-d324-4736-91d9-5b683e887102 admin admin] PATH_INFO: `/v3/projects/e9904079a3e94900bd545a99cd672ff0` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:35.465533 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324dfef0-d324-4736-91d9-5b683e887102 admin admin] RBAC: Authorizing `identity:get_project(project_id=e9904079a3e94900bd545a99cd672ff0)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:35.467420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324dfef0-d324-4736-91d9-5b683e887102 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:35.469248 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 133/275] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:35 2021] GET /identity/v3/projects/e9904079a3e94900bd545a99cd672ff0 => generated 344 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:35.475709 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2920b-2287-4839-9031-7913651301c9 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:35.490566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2920b-2287-4839-9031-7913651301c9 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:35.495216 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9cc70-a95d-4a05-8118-e55afd4a8cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:35.496089 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9cc70-a95d-4a05-8118-e55afd4a8cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:35.496379 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9cc70-a95d-4a05-8118-e55afd4a8cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:35.496660 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9cc70-a95d-4a05-8118-e55afd4a8cc9 admin admin] PATH_INFO: `/v3/groups/df8c8e75c6a047369e9c77d7949a3a5e` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:35.503289 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9cc70-a95d-4a05-8118-e55afd4a8cc9 admin admin] RBAC: Authorizing `identity:get_group(group_id=df8c8e75c6a047369e9c77d7949a3a5e)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:35.505271 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9cc70-a95d-4a05-8118-e55afd4a8cc9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:35.507030 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 143/276] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 01:13:35 2021] GET /identity/v3/groups/df8c8e75c6a047369e9c77d7949a3a5e => generated 229 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:35.513542 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324dfef0-d324-4736-91d9-5b683e887102 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:35.531174 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324dfef0-d324-4736-91d9-5b683e887102 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:35.536022 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58b595-f688-4c51-9f9c-f71305da4982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:35.536677 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58b595-f688-4c51-9f9c-f71305da4982 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:35.537012 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58b595-f688-4c51-9f9c-f71305da4982 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:35.537288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58b595-f688-4c51-9f9c-f71305da4982 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:35.538224 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58b595-f688-4c51-9f9c-f71305da4982 admin admin] RBAC: Adding query filter params (group.id=df8c8e75c6a047369e9c77d7949a3a5e, role.id=faadc5010ffb447ba5280e491c2ea2f5, scope.project.id=e9904079a3e94900bd545a99cd672ff0) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:35.538542 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58b595-f688-4c51-9f9c-f71305da4982 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:35.540490 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58b595-f688-4c51-9f9c-f71305da4982 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:35.547196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 134/277] 10.222.0.25 () {56 vars in 1398 bytes} [Fri Aug 27 01:13:35 2021] GET /identity/v3/role_assignments?group.id=df8c8e75c6a047369e9c77d7949a3a5e&scope.project.id=e9904079a3e94900bd545a99cd672ff0&role.id=faadc5010ffb447ba5280e491c2ea2f5 => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:36.149027 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215368a8-2ce4-4962-8112-050fc7ce3e58 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:36.149398 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215368a8-2ce4-4962-8112-050fc7ce3e58 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:36.149563 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215368a8-2ce4-4962-8112-050fc7ce3e58 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:36.151721 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 144/278] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:36.157614 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b58808-e5ed-448a-addf-566f86c86bda None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:36.157904 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b58808-e5ed-448a-addf-566f86c86bda None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:36.158185 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b58808-e5ed-448a-addf-566f86c86bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:36.181862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-a1b58808-e5ed-448a-addf-566f86c86bda None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:36.183080 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a1b58808-e5ed-448a-addf-566f86c86bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:36.192192 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 135/279] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:36.227962 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215368a8-2ce4-4962-8112-050fc7ce3e58 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:36.241727 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215368a8-2ce4-4962-8112-050fc7ce3e58 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:36.253296 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea1642-9c75-4163-aa23-80b843d34734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:36.254109 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea1642-9c75-4163-aa23-80b843d34734 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:36.254390 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea1642-9c75-4163-aa23-80b843d34734 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:36.254664 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea1642-9c75-4163-aa23-80b843d34734 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:36.271780 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea1642-9c75-4163-aa23-80b843d34734 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:36.278809 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-62ea1642-9c75-4163-aa23-80b843d34734 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 01:13:36.283071 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 145/280] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:36 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:36.289078 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b58808-e5ed-448a-addf-566f86c86bda None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:36.299819 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b58808-e5ed-448a-addf-566f86c86bda None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:36.312881 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528600ec-e061-47df-b4a6-a1266b5befc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:36.312881 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528600ec-e061-47df-b4a6-a1266b5befc2 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:36.312881 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528600ec-e061-47df-b4a6-a1266b5befc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:36.312881 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528600ec-e061-47df-b4a6-a1266b5befc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:36.313287 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528600ec-e061-47df-b4a6-a1266b5befc2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:36.313287 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528600ec-e061-47df-b4a6-a1266b5befc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:36.314948 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528600ec-e061-47df-b4a6-a1266b5befc2 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:36.326670 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 136/281] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 01:13:36 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:36.333120 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea1642-9c75-4163-aa23-80b843d34734 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:36.344080 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea1642-9c75-4163-aa23-80b843d34734 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:36.352643 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ddd40-6fdb-4a34-8781-6cd9bf9544a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:36.353711 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ddd40-6fdb-4a34-8781-6cd9bf9544a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:36.354140 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ddd40-6fdb-4a34-8781-6cd9bf9544a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:36.354586 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ddd40-6fdb-4a34-8781-6cd9bf9544a1 admin admin] PATH_INFO: `/v3/groups/aac072deeef0435383b2e63ff22b9e4c` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:36.355912 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ddd40-6fdb-4a34-8781-6cd9bf9544a1 admin admin] RBAC: Authorizing `identity:get_group(group_id=aac072deeef0435383b2e63ff22b9e4c)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:36.360279 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ddd40-6fdb-4a34-8781-6cd9bf9544a1 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:36.362423 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 146/282] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 01:13:36 2021] GET /identity/v3/groups/aac072deeef0435383b2e63ff22b9e4c => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:36.368144 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528600ec-e061-47df-b4a6-a1266b5befc2 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:36.384456 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528600ec-e061-47df-b4a6-a1266b5befc2 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:36.403002 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d8bbe-c7cc-4c19-bafa-88548cbdc7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:36.403817 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d8bbe-c7cc-4c19-bafa-88548cbdc7db admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:36.404100 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d8bbe-c7cc-4c19-bafa-88548cbdc7db admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:36.404571 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d8bbe-c7cc-4c19-bafa-88548cbdc7db admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:36.406029 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d8bbe-c7cc-4c19-bafa-88548cbdc7db admin admin] RBAC: Authorizing `identity:get_project(project_id=966196fad6e9467e93b5762e459a1d84)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:36.408091 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d8bbe-c7cc-4c19-bafa-88548cbdc7db admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:36.409873 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 137/283] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:36 2021] GET /identity/v3/projects/966196fad6e9467e93b5762e459a1d84 => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:36.416129 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ddd40-6fdb-4a34-8781-6cd9bf9544a1 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:36.430125 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ddd40-6fdb-4a34-8781-6cd9bf9544a1 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:36.440445 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf4269-42fc-4e12-a36d-c7c55932c3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:36.441633 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf4269-42fc-4e12-a36d-c7c55932c3a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:36.442119 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf4269-42fc-4e12-a36d-c7c55932c3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:36.442592 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf4269-42fc-4e12-a36d-c7c55932c3a2 admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84/groups/aac072deeef0435383b2e63ff22b9e4c/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:36.444775 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf4269-42fc-4e12-a36d-c7c55932c3a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=966196fad6e9467e93b5762e459a1d84, group_id=aac072deeef0435383b2e63ff22b9e4c, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:36.447656 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf4269-42fc-4e12-a36d-c7c55932c3a2 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:36.540858 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 147/284] 10.222.0.25 () {58 vars in 1464 bytes} [Fri Aug 27 01:13:36 2021] PUT /identity/v3/projects/966196fad6e9467e93b5762e459a1d84/groups/aac072deeef0435383b2e63ff22b9e4c/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:13:37.039315 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37b6d-3e38-4e7c-924c-9ea2f3af7f9d None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:37.097096 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37b6d-3e38-4e7c-924c-9ea2f3af7f9d None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:37.097096 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37b6d-3e38-4e7c-924c-9ea2f3af7f9d None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:37.097096 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 138/285] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:37.097360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cead40e-e4ce-4780-8eac-71bf1dfd3f69 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:37.097360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cead40e-e4ce-4780-8eac-71bf1dfd3f69 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:37.097360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cead40e-e4ce-4780-8eac-71bf1dfd3f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:37.097360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-2cead40e-e4ce-4780-8eac-71bf1dfd3f69 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:37.097360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-2cead40e-e4ce-4780-8eac-71bf1dfd3f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:37.149948 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 148/286] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:37.196420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a37b6d-3e38-4e7c-924c-9ea2f3af7f9d None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:37.216184 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a37b6d-3e38-4e7c-924c-9ea2f3af7f9d None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:37.223014 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706514cb-0c7e-470a-9129-710dc279e0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:37.223876 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706514cb-0c7e-470a-9129-710dc279e0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:37.224159 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706514cb-0c7e-470a-9129-710dc279e0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:37.224430 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706514cb-0c7e-470a-9129-710dc279e0a1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:37.241239 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706514cb-0c7e-470a-9129-710dc279e0a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:37.254014 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-706514cb-0c7e-470a-9129-710dc279e0a1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 01:13:37.255593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 139/287] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:13:37 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:37.262040 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cead40e-e4ce-4780-8eac-71bf1dfd3f69 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:37.272151 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cead40e-e4ce-4780-8eac-71bf1dfd3f69 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:37.285423 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055a7b1-d4fd-4a56-a06f-7f7f4f4b88c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:37.286341 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055a7b1-d4fd-4a56-a06f-7f7f4f4b88c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:37.286633 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055a7b1-d4fd-4a56-a06f-7f7f4f4b88c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:37.286922 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055a7b1-d4fd-4a56-a06f-7f7f4f4b88c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:37.287697 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055a7b1-d4fd-4a56-a06f-7f7f4f4b88c6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:37.288009 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055a7b1-d4fd-4a56-a06f-7f7f4f4b88c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:37.289701 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055a7b1-d4fd-4a56-a06f-7f7f4f4b88c6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:37.301480 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 149/288] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:37 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:37.307660 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706514cb-0c7e-470a-9129-710dc279e0a1 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:37.321021 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706514cb-0c7e-470a-9129-710dc279e0a1 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:37.329455 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efd55b-a951-458c-a752-df1a6eac6093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:37.330625 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd55b-a951-458c-a752-df1a6eac6093 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:37.330910 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd55b-a951-458c-a752-df1a6eac6093 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:37.331231 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd55b-a951-458c-a752-df1a6eac6093 admin admin] PATH_INFO: `/v3/groups/aac072deeef0435383b2e63ff22b9e4c` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:37.332404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efd55b-a951-458c-a752-df1a6eac6093 admin admin] RBAC: Authorizing `identity:get_group(group_id=aac072deeef0435383b2e63ff22b9e4c)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:37.333440 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING py.warnings [None req-b1efd55b-a951-458c-a752-df1a6eac6093 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:37.333440 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: warnings.warn(msg) Aug 27 01:13:37.333440 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: Aug 27 01:13:37.334702 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efd55b-a951-458c-a752-df1a6eac6093 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:37.336676 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 140/289] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 01:13:37 2021] GET /identity/v3/groups/aac072deeef0435383b2e63ff22b9e4c => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:37.344022 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055a7b1-d4fd-4a56-a06f-7f7f4f4b88c6 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:37.354174 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055a7b1-d4fd-4a56-a06f-7f7f4f4b88c6 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:37.363932 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85890d-55a7-428b-bac2-817ef555e704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:37.364808 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85890d-55a7-428b-bac2-817ef555e704 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:37.365119 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85890d-55a7-428b-bac2-817ef555e704 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:37.365402 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85890d-55a7-428b-bac2-817ef555e704 admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:37.366602 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85890d-55a7-428b-bac2-817ef555e704 admin admin] RBAC: Authorizing `identity:get_project(project_id=966196fad6e9467e93b5762e459a1d84)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:37.368661 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85890d-55a7-428b-bac2-817ef555e704 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:37.370548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 150/290] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:37 2021] GET /identity/v3/projects/966196fad6e9467e93b5762e459a1d84 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:37.377490 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efd55b-a951-458c-a752-df1a6eac6093 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:37.388130 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efd55b-a951-458c-a752-df1a6eac6093 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:37.404971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01835fbc-c5ac-4f80-94b7-3ddce9a2cf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:37.404971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01835fbc-c5ac-4f80-94b7-3ddce9a2cf64 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:37.404971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01835fbc-c5ac-4f80-94b7-3ddce9a2cf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:37.404971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01835fbc-c5ac-4f80-94b7-3ddce9a2cf64 admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84/groups/aac072deeef0435383b2e63ff22b9e4c/roles/5ce68b651d084d388f8528d29fab2530` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:37.406424 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01835fbc-c5ac-4f80-94b7-3ddce9a2cf64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=966196fad6e9467e93b5762e459a1d84, group_id=aac072deeef0435383b2e63ff22b9e4c, role_id=5ce68b651d084d388f8528d29fab2530)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:37.409318 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01835fbc-c5ac-4f80-94b7-3ddce9a2cf64 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:37.485420 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd354d-3cd9-4e96-b67d-c4701022e31d None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:37.485958 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd354d-3cd9-4e96-b67d-c4701022e31d None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:37.485958 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd354d-3cd9-4e96-b67d-c4701022e31d None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:37.487868 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 151/291] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:37.494763 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb58a77-3302-4d8f-8e5a-c51e1de8f07a None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:37.495054 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb58a77-3302-4d8f-8e5a-c51e1de8f07a None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:37.495412 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb58a77-3302-4d8f-8e5a-c51e1de8f07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:37.497319 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 141/292] 10.222.0.25 () {58 vars in 1464 bytes} [Fri Aug 27 01:13:37 2021] PUT /identity/v3/projects/966196fad6e9467e93b5762e459a1d84/groups/aac072deeef0435383b2e63ff22b9e4c/roles/5ce68b651d084d388f8528d29fab2530 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:13:37.517504 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-9fb58a77-3302-4d8f-8e5a-c51e1de8f07a None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:37.518731 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-9fb58a77-3302-4d8f-8e5a-c51e1de8f07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:37.599832 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 152/293] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:37.646945 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01835fbc-c5ac-4f80-94b7-3ddce9a2cf64 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:37.662342 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01835fbc-c5ac-4f80-94b7-3ddce9a2cf64 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:37.674152 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b48fa-0f77-4c87-9679-db7290a5ab16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:37.674994 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b48fa-0f77-4c87-9679-db7290a5ab16 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:37.675279 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b48fa-0f77-4c87-9679-db7290a5ab16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:37.675555 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b48fa-0f77-4c87-9679-db7290a5ab16 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:37.694211 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b48fa-0f77-4c87-9679-db7290a5ab16 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:37.702522 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-001b48fa-0f77-4c87-9679-db7290a5ab16 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 01:13:37.704131 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 142/294] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:37 2021] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:37.711340 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb58a77-3302-4d8f-8e5a-c51e1de8f07a None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:37.720670 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb58a77-3302-4d8f-8e5a-c51e1de8f07a None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:37.730144 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b621c65-c7bd-4632-8446-80d81c82e017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:37.730812 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b621c65-c7bd-4632-8446-80d81c82e017 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:37.731088 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b621c65-c7bd-4632-8446-80d81c82e017 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:37.731410 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b621c65-c7bd-4632-8446-80d81c82e017 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:37.732106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b621c65-c7bd-4632-8446-80d81c82e017 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:37.733051 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b621c65-c7bd-4632-8446-80d81c82e017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:37.735481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b621c65-c7bd-4632-8446-80d81c82e017 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:37.749995 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 153/295] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 01:13:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:37.757912 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b48fa-0f77-4c87-9679-db7290a5ab16 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:37.778134 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b48fa-0f77-4c87-9679-db7290a5ab16 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:37.785470 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7d24e-c6a6-4f91-954e-0b99e5d9125a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:37.786580 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7d24e-c6a6-4f91-954e-0b99e5d9125a admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:37.787032 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7d24e-c6a6-4f91-954e-0b99e5d9125a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:37.787472 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7d24e-c6a6-4f91-954e-0b99e5d9125a admin admin] PATH_INFO: `/v3/groups/aac072deeef0435383b2e63ff22b9e4c` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:37.789396 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7d24e-c6a6-4f91-954e-0b99e5d9125a admin admin] RBAC: Authorizing `identity:get_group(group_id=aac072deeef0435383b2e63ff22b9e4c)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:37.791469 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7d24e-c6a6-4f91-954e-0b99e5d9125a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:37.794451 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 143/296] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 01:13:37 2021] GET /identity/v3/groups/aac072deeef0435383b2e63ff22b9e4c => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:37.801412 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b621c65-c7bd-4632-8446-80d81c82e017 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:37.812125 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b621c65-c7bd-4632-8446-80d81c82e017 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:37.816806 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1ce82-63c6-4251-afb8-727be6486f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:37.817876 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1ce82-63c6-4251-afb8-727be6486f02 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:37.818355 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1ce82-63c6-4251-afb8-727be6486f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:37.818810 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1ce82-63c6-4251-afb8-727be6486f02 admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:37.820146 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1ce82-63c6-4251-afb8-727be6486f02 admin admin] RBAC: Authorizing `identity:get_project(project_id=2094d4b288d94b69a3989eda8c1f1660)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:37.822478 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1ce82-63c6-4251-afb8-727be6486f02 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:37.824339 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 154/297] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:37 2021] GET /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:37.832143 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7d24e-c6a6-4f91-954e-0b99e5d9125a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:37.842918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7d24e-c6a6-4f91-954e-0b99e5d9125a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:37.849944 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c48ea-a360-4127-8b34-3050880b3fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:37.851029 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c48ea-a360-4127-8b34-3050880b3fef admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:37.851499 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c48ea-a360-4127-8b34-3050880b3fef admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:37.852017 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c48ea-a360-4127-8b34-3050880b3fef admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660/groups/aac072deeef0435383b2e63ff22b9e4c/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:37.854178 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c48ea-a360-4127-8b34-3050880b3fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2094d4b288d94b69a3989eda8c1f1660, group_id=aac072deeef0435383b2e63ff22b9e4c, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:37.857010 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c48ea-a360-4127-8b34-3050880b3fef admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:37.948342 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 144/298] 10.222.0.25 () {58 vars in 1464 bytes} [Fri Aug 27 01:13:37 2021] PUT /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660/groups/aac072deeef0435383b2e63ff22b9e4c/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:13:38.161851 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c70b8-b5e8-412b-8f9e-e59f371cbdee None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:38.162429 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c70b8-b5e8-412b-8f9e-e59f371cbdee None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:38.162876 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c70b8-b5e8-412b-8f9e-e59f371cbdee None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:38.165130 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 155/299] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:38.171556 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37bf4e-93ca-4bce-88dd-b484028e3d3b None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:38.172448 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37bf4e-93ca-4bce-88dd-b484028e3d3b None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:38.172970 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37bf4e-93ca-4bce-88dd-b484028e3d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:38.200648 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-bf37bf4e-93ca-4bce-88dd-b484028e3d3b None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:38.202303 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-bf37bf4e-93ca-4bce-88dd-b484028e3d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:38.378122 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 145/300] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:38.426541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c70b8-b5e8-412b-8f9e-e59f371cbdee None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:38.441802 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c70b8-b5e8-412b-8f9e-e59f371cbdee None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:38.449616 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92417c-2948-4e6e-8a3b-72ccf94de65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:38.450718 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92417c-2948-4e6e-8a3b-72ccf94de65a admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:38.451770 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92417c-2948-4e6e-8a3b-72ccf94de65a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:38.452256 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92417c-2948-4e6e-8a3b-72ccf94de65a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:38.463760 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92417c-2948-4e6e-8a3b-72ccf94de65a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:38.474288 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-8e92417c-2948-4e6e-8a3b-72ccf94de65a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 01:13:38.476131 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 156/301] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:13:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:38.482278 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37bf4e-93ca-4bce-88dd-b484028e3d3b None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:38.491545 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37bf4e-93ca-4bce-88dd-b484028e3d3b None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:38.501036 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc396d1e-7fb5-41e0-a4d9-bdbbf1b87840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:38.501713 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc396d1e-7fb5-41e0-a4d9-bdbbf1b87840 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:38.501990 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc396d1e-7fb5-41e0-a4d9-bdbbf1b87840 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:38.502262 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc396d1e-7fb5-41e0-a4d9-bdbbf1b87840 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:38.503063 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc396d1e-7fb5-41e0-a4d9-bdbbf1b87840 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:38.503373 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc396d1e-7fb5-41e0-a4d9-bdbbf1b87840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:38.504968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc396d1e-7fb5-41e0-a4d9-bdbbf1b87840 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:38.516435 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 146/302] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:38.520274 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92417c-2948-4e6e-8a3b-72ccf94de65a admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:38.539565 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92417c-2948-4e6e-8a3b-72ccf94de65a admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:38.544583 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df60c53-2644-43fd-9ff1-447b1ce79106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:38.546311 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df60c53-2644-43fd-9ff1-447b1ce79106 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:38.546798 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df60c53-2644-43fd-9ff1-447b1ce79106 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:38.547375 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df60c53-2644-43fd-9ff1-447b1ce79106 admin admin] PATH_INFO: `/v3/groups/aac072deeef0435383b2e63ff22b9e4c` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:38.548783 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df60c53-2644-43fd-9ff1-447b1ce79106 admin admin] RBAC: Authorizing `identity:get_group(group_id=aac072deeef0435383b2e63ff22b9e4c)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:38.551095 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df60c53-2644-43fd-9ff1-447b1ce79106 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:38.553575 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 157/303] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 01:13:38 2021] GET /identity/v3/groups/aac072deeef0435383b2e63ff22b9e4c => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:38.559606 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc396d1e-7fb5-41e0-a4d9-bdbbf1b87840 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:38.574646 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc396d1e-7fb5-41e0-a4d9-bdbbf1b87840 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:38.580918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1023f-1478-4196-a029-82cbd80f1313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:38.581832 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1023f-1478-4196-a029-82cbd80f1313 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:38.582114 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1023f-1478-4196-a029-82cbd80f1313 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:38.582387 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1023f-1478-4196-a029-82cbd80f1313 admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:38.589914 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1023f-1478-4196-a029-82cbd80f1313 admin admin] RBAC: Authorizing `identity:get_project(project_id=2094d4b288d94b69a3989eda8c1f1660)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:38.593603 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1023f-1478-4196-a029-82cbd80f1313 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:38.597005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 147/304] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:38 2021] GET /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:38.603644 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df60c53-2644-43fd-9ff1-447b1ce79106 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:38.616844 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df60c53-2644-43fd-9ff1-447b1ce79106 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:38.626467 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04112d-ab01-45e0-b149-b83c0e95ba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:38.627694 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04112d-ab01-45e0-b149-b83c0e95ba9c admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:38.628180 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04112d-ab01-45e0-b149-b83c0e95ba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:38.628752 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04112d-ab01-45e0-b149-b83c0e95ba9c admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660/groups/aac072deeef0435383b2e63ff22b9e4c/roles/5ce68b651d084d388f8528d29fab2530` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:38.631229 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04112d-ab01-45e0-b149-b83c0e95ba9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2094d4b288d94b69a3989eda8c1f1660, group_id=aac072deeef0435383b2e63ff22b9e4c, role_id=5ce68b651d084d388f8528d29fab2530)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:38.638340 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04112d-ab01-45e0-b149-b83c0e95ba9c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:38.662108 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c268ec-812e-4793-90e8-b23dfb52c4a1 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:38.662391 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c268ec-812e-4793-90e8-b23dfb52c4a1 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:38.668930 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c268ec-812e-4793-90e8-b23dfb52c4a1 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:38.668930 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 148/305] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:13:38.670551 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19319e22-f0cc-4b54-bcb6-19d56f94c2e6 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:38.670889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19319e22-f0cc-4b54-bcb6-19d56f94c2e6 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:38.671169 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19319e22-f0cc-4b54-bcb6-19d56f94c2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:38.695234 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-19319e22-f0cc-4b54-bcb6-19d56f94c2e6 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:38.696546 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-19319e22-f0cc-4b54-bcb6-19d56f94c2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:38.708164 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 149/306] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:38.733057 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19319e22-f0cc-4b54-bcb6-19d56f94c2e6 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:38.743024 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19319e22-f0cc-4b54-bcb6-19d56f94c2e6 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:38.751932 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700fa1a-3552-419a-8fc6-c3b829d289ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:38.752980 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700fa1a-3552-419a-8fc6-c3b829d289ed admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:38.753361 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700fa1a-3552-419a-8fc6-c3b829d289ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:38.753703 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700fa1a-3552-419a-8fc6-c3b829d289ed admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:38.765808 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700fa1a-3552-419a-8fc6-c3b829d289ed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:38.769035 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 158/307] 10.222.0.25 () {58 vars in 1464 bytes} [Fri Aug 27 01:13:38 2021] PUT /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660/groups/aac072deeef0435383b2e63ff22b9e4c/roles/5ce68b651d084d388f8528d29fab2530 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:13:38.773480 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-5700fa1a-3552-419a-8fc6-c3b829d289ed admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:13:38.775066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 150/308] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:13:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:13:38.782641 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04112d-ab01-45e0-b149-b83c0e95ba9c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:38.851357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04112d-ab01-45e0-b149-b83c0e95ba9c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:38.855829 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37cd3d-02bd-4eca-93c7-b9b97c3ba091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:38.856490 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37cd3d-02bd-4eca-93c7-b9b97c3ba091 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:38.856768 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37cd3d-02bd-4eca-93c7-b9b97c3ba091 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:38.857063 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37cd3d-02bd-4eca-93c7-b9b97c3ba091 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:38.858203 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37cd3d-02bd-4eca-93c7-b9b97c3ba091 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:38.858513 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37cd3d-02bd-4eca-93c7-b9b97c3ba091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:38.860275 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37cd3d-02bd-4eca-93c7-b9b97c3ba091 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:38.869628 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 159/309] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:38.876802 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700fa1a-3552-419a-8fc6-c3b829d289ed admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:38.887944 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700fa1a-3552-419a-8fc6-c3b829d289ed admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:38.893123 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61180497-1e1d-4a01-af64-6e04a8435344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:38.894022 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61180497-1e1d-4a01-af64-6e04a8435344 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:38.894303 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61180497-1e1d-4a01-af64-6e04a8435344 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:38.894575 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61180497-1e1d-4a01-af64-6e04a8435344 admin admin] PATH_INFO: `/v3/groups/df8c8e75c6a047369e9c77d7949a3a5e` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:38.895844 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61180497-1e1d-4a01-af64-6e04a8435344 admin admin] RBAC: Authorizing `identity:get_group(group_id=df8c8e75c6a047369e9c77d7949a3a5e)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:38.897812 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61180497-1e1d-4a01-af64-6e04a8435344 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:38.904953 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 151/310] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 01:13:38 2021] GET /identity/v3/groups/df8c8e75c6a047369e9c77d7949a3a5e => generated 229 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:38.906856 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37cd3d-02bd-4eca-93c7-b9b97c3ba091 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:38.917081 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37cd3d-02bd-4eca-93c7-b9b97c3ba091 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:38.922289 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a259e5-1c85-4177-8dc2-eb583be34b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:38.923177 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a259e5-1c85-4177-8dc2-eb583be34b05 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:38.923537 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a259e5-1c85-4177-8dc2-eb583be34b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:38.923816 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a259e5-1c85-4177-8dc2-eb583be34b05 admin admin] PATH_INFO: `/v3/projects/e9904079a3e94900bd545a99cd672ff0` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:38.925157 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a259e5-1c85-4177-8dc2-eb583be34b05 admin admin] RBAC: Authorizing `identity:get_project(project_id=e9904079a3e94900bd545a99cd672ff0)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:38.927215 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a259e5-1c85-4177-8dc2-eb583be34b05 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:38.932997 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 160/311] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:38 2021] GET /identity/v3/projects/e9904079a3e94900bd545a99cd672ff0 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:38.936638 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61180497-1e1d-4a01-af64-6e04a8435344 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:38.946886 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61180497-1e1d-4a01-af64-6e04a8435344 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:38.951902 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1ed3f-161e-4db2-9eef-6c18a60a49bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:38.952816 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1ed3f-161e-4db2-9eef-6c18a60a49bd admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:38.953172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1ed3f-161e-4db2-9eef-6c18a60a49bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:38.953537 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1ed3f-161e-4db2-9eef-6c18a60a49bd admin admin] PATH_INFO: `/v3/projects/e9904079a3e94900bd545a99cd672ff0/groups/df8c8e75c6a047369e9c77d7949a3a5e/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:38.955960 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1ed3f-161e-4db2-9eef-6c18a60a49bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9904079a3e94900bd545a99cd672ff0, group_id=df8c8e75c6a047369e9c77d7949a3a5e, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:38.958827 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1ed3f-161e-4db2-9eef-6c18a60a49bd admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:39.028656 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 152/312] 10.222.0.25 () {58 vars in 1464 bytes} [Fri Aug 27 01:13:38 2021] PUT /identity/v3/projects/e9904079a3e94900bd545a99cd672ff0/groups/df8c8e75c6a047369e9c77d7949a3a5e/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:13:39.587051 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729662aa-abaf-4060-990c-12d111f88207 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:39.587740 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729662aa-abaf-4060-990c-12d111f88207 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:39.587740 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729662aa-abaf-4060-990c-12d111f88207 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:39.589638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 161/313] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:39.596756 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d099aa6-f204-4552-9d08-ca3fca604462 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:39.597504 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d099aa6-f204-4552-9d08-ca3fca604462 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:39.597504 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d099aa6-f204-4552-9d08-ca3fca604462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:39.621708 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-7d099aa6-f204-4552-9d08-ca3fca604462 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:39.623449 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-7d099aa6-f204-4552-9d08-ca3fca604462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:39.682740 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 153/314] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:39.707316 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729662aa-abaf-4060-990c-12d111f88207 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:39.720111 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729662aa-abaf-4060-990c-12d111f88207 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:39.724702 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022d052-efea-46d9-b1d2-be59b7cdec90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:39.725515 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022d052-efea-46d9-b1d2-be59b7cdec90 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:39.725791 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022d052-efea-46d9-b1d2-be59b7cdec90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:39.726062 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022d052-efea-46d9-b1d2-be59b7cdec90 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:39.746899 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022d052-efea-46d9-b1d2-be59b7cdec90 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:39.753641 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-0022d052-efea-46d9-b1d2-be59b7cdec90 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 01:13:39.754828 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 162/315] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:39.761419 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d099aa6-f204-4552-9d08-ca3fca604462 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:39.771696 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d099aa6-f204-4552-9d08-ca3fca604462 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:39.776543 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe19eac-fb3d-4b3d-97c1-4ef61e4c2e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:39.777235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe19eac-fb3d-4b3d-97c1-4ef61e4c2e39 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:39.777567 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe19eac-fb3d-4b3d-97c1-4ef61e4c2e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:39.777892 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe19eac-fb3d-4b3d-97c1-4ef61e4c2e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:39.778667 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe19eac-fb3d-4b3d-97c1-4ef61e4c2e39 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:39.778976 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe19eac-fb3d-4b3d-97c1-4ef61e4c2e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:39.780948 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe19eac-fb3d-4b3d-97c1-4ef61e4c2e39 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:39.792593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 154/316] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 01:13:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:39.797033 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022d052-efea-46d9-b1d2-be59b7cdec90 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:39.807516 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022d052-efea-46d9-b1d2-be59b7cdec90 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:39.812030 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4722413-d34c-4417-ae9b-d8064da2d7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:39.812655 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4722413-d34c-4417-ae9b-d8064da2d7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:39.813026 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4722413-d34c-4417-ae9b-d8064da2d7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:39.813299 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4722413-d34c-4417-ae9b-d8064da2d7c1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:39.821580 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4722413-d34c-4417-ae9b-d8064da2d7c1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:39.823365 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4722413-d34c-4417-ae9b-d8064da2d7c1 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:39.836741 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 163/317] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:39.854226 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe19eac-fb3d-4b3d-97c1-4ef61e4c2e39 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:39.864711 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe19eac-fb3d-4b3d-97c1-4ef61e4c2e39 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:39.872898 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f365f5-63aa-43c1-b0dd-ef91e50f81a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:39.873710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f365f5-63aa-43c1-b0dd-ef91e50f81a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:39.873987 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f365f5-63aa-43c1-b0dd-ef91e50f81a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:39.874258 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f365f5-63aa-43c1-b0dd-ef91e50f81a7 admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:39.881553 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f365f5-63aa-43c1-b0dd-ef91e50f81a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=966196fad6e9467e93b5762e459a1d84)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:39.883687 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f365f5-63aa-43c1-b0dd-ef91e50f81a7 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:39.885525 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 155/318] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:39 2021] GET /identity/v3/projects/966196fad6e9467e93b5762e459a1d84 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:39.892655 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4722413-d34c-4417-ae9b-d8064da2d7c1 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:39.901565 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4722413-d34c-4417-ae9b-d8064da2d7c1 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:39.906283 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fea73-0b5c-47ea-a232-5af5dc705f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:39.907120 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fea73-0b5c-47ea-a232-5af5dc705f9c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:39.907466 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fea73-0b5c-47ea-a232-5af5dc705f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:39.907740 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fea73-0b5c-47ea-a232-5af5dc705f9c admin admin] PATH_INFO: `/v3/groups/aac072deeef0435383b2e63ff22b9e4c` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:39.908975 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fea73-0b5c-47ea-a232-5af5dc705f9c admin admin] RBAC: Authorizing `identity:get_group(group_id=aac072deeef0435383b2e63ff22b9e4c)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:39.910920 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fea73-0b5c-47ea-a232-5af5dc705f9c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:39.916954 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 164/319] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 01:13:39 2021] GET /identity/v3/groups/aac072deeef0435383b2e63ff22b9e4c => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:39.919546 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f365f5-63aa-43c1-b0dd-ef91e50f81a7 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:39.930426 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f365f5-63aa-43c1-b0dd-ef91e50f81a7 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:39.935117 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bfd9e-6393-461b-9f35-b98fc2d47f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:39.935913 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bfd9e-6393-461b-9f35-b98fc2d47f87 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:39.936395 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bfd9e-6393-461b-9f35-b98fc2d47f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:39.936672 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bfd9e-6393-461b-9f35-b98fc2d47f87 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:39.937576 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bfd9e-6393-461b-9f35-b98fc2d47f87 admin admin] RBAC: Adding query filter params (group.id=aac072deeef0435383b2e63ff22b9e4c, role.id=681adf4aa4c14ac7a9ce4ac1c261cf93, scope.project.id=966196fad6e9467e93b5762e459a1d84) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:39.937887 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bfd9e-6393-461b-9f35-b98fc2d47f87 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:39.939877 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bfd9e-6393-461b-9f35-b98fc2d47f87 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:39.953001 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 156/320] 10.222.0.25 () {56 vars in 1398 bytes} [Fri Aug 27 01:13:39 2021] GET /identity/v3/role_assignments?group.id=aac072deeef0435383b2e63ff22b9e4c&scope.project.id=966196fad6e9467e93b5762e459a1d84&role.id=681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:40.361459 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8e0a3-8b3d-4c3b-9856-7ec9b70e8b5e None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:40.361795 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8e0a3-8b3d-4c3b-9856-7ec9b70e8b5e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:40.361979 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8e0a3-8b3d-4c3b-9856-7ec9b70e8b5e None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:40.364005 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 165/321] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:40.369771 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae664b4-4aae-4473-a6d6-e0c7f5a06354 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:40.370061 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae664b4-4aae-4473-a6d6-e0c7f5a06354 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:40.370344 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae664b4-4aae-4473-a6d6-e0c7f5a06354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:40.396404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-7ae664b4-4aae-4473-a6d6-e0c7f5a06354 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:40.397655 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-7ae664b4-4aae-4473-a6d6-e0c7f5a06354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:40.407399 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 157/322] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:40.434136 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8e0a3-8b3d-4c3b-9856-7ec9b70e8b5e None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:40.448430 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8e0a3-8b3d-4c3b-9856-7ec9b70e8b5e None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:40.452913 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2b510-7954-4f5c-80fb-14fa31ed5144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:40.453707 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2b510-7954-4f5c-80fb-14fa31ed5144 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:40.454041 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2b510-7954-4f5c-80fb-14fa31ed5144 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:40.454351 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2b510-7954-4f5c-80fb-14fa31ed5144 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:40.467576 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2b510-7954-4f5c-80fb-14fa31ed5144 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:40.474694 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-94d2b510-7954-4f5c-80fb-14fa31ed5144 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 01:13:40.476062 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 166/323] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:13:40 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:40.485643 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae664b4-4aae-4473-a6d6-e0c7f5a06354 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:40.495401 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae664b4-4aae-4473-a6d6-e0c7f5a06354 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:40.503961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3c774-db8e-4780-9eca-42b7839e2945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:40.504679 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3c774-db8e-4780-9eca-42b7839e2945 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:40.504984 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3c774-db8e-4780-9eca-42b7839e2945 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:40.505255 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3c774-db8e-4780-9eca-42b7839e2945 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:40.505998 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3c774-db8e-4780-9eca-42b7839e2945 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:40.506295 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3c774-db8e-4780-9eca-42b7839e2945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:40.507873 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3c774-db8e-4780-9eca-42b7839e2945 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:40.519580 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 158/324] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:40.523452 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2b510-7954-4f5c-80fb-14fa31ed5144 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:40.534579 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2b510-7954-4f5c-80fb-14fa31ed5144 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:40.542532 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f598fbc-9bd8-4583-9801-ef5b421022e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:40.543175 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f598fbc-9bd8-4583-9801-ef5b421022e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:40.543456 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f598fbc-9bd8-4583-9801-ef5b421022e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:40.543729 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f598fbc-9bd8-4583-9801-ef5b421022e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:40.556967 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f598fbc-9bd8-4583-9801-ef5b421022e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:40.558791 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f598fbc-9bd8-4583-9801-ef5b421022e4 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:40.570163 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 167/325] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:13:40.577659 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3c774-db8e-4780-9eca-42b7839e2945 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:40.587875 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3c774-db8e-4780-9eca-42b7839e2945 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:40.595667 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca18c6a-8e88-42fe-9ca9-56a7cfd4fdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:40.596532 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca18c6a-8e88-42fe-9ca9-56a7cfd4fdfd admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:40.596811 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca18c6a-8e88-42fe-9ca9-56a7cfd4fdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:40.597420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca18c6a-8e88-42fe-9ca9-56a7cfd4fdfd admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:40.598465 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca18c6a-8e88-42fe-9ca9-56a7cfd4fdfd admin admin] RBAC: Authorizing `identity:get_project(project_id=966196fad6e9467e93b5762e459a1d84)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:40.600520 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca18c6a-8e88-42fe-9ca9-56a7cfd4fdfd admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:40.602517 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 159/326] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:40 2021] GET /identity/v3/projects/966196fad6e9467e93b5762e459a1d84 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:40.609275 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f598fbc-9bd8-4583-9801-ef5b421022e4 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:40.621316 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f598fbc-9bd8-4583-9801-ef5b421022e4 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:40.625859 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73646bb8-0437-494b-9707-9f9605bd1176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:40.626697 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73646bb8-0437-494b-9707-9f9605bd1176 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:40.626969 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73646bb8-0437-494b-9707-9f9605bd1176 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:40.627239 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73646bb8-0437-494b-9707-9f9605bd1176 admin admin] PATH_INFO: `/v3/groups/aac072deeef0435383b2e63ff22b9e4c` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:40.629213 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73646bb8-0437-494b-9707-9f9605bd1176 admin admin] RBAC: Authorizing `identity:get_group(group_id=aac072deeef0435383b2e63ff22b9e4c)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:40.631151 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73646bb8-0437-494b-9707-9f9605bd1176 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:40.633855 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 168/327] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 01:13:40 2021] GET /identity/v3/groups/aac072deeef0435383b2e63ff22b9e4c => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:40.640636 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca18c6a-8e88-42fe-9ca9-56a7cfd4fdfd admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:40.653916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca18c6a-8e88-42fe-9ca9-56a7cfd4fdfd admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:40.661541 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4becbad-ad76-4bc4-8e7c-cef0868b718b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:40.662224 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4becbad-ad76-4bc4-8e7c-cef0868b718b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:40.662505 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4becbad-ad76-4bc4-8e7c-cef0868b718b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:40.662784 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4becbad-ad76-4bc4-8e7c-cef0868b718b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:40.663640 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4becbad-ad76-4bc4-8e7c-cef0868b718b admin admin] RBAC: Adding query filter params (group.id=aac072deeef0435383b2e63ff22b9e4c, role.id=5ce68b651d084d388f8528d29fab2530, scope.project.id=966196fad6e9467e93b5762e459a1d84) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:40.663959 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4becbad-ad76-4bc4-8e7c-cef0868b718b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:40.665910 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4becbad-ad76-4bc4-8e7c-cef0868b718b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:40.673831 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 160/328] 10.222.0.25 () {56 vars in 1398 bytes} [Fri Aug 27 01:13:40 2021] GET /identity/v3/role_assignments?group.id=aac072deeef0435383b2e63ff22b9e4c&scope.project.id=966196fad6e9467e93b5762e459a1d84&role.id=5ce68b651d084d388f8528d29fab2530 => generated 611 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:40.759888 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68f4ff-680f-4d7d-ad18-925bf8ea1dc4 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:40.760221 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68f4ff-680f-4d7d-ad18-925bf8ea1dc4 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:40.760425 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68f4ff-680f-4d7d-ad18-925bf8ea1dc4 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:40.762357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 169/329] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:40.770173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b4fc-dd9f-4878-906c-0a33e2e365c0 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:40.770473 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b4fc-dd9f-4878-906c-0a33e2e365c0 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:40.770734 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b4fc-dd9f-4878-906c-0a33e2e365c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:40.793245 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-2bf5b4fc-dd9f-4878-906c-0a33e2e365c0 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:40.794466 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-2bf5b4fc-dd9f-4878-906c-0a33e2e365c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:40.806389 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 161/330] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:40.833112 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68f4ff-680f-4d7d-ad18-925bf8ea1dc4 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:40.853149 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68f4ff-680f-4d7d-ad18-925bf8ea1dc4 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:40.859371 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6f337-2263-4907-84b4-bda876abb5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:40.860169 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6f337-2263-4907-84b4-bda876abb5cb admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:40.860501 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6f337-2263-4907-84b4-bda876abb5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:40.860950 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6f337-2263-4907-84b4-bda876abb5cb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:40.872947 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec6f337-2263-4907-84b4-bda876abb5cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:40.880064 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-6ec6f337-2263-4907-84b4-bda876abb5cb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 01:13:40.881664 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 170/331] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:40 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:40.887944 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5b4fc-dd9f-4878-906c-0a33e2e365c0 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:40.900204 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5b4fc-dd9f-4878-906c-0a33e2e365c0 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:40.907415 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc01e1-8ed6-4f14-8b2a-9ac62dba27be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:40.908094 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc01e1-8ed6-4f14-8b2a-9ac62dba27be admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:40.908434 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc01e1-8ed6-4f14-8b2a-9ac62dba27be admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:40.908716 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc01e1-8ed6-4f14-8b2a-9ac62dba27be admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:40.909522 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc01e1-8ed6-4f14-8b2a-9ac62dba27be admin admin] RBAC: Adding query filter params (name=member) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:40.909830 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc01e1-8ed6-4f14-8b2a-9ac62dba27be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:40.911419 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc01e1-8ed6-4f14-8b2a-9ac62dba27be admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:40.921925 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 162/332] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 01:13:40 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:40.928049 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6f337-2263-4907-84b4-bda876abb5cb admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:40.938716 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6f337-2263-4907-84b4-bda876abb5cb admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:40.944810 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48715cf-29b3-4dcd-b513-c07c20420641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:40.945492 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48715cf-29b3-4dcd-b513-c07c20420641 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:40.945776 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48715cf-29b3-4dcd-b513-c07c20420641 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:40.946052 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48715cf-29b3-4dcd-b513-c07c20420641 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:40.957399 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48715cf-29b3-4dcd-b513-c07c20420641 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:40.959174 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48715cf-29b3-4dcd-b513-c07c20420641 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:40.968913 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 171/333] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:40.975076 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc01e1-8ed6-4f14-8b2a-9ac62dba27be admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:40.985127 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc01e1-8ed6-4f14-8b2a-9ac62dba27be admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:40.992066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742dd5dd-1691-4a20-bdcf-436ad91d3d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:40.993055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dd5dd-1691-4a20-bdcf-436ad91d3d12 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:40.993389 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dd5dd-1691-4a20-bdcf-436ad91d3d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:40.993663 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dd5dd-1691-4a20-bdcf-436ad91d3d12 admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:40.994849 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742dd5dd-1691-4a20-bdcf-436ad91d3d12 admin admin] RBAC: Authorizing `identity:get_project(project_id=2094d4b288d94b69a3989eda8c1f1660)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:40.997053 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742dd5dd-1691-4a20-bdcf-436ad91d3d12 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:40.999418 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 163/334] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:40 2021] GET /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:41.005658 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48715cf-29b3-4dcd-b513-c07c20420641 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:41.015655 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48715cf-29b3-4dcd-b513-c07c20420641 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:41.020194 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a9d9e-383a-4193-acf1-91cf3af41517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:41.021318 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a9d9e-383a-4193-acf1-91cf3af41517 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:41.021602 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a9d9e-383a-4193-acf1-91cf3af41517 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:41.021877 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a9d9e-383a-4193-acf1-91cf3af41517 admin admin] PATH_INFO: `/v3/groups/aac072deeef0435383b2e63ff22b9e4c` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:41.023929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a9d9e-383a-4193-acf1-91cf3af41517 admin admin] RBAC: Authorizing `identity:get_group(group_id=aac072deeef0435383b2e63ff22b9e4c)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:41.025883 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a9d9e-383a-4193-acf1-91cf3af41517 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:41.027499 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 172/335] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 01:13:41 2021] GET /identity/v3/groups/aac072deeef0435383b2e63ff22b9e4c => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:41.034959 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742dd5dd-1691-4a20-bdcf-436ad91d3d12 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:41.045806 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742dd5dd-1691-4a20-bdcf-436ad91d3d12 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:41.050547 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651def4-fb2b-4a44-b35b-3de82361725f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:41.051201 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651def4-fb2b-4a44-b35b-3de82361725f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:41.051483 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651def4-fb2b-4a44-b35b-3de82361725f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:41.051754 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651def4-fb2b-4a44-b35b-3de82361725f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:41.052574 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651def4-fb2b-4a44-b35b-3de82361725f admin admin] RBAC: Adding query filter params (group.id=aac072deeef0435383b2e63ff22b9e4c, role.id=681adf4aa4c14ac7a9ce4ac1c261cf93, scope.project.id=2094d4b288d94b69a3989eda8c1f1660) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:41.052914 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651def4-fb2b-4a44-b35b-3de82361725f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:41.054750 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651def4-fb2b-4a44-b35b-3de82361725f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:41.061470 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 164/336] 10.222.0.25 () {56 vars in 1398 bytes} [Fri Aug 27 01:13:41 2021] GET /identity/v3/role_assignments?group.id=aac072deeef0435383b2e63ff22b9e4c&scope.project.id=2094d4b288d94b69a3989eda8c1f1660&role.id=681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:41.475045 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50c441-b503-41e8-b22c-d5f1fb744f1d None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:41.475326 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50c441-b503-41e8-b22c-d5f1fb744f1d None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:41.475600 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50c441-b503-41e8-b22c-d5f1fb744f1d None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:41.477398 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 173/337] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:41.483442 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc4d86-4235-4619-89bc-3f63128834f0 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:41.483731 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc4d86-4235-4619-89bc-3f63128834f0 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:41.484011 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc4d86-4235-4619-89bc-3f63128834f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:41.501252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-39bc4d86-4235-4619-89bc-3f63128834f0 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:41.502429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-39bc4d86-4235-4619-89bc-3f63128834f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:41.509877 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 165/338] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:41.534552 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50c441-b503-41e8-b22c-d5f1fb744f1d None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:41.547155 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50c441-b503-41e8-b22c-d5f1fb744f1d None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:41.551335 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbcb30-c267-4bbd-887a-25d0bf5e71cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:41.552124 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbcb30-c267-4bbd-887a-25d0bf5e71cc admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:41.552407 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbcb30-c267-4bbd-887a-25d0bf5e71cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:41.552682 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbcb30-c267-4bbd-887a-25d0bf5e71cc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:41.563468 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbcb30-c267-4bbd-887a-25d0bf5e71cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:41.570638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-21dbcb30-c267-4bbd-887a-25d0bf5e71cc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 01:13:41.571797 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 174/339] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:13:41 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:41.578080 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc4d86-4235-4619-89bc-3f63128834f0 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:41.587159 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc4d86-4235-4619-89bc-3f63128834f0 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:41.591488 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de3026-94d3-41bd-adff-7b5b4d9078a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:41.592207 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de3026-94d3-41bd-adff-7b5b4d9078a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:41.592549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de3026-94d3-41bd-adff-7b5b4d9078a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:41.592914 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de3026-94d3-41bd-adff-7b5b4d9078a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:41.593714 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de3026-94d3-41bd-adff-7b5b4d9078a4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:41.594081 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de3026-94d3-41bd-adff-7b5b4d9078a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:41.595735 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de3026-94d3-41bd-adff-7b5b4d9078a4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:41.603989 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 166/340] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:41 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:41.610638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbcb30-c267-4bbd-887a-25d0bf5e71cc admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:41.620203 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbcb30-c267-4bbd-887a-25d0bf5e71cc admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:41.625179 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5d706-3591-4f34-b59d-3e2b2a2d2c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:41.625813 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5d706-3591-4f34-b59d-3e2b2a2d2c90 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:41.626098 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5d706-3591-4f34-b59d-3e2b2a2d2c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:41.626379 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5d706-3591-4f34-b59d-3e2b2a2d2c90 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:41.634472 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5d706-3591-4f34-b59d-3e2b2a2d2c90 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:41.636202 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5d706-3591-4f34-b59d-3e2b2a2d2c90 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:41.645126 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 175/341] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:41.651396 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de3026-94d3-41bd-adff-7b5b4d9078a4 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:41.661431 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de3026-94d3-41bd-adff-7b5b4d9078a4 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:41.665926 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa5e63-16dd-4aff-a383-8a4fecdadd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:41.666858 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa5e63-16dd-4aff-a383-8a4fecdadd4e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:41.667082 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa5e63-16dd-4aff-a383-8a4fecdadd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:41.667352 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa5e63-16dd-4aff-a383-8a4fecdadd4e admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:41.668608 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa5e63-16dd-4aff-a383-8a4fecdadd4e admin admin] RBAC: Authorizing `identity:get_project(project_id=2094d4b288d94b69a3989eda8c1f1660)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:41.671642 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa5e63-16dd-4aff-a383-8a4fecdadd4e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:41.673491 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 167/342] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:41 2021] GET /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:41.680289 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5d706-3591-4f34-b59d-3e2b2a2d2c90 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:41.690074 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5d706-3591-4f34-b59d-3e2b2a2d2c90 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:41.694617 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999681a-1937-4e0f-9f0f-f43abb7d4459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:41.695494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999681a-1937-4e0f-9f0f-f43abb7d4459 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:41.695776 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999681a-1937-4e0f-9f0f-f43abb7d4459 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:41.698856 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999681a-1937-4e0f-9f0f-f43abb7d4459 admin admin] PATH_INFO: `/v3/groups/aac072deeef0435383b2e63ff22b9e4c` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:41.698856 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999681a-1937-4e0f-9f0f-f43abb7d4459 admin admin] RBAC: Authorizing `identity:get_group(group_id=aac072deeef0435383b2e63ff22b9e4c)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:41.699354 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999681a-1937-4e0f-9f0f-f43abb7d4459 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:41.701137 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 176/343] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 01:13:41 2021] GET /identity/v3/groups/aac072deeef0435383b2e63ff22b9e4c => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:41.708119 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa5e63-16dd-4aff-a383-8a4fecdadd4e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:41.719099 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa5e63-16dd-4aff-a383-8a4fecdadd4e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:41.723635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c8293-2f69-40e6-b1b0-7b88f6e1a077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:41.724282 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c8293-2f69-40e6-b1b0-7b88f6e1a077 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:41.724568 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c8293-2f69-40e6-b1b0-7b88f6e1a077 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:41.724868 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c8293-2f69-40e6-b1b0-7b88f6e1a077 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:41.725697 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c8293-2f69-40e6-b1b0-7b88f6e1a077 admin admin] RBAC: Adding query filter params (group.id=aac072deeef0435383b2e63ff22b9e4c, role.id=5ce68b651d084d388f8528d29fab2530, scope.project.id=2094d4b288d94b69a3989eda8c1f1660) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:41.726021 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c8293-2f69-40e6-b1b0-7b88f6e1a077 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:41.727847 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c8293-2f69-40e6-b1b0-7b88f6e1a077 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:41.734813 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 168/344] 10.222.0.25 () {56 vars in 1398 bytes} [Fri Aug 27 01:13:41 2021] GET /identity/v3/role_assignments?group.id=aac072deeef0435383b2e63ff22b9e4c&scope.project.id=2094d4b288d94b69a3989eda8c1f1660&role.id=5ce68b651d084d388f8528d29fab2530 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:41.751334 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c2c70-34c9-4b9e-a307-4495f733373d None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:41.751702 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c2c70-34c9-4b9e-a307-4495f733373d None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:41.752046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c2c70-34c9-4b9e-a307-4495f733373d None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:41.754197 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 177/345] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:41.760786 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f2529-89d9-45f8-812a-460723175f59 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:41.761113 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f2529-89d9-45f8-812a-460723175f59 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:41.761392 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f2529-89d9-45f8-812a-460723175f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:41.780435 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-1f2f2529-89d9-45f8-812a-460723175f59 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:41.781691 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1f2f2529-89d9-45f8-812a-460723175f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:41.789487 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 169/346] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:41.814878 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c2c70-34c9-4b9e-a307-4495f733373d None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:41.827440 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c2c70-34c9-4b9e-a307-4495f733373d None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:41.831977 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a617541-923d-4c5f-a897-503d20ab8ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:41.832778 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a617541-923d-4c5f-a897-503d20ab8ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:41.833105 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a617541-923d-4c5f-a897-503d20ab8ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:41.833378 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a617541-923d-4c5f-a897-503d20ab8ff0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:41.845062 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a617541-923d-4c5f-a897-503d20ab8ff0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:41.851950 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-7a617541-923d-4c5f-a897-503d20ab8ff0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:13:41.853366 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 178/347] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:13:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:41.860856 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f2529-89d9-45f8-812a-460723175f59 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:41.870680 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f2529-89d9-45f8-812a-460723175f59 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:41.875205 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88209c1b-5301-41b6-8f2b-659b0eac8c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:41.875981 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88209c1b-5301-41b6-8f2b-659b0eac8c7f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:41.876330 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88209c1b-5301-41b6-8f2b-659b0eac8c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:41.876670 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88209c1b-5301-41b6-8f2b-659b0eac8c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:41.877533 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88209c1b-5301-41b6-8f2b-659b0eac8c7f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:41.877903 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88209c1b-5301-41b6-8f2b-659b0eac8c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:41.879517 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88209c1b-5301-41b6-8f2b-659b0eac8c7f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:41.888486 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 170/348] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:41.894775 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a617541-923d-4c5f-a897-503d20ab8ff0 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:41.905325 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a617541-923d-4c5f-a897-503d20ab8ff0 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:41.909779 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752788f-a340-4b6a-8558-e46a76d0add7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:41.910486 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752788f-a340-4b6a-8558-e46a76d0add7 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:41.910776 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752788f-a340-4b6a-8558-e46a76d0add7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:41.911061 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752788f-a340-4b6a-8558-e46a76d0add7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:41.920687 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752788f-a340-4b6a-8558-e46a76d0add7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:41.922515 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752788f-a340-4b6a-8558-e46a76d0add7 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:41.931336 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 179/349] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:41.937884 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88209c1b-5301-41b6-8f2b-659b0eac8c7f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:41.947336 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88209c1b-5301-41b6-8f2b-659b0eac8c7f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:41.951791 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807036a-a355-43bd-8418-ef0506420b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:41.952633 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807036a-a355-43bd-8418-ef0506420b68 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:41.952939 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807036a-a355-43bd-8418-ef0506420b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:41.953211 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807036a-a355-43bd-8418-ef0506420b68 admin admin] PATH_INFO: `/v3/projects/e9904079a3e94900bd545a99cd672ff0` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:41.954386 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807036a-a355-43bd-8418-ef0506420b68 admin admin] RBAC: Authorizing `identity:get_project(project_id=e9904079a3e94900bd545a99cd672ff0)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:41.956416 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807036a-a355-43bd-8418-ef0506420b68 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:41.958106 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 171/350] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:13:41 2021] GET /identity/v3/projects/e9904079a3e94900bd545a99cd672ff0 => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:41.964611 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752788f-a340-4b6a-8558-e46a76d0add7 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:41.974290 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752788f-a340-4b6a-8558-e46a76d0add7 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:41.978665 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264ae81-e8aa-44ed-b5b9-5c03441764a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:41.979507 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264ae81-e8aa-44ed-b5b9-5c03441764a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:41.979788 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264ae81-e8aa-44ed-b5b9-5c03441764a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:41.980060 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264ae81-e8aa-44ed-b5b9-5c03441764a9 admin admin] PATH_INFO: `/v3/groups/df8c8e75c6a047369e9c77d7949a3a5e` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:41.981283 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264ae81-e8aa-44ed-b5b9-5c03441764a9 admin admin] RBAC: Authorizing `identity:get_group(group_id=df8c8e75c6a047369e9c77d7949a3a5e)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:41.983281 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264ae81-e8aa-44ed-b5b9-5c03441764a9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:41.984898 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 180/351] 10.222.0.25 () {56 vars in 1202 bytes} [Fri Aug 27 01:13:41 2021] GET /identity/v3/groups/df8c8e75c6a047369e9c77d7949a3a5e => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:41.991629 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807036a-a355-43bd-8418-ef0506420b68 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:42.002144 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807036a-a355-43bd-8418-ef0506420b68 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:42.006741 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32631024-8cac-4e67-a447-159d297a0dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:42.007395 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32631024-8cac-4e67-a447-159d297a0dcf admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:42.007674 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32631024-8cac-4e67-a447-159d297a0dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:42.007945 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32631024-8cac-4e67-a447-159d297a0dcf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:42.008767 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32631024-8cac-4e67-a447-159d297a0dcf admin admin] RBAC: Adding query filter params (group.id=df8c8e75c6a047369e9c77d7949a3a5e, role.id=faadc5010ffb447ba5280e491c2ea2f5, scope.project.id=e9904079a3e94900bd545a99cd672ff0) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:42.009109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32631024-8cac-4e67-a447-159d297a0dcf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:42.010944 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32631024-8cac-4e67-a447-159d297a0dcf admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:42.017329 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 172/352] 10.222.0.25 () {56 vars in 1398 bytes} [Fri Aug 27 01:13:41 2021] GET /identity/v3/role_assignments?group.id=df8c8e75c6a047369e9c77d7949a3a5e&scope.project.id=e9904079a3e94900bd545a99cd672ff0&role.id=faadc5010ffb447ba5280e491c2ea2f5 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:44.613690 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f8333-0904-4536-ad8b-458b39eada75 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:44.614253 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f8333-0904-4536-ad8b-458b39eada75 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:44.614253 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f8333-0904-4536-ad8b-458b39eada75 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:44.616005 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 181/353] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:44.622034 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d581d-800a-4e50-9c40-5689ad249aef None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:44.622465 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d581d-800a-4e50-9c40-5689ad249aef None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:44.623135 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d581d-800a-4e50-9c40-5689ad249aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:44.646183 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-010d581d-800a-4e50-9c40-5689ad249aef None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:44.647728 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-010d581d-800a-4e50-9c40-5689ad249aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:44.659619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 173/354] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:44.697912 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f8333-0904-4536-ad8b-458b39eada75 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:44.718495 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f8333-0904-4536-ad8b-458b39eada75 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:44.723066 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426c4bb-a15d-4b70-ab2b-17422bc1d751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:44.723853 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426c4bb-a15d-4b70-ab2b-17422bc1d751 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:44.724133 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426c4bb-a15d-4b70-ab2b-17422bc1d751 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:44.724408 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426c4bb-a15d-4b70-ab2b-17422bc1d751 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:44.739309 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426c4bb-a15d-4b70-ab2b-17422bc1d751 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:44.741177 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426c4bb-a15d-4b70-ab2b-17422bc1d751 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:44.769768 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-a426c4bb-a15d-4b70-ab2b-17422bc1d751 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:44.771091 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 182/355] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:44.777652 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d581d-800a-4e50-9c40-5689ad249aef None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:44.794076 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d581d-800a-4e50-9c40-5689ad249aef None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:44.810946 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea280f-1248-4dbe-b368-dc04453afd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:44.812073 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea280f-1248-4dbe-b368-dc04453afd64 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:44.812587 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea280f-1248-4dbe-b368-dc04453afd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:44.813107 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea280f-1248-4dbe-b368-dc04453afd64 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:44.814089 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea280f-1248-4dbe-b368-dc04453afd64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:44.814626 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea280f-1248-4dbe-b368-dc04453afd64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:44.816604 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea280f-1248-4dbe-b368-dc04453afd64 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:44.832246 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 174/356] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:44.838118 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426c4bb-a15d-4b70-ab2b-17422bc1d751 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:44.853338 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426c4bb-a15d-4b70-ab2b-17422bc1d751 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:44.861092 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581180a7-cab3-43f2-955c-ccfab627f442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:44.862062 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581180a7-cab3-43f2-955c-ccfab627f442 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:44.862555 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581180a7-cab3-43f2-955c-ccfab627f442 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:44.863033 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581180a7-cab3-43f2-955c-ccfab627f442 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:44.863955 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581180a7-cab3-43f2-955c-ccfab627f442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:44.866119 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581180a7-cab3-43f2-955c-ccfab627f442 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:44.901158 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4958b-dce7-461c-ab13-aee487fc19c0 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:44.901791 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4958b-dce7-461c-ab13-aee487fc19c0 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:44.902279 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4958b-dce7-461c-ab13-aee487fc19c0 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:44.904395 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 175/357] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:13:44.910734 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cd791-cacf-4da5-98bc-e00670b679fb None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:44.911287 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cd791-cacf-4da5-98bc-e00670b679fb None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:44.911777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cd791-cacf-4da5-98bc-e00670b679fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:44.933815 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-bf0cd791-cacf-4da5-98bc-e00670b679fb None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:44.935644 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-bf0cd791-cacf-4da5-98bc-e00670b679fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:44.947851 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 176/358] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:44.976466 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cd791-cacf-4da5-98bc-e00670b679fb None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:44.988071 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cd791-cacf-4da5-98bc-e00670b679fb None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:44.995380 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef254c9-90e5-4aa6-b776-12fa62b0b494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:44.996501 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef254c9-90e5-4aa6-b776-12fa62b0b494 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:44.997055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef254c9-90e5-4aa6-b776-12fa62b0b494 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:44.997663 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef254c9-90e5-4aa6-b776-12fa62b0b494 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:45.008490 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 183/359] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 01:13:44 2021] POST /identity/v3/users => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:13:45.018261 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef254c9-90e5-4aa6-b776-12fa62b0b494 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:45.020983 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef254c9-90e5-4aa6-b776-12fa62b0b494 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:45.039810 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-7ef254c9-90e5-4aa6-b776-12fa62b0b494 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:45.047073 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 177/360] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:13:45.049477 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581180a7-cab3-43f2-955c-ccfab627f442 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:45.063499 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581180a7-cab3-43f2-955c-ccfab627f442 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:45.070269 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c98699-c47b-4348-a9a6-3fce0aad1dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:45.071329 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c98699-c47b-4348-a9a6-3fce0aad1dae admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:45.071824 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c98699-c47b-4348-a9a6-3fce0aad1dae admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:45.072307 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c98699-c47b-4348-a9a6-3fce0aad1dae admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:45.073286 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c98699-c47b-4348-a9a6-3fce0aad1dae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:45.073813 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c98699-c47b-4348-a9a6-3fce0aad1dae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:45.075073 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING py.warnings [None req-55c98699-c47b-4348-a9a6-3fce0aad1dae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:45.075073 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: warnings.warn(msg) Aug 27 01:13:45.075073 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: Aug 27 01:13:45.076520 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c98699-c47b-4348-a9a6-3fce0aad1dae admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:45.104919 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 184/361] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:45.112628 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef254c9-90e5-4aa6-b776-12fa62b0b494 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:45.123865 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef254c9-90e5-4aa6-b776-12fa62b0b494 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:45.131077 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043488c-5574-413f-8c80-6955c4f5397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:45.132090 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043488c-5574-413f-8c80-6955c4f5397c admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:45.132571 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043488c-5574-413f-8c80-6955c4f5397c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:45.133077 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043488c-5574-413f-8c80-6955c4f5397c admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:45.134023 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043488c-5574-413f-8c80-6955c4f5397c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:45.136140 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043488c-5574-413f-8c80-6955c4f5397c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:45.172145 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9c6da-4d65-40d4-a3ab-d0966d48566b None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:45.172798 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9c6da-4d65-40d4-a3ab-d0966d48566b None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:45.173339 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9c6da-4d65-40d4-a3ab-d0966d48566b None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:45.175877 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 185/362] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:45 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:45.182944 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b8f63-a1c5-49ca-9654-dfce5cedb13e None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:45.185896 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b8f63-a1c5-49ca-9654-dfce5cedb13e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:45.185896 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b8f63-a1c5-49ca-9654-dfce5cedb13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:45.211857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f74b8f63-a1c5-49ca-9654-dfce5cedb13e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:45.214616 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f74b8f63-a1c5-49ca-9654-dfce5cedb13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:45.224428 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 186/363] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:45.239458 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 178/364] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 01:13:45 2021] POST /identity/v3/users => generated 248 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:13:45.289542 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b8f63-a1c5-49ca-9654-dfce5cedb13e None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:45.302657 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b8f63-a1c5-49ca-9654-dfce5cedb13e None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:45.308436 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3a9fb-15da-4600-a776-6ac2766c558c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:45.309676 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3a9fb-15da-4600-a776-6ac2766c558c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:45.311040 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3a9fb-15da-4600-a776-6ac2766c558c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:45.311524 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3a9fb-15da-4600-a776-6ac2766c558c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:45.326154 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3a9fb-15da-4600-a776-6ac2766c558c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:45.328403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3a9fb-15da-4600-a776-6ac2766c558c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:45.349887 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-8ef3a9fb-15da-4600-a776-6ac2766c558c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:45.353329 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 187/365] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:45.358444 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043488c-5574-413f-8c80-6955c4f5397c admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:45.369165 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043488c-5574-413f-8c80-6955c4f5397c admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:45.378409 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d47259-7f58-4c69-a02a-668c97e058d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:45.379510 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d47259-7f58-4c69-a02a-668c97e058d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:45.380056 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d47259-7f58-4c69-a02a-668c97e058d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:45.380530 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d47259-7f58-4c69-a02a-668c97e058d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:45.381573 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d47259-7f58-4c69-a02a-668c97e058d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:45.382109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d47259-7f58-4c69-a02a-668c97e058d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:45.384012 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d47259-7f58-4c69-a02a-668c97e058d3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:45.405426 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 179/366] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:45.411246 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3a9fb-15da-4600-a776-6ac2766c558c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:45.425136 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3a9fb-15da-4600-a776-6ac2766c558c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:45.433731 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27242d-0802-498d-989b-55f933adea50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:45.434484 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27242d-0802-498d-989b-55f933adea50 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:45.434767 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27242d-0802-498d-989b-55f933adea50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:45.435189 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27242d-0802-498d-989b-55f933adea50 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:45.436310 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27242d-0802-498d-989b-55f933adea50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:45.438395 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27242d-0802-498d-989b-55f933adea50 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:45.509462 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bc014-953e-44a3-89b4-e38de031203b None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:45.509750 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bc014-953e-44a3-89b4-e38de031203b None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:45.509941 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bc014-953e-44a3-89b4-e38de031203b None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:45.512075 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 180/367] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:13:45.518934 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fd52f-d97a-469a-9fd5-f73bf2118e43 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:45.519217 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fd52f-d97a-469a-9fd5-f73bf2118e43 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:45.519488 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fd52f-d97a-469a-9fd5-f73bf2118e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:45.528658 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 188/368] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 01:13:45 2021] POST /identity/v3/users => generated 248 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:13:45.543536 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-d26fd52f-d97a-469a-9fd5-f73bf2118e43 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:45.545461 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d26fd52f-d97a-469a-9fd5-f73bf2118e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:45.555356 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 181/369] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:45.584545 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27242d-0802-498d-989b-55f933adea50 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:45.598123 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27242d-0802-498d-989b-55f933adea50 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:45.605050 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199f601-416d-4663-8306-9869b4f3f8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:45.605868 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199f601-416d-4663-8306-9869b4f3f8da admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:45.606151 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199f601-416d-4663-8306-9869b4f3f8da admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:45.606429 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199f601-416d-4663-8306-9869b4f3f8da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:45.620444 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199f601-416d-4663-8306-9869b4f3f8da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:45.622370 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199f601-416d-4663-8306-9869b4f3f8da admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:45.642578 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-c199f601-416d-4663-8306-9869b4f3f8da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:45.643860 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 189/370] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:45.650424 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fd52f-d97a-469a-9fd5-f73bf2118e43 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:45.659695 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fd52f-d97a-469a-9fd5-f73bf2118e43 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:45.674008 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db8b1b-959a-4b73-9e54-b817a7886cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:45.674693 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db8b1b-959a-4b73-9e54-b817a7886cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:45.674979 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db8b1b-959a-4b73-9e54-b817a7886cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:45.675253 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db8b1b-959a-4b73-9e54-b817a7886cb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:45.675985 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db8b1b-959a-4b73-9e54-b817a7886cb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:45.676289 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db8b1b-959a-4b73-9e54-b817a7886cb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:45.677924 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db8b1b-959a-4b73-9e54-b817a7886cb3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:45.699172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 182/371] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:45.706372 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199f601-416d-4663-8306-9869b4f3f8da admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:45.723375 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199f601-416d-4663-8306-9869b4f3f8da admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:45.732765 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177defbe-9748-4d4e-b39f-6d3bcb277535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:45.734272 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177defbe-9748-4d4e-b39f-6d3bcb277535 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:45.734272 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177defbe-9748-4d4e-b39f-6d3bcb277535 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:45.734272 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177defbe-9748-4d4e-b39f-6d3bcb277535 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:45.742550 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177defbe-9748-4d4e-b39f-6d3bcb277535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:45.742550 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177defbe-9748-4d4e-b39f-6d3bcb277535 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:45.881213 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 190/372] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 01:13:45 2021] POST /identity/v3/users => generated 249 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:13:46.470609 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a22171-b6cc-4151-8705-08ad2620d3ca None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:46.470921 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a22171-b6cc-4151-8705-08ad2620d3ca None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:46.471162 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a22171-b6cc-4151-8705-08ad2620d3ca None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:46.473370 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 183/373] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:46.479265 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e844467-22b9-40b2-9af7-96c3c1db9034 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:46.479550 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e844467-22b9-40b2-9af7-96c3c1db9034 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:46.479830 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e844467-22b9-40b2-9af7-96c3c1db9034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:46.504283 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-5e844467-22b9-40b2-9af7-96c3c1db9034 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:46.505519 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-5e844467-22b9-40b2-9af7-96c3c1db9034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:46.518474 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 191/374] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:46.543522 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a22171-b6cc-4151-8705-08ad2620d3ca None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:46.559136 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a22171-b6cc-4151-8705-08ad2620d3ca None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:46.564487 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1704967-e331-475d-be68-bd5633b7054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:46.565241 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1704967-e331-475d-be68-bd5633b7054c admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:46.565520 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1704967-e331-475d-be68-bd5633b7054c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:46.565798 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1704967-e331-475d-be68-bd5633b7054c admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:46.566558 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1704967-e331-475d-be68-bd5633b7054c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:46.568155 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1704967-e331-475d-be68-bd5633b7054c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:46.612216 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.sql.core [None req-f1704967-e331-475d-be68-bd5633b7054c admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 27 01:13:46.612216 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 27 01:13:46.612216 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [parameters: {'id': 'a311684bf2844bbdae0a233eb48dfa4c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 27 01:13:46.612216 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73679) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 01:13:46.630741 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-f1704967-e331-475d-be68-bd5633b7054c admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 27 01:13:46.632175 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 184/375] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:13:46 2021] POST /identity/v3/roles => generated 144 bytes in 89 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:46.638936 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e844467-22b9-40b2-9af7-96c3c1db9034 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:46.648282 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e844467-22b9-40b2-9af7-96c3c1db9034 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:46.657558 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7822d0-feb7-4e51-a6cd-f91a7fd8c412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:46.658364 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7822d0-feb7-4e51-a6cd-f91a7fd8c412 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:46.658650 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7822d0-feb7-4e51-a6cd-f91a7fd8c412 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:46.658923 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7822d0-feb7-4e51-a6cd-f91a7fd8c412 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:46.677444 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7822d0-feb7-4e51-a6cd-f91a7fd8c412 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:46.682207 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-7b7822d0-feb7-4e51-a6cd-f91a7fd8c412 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 01:13:46.683564 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 192/376] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:13:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:46.691220 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1704967-e331-475d-be68-bd5633b7054c admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:46.703088 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1704967-e331-475d-be68-bd5633b7054c admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:46.711420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bb2f4-1aea-469e-87df-c1fc5726125c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:46.712101 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bb2f4-1aea-469e-87df-c1fc5726125c admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:46.712382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bb2f4-1aea-469e-87df-c1fc5726125c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:46.712655 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bb2f4-1aea-469e-87df-c1fc5726125c admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:46.713430 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bb2f4-1aea-469e-87df-c1fc5726125c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:46.713735 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bb2f4-1aea-469e-87df-c1fc5726125c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:46.715404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bb2f4-1aea-469e-87df-c1fc5726125c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:46.729872 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 185/377] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:47.842058 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdb15d-efc0-4b0c-b16e-8f944cba2b1e None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:47.842975 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdb15d-efc0-4b0c-b16e-8f944cba2b1e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:47.842975 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdb15d-efc0-4b0c-b16e-8f944cba2b1e None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:47.844819 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 193/378] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:47.851925 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634ff7a-e8ae-47e1-8a03-bf24f8a1e158 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:47.852572 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634ff7a-e8ae-47e1-8a03-bf24f8a1e158 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:47.852572 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634ff7a-e8ae-47e1-8a03-bf24f8a1e158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:47.877401 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-d634ff7a-e8ae-47e1-8a03-bf24f8a1e158 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:47.878791 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d634ff7a-e8ae-47e1-8a03-bf24f8a1e158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:47.888525 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 186/379] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:47.922348 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b19965-d4c0-4a9f-9e17-cc8c625e760d None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:47.922996 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b19965-d4c0-4a9f-9e17-cc8c625e760d None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:47.923474 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b19965-d4c0-4a9f-9e17-cc8c625e760d None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:47.925750 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 194/380] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:47.929811 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634ff7a-e8ae-47e1-8a03-bf24f8a1e158 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:47.931736 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa6c5f-f479-462c-857a-a9815de1026a None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:47.932235 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa6c5f-f479-462c-857a-a9815de1026a None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:47.932744 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa6c5f-f479-462c-857a-a9815de1026a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:47.942973 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634ff7a-e8ae-47e1-8a03-bf24f8a1e158 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:47.956988 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bcc1a-9f3d-4c82-9da3-3559362c02fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:47.958295 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bcc1a-9f3d-4c82-9da3-3559362c02fb admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:47.958783 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bcc1a-9f3d-4c82-9da3-3559362c02fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:47.959256 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bcc1a-9f3d-4c82-9da3-3559362c02fb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:47.969107 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-a1aa6c5f-f479-462c-857a-a9815de1026a None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:47.971024 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a1aa6c5f-f479-462c-857a-a9815de1026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:47.982052 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 195/381] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:47.985961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bcc1a-9f3d-4c82-9da3-3559362c02fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:47.994086 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-fe4bcc1a-9f3d-4c82-9da3-3559362c02fb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:13:47.996071 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 187/382] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:13:47 2021] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:48.003411 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa6c5f-f479-462c-857a-a9815de1026a None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.011126 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bcc1a-9f3d-4c82-9da3-3559362c02fb admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.016156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa6c5f-f479-462c-857a-a9815de1026a None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.027134 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7d19b-6eff-4008-8f65-7345690098d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.028151 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7d19b-6eff-4008-8f65-7345690098d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.029424 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7d19b-6eff-4008-8f65-7345690098d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.029917 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7d19b-6eff-4008-8f65-7345690098d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.032147 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7d19b-6eff-4008-8f65-7345690098d1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:48.032952 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7d19b-6eff-4008-8f65-7345690098d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.035567 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bcc1a-9f3d-4c82-9da3-3559362c02fb admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.037703 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7d19b-6eff-4008-8f65-7345690098d1 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.049906 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cf5d1-ab2a-452a-a64f-2f3fe661cdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.051426 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cf5d1-ab2a-452a-a64f-2f3fe661cdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.059343 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cf5d1-ab2a-452a-a64f-2f3fe661cdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.060538 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cf5d1-ab2a-452a-a64f-2f3fe661cdc3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.062543 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 196/383] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:48.069087 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7d19b-6eff-4008-8f65-7345690098d1 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.084625 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7d19b-6eff-4008-8f65-7345690098d1 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.089141 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cf5d1-ab2a-452a-a64f-2f3fe661cdc3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:48.090957 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d9577-0db2-456a-97c7-6cf2dffe0a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.093298 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d9577-0db2-456a-97c7-6cf2dffe0a1c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.093820 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d9577-0db2-456a-97c7-6cf2dffe0a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.094294 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d9577-0db2-456a-97c7-6cf2dffe0a1c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.100999 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-580cf5d1-ab2a-452a-a64f-2f3fe661cdc3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:13:48.103429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 188/384] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:48.109618 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cf5d1-ab2a-452a-a64f-2f3fe661cdc3 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.116547 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d9577-0db2-456a-97c7-6cf2dffe0a1c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.119126 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d9577-0db2-456a-97c7-6cf2dffe0a1c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.136698 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cf5d1-ab2a-452a-a64f-2f3fe661cdc3 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.157032 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99073bf2-3bf1-4fd8-a238-b4d2b4e79311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.157722 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99073bf2-3bf1-4fd8-a238-b4d2b4e79311 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.158008 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99073bf2-3bf1-4fd8-a238-b4d2b4e79311 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.158285 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99073bf2-3bf1-4fd8-a238-b4d2b4e79311 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.159037 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99073bf2-3bf1-4fd8-a238-b4d2b4e79311 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:48.159343 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99073bf2-3bf1-4fd8-a238-b4d2b4e79311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.161066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99073bf2-3bf1-4fd8-a238-b4d2b4e79311 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.164168 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-ab0d9577-0db2-456a-97c7-6cf2dffe0a1c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:48.176810 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 197/385] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:13:48.178171 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d9577-0db2-456a-97c7-6cf2dffe0a1c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.189835 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 189/386] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:48.196293 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99073bf2-3bf1-4fd8-a238-b4d2b4e79311 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.207781 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d9577-0db2-456a-97c7-6cf2dffe0a1c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.212550 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99073bf2-3bf1-4fd8-a238-b4d2b4e79311 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.218769 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7aa0f-37a3-4ed2-8740-142949aa980e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.219464 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7aa0f-37a3-4ed2-8740-142949aa980e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.219725 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7aa0f-37a3-4ed2-8740-142949aa980e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.220004 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7aa0f-37a3-4ed2-8740-142949aa980e admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.220731 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7aa0f-37a3-4ed2-8740-142949aa980e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:48.221080 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7aa0f-37a3-4ed2-8740-142949aa980e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.222687 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7aa0f-37a3-4ed2-8740-142949aa980e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.227968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a5517-4e16-4749-bae9-1ffa0aee7aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.229246 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a5517-4e16-4749-bae9-1ffa0aee7aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.229733 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a5517-4e16-4749-bae9-1ffa0aee7aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.230093 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a5517-4e16-4749-bae9-1ffa0aee7aa8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.244957 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 198/387] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:48.255205 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7aa0f-37a3-4ed2-8740-142949aa980e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.255628 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a5517-4e16-4749-bae9-1ffa0aee7aa8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.257709 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a5517-4e16-4749-bae9-1ffa0aee7aa8 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.266433 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7aa0f-37a3-4ed2-8740-142949aa980e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.272521 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391fc24-7218-4a84-b672-7a101f9c4d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.274928 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391fc24-7218-4a84-b672-7a101f9c4d41 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.275419 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391fc24-7218-4a84-b672-7a101f9c4d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.276011 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391fc24-7218-4a84-b672-7a101f9c4d41 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.289527 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391fc24-7218-4a84-b672-7a101f9c4d41 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.291696 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-ae2a5517-4e16-4749-bae9-1ffa0aee7aa8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:48.293856 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391fc24-7218-4a84-b672-7a101f9c4d41 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.302201 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 190/388] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:48.307203 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a5517-4e16-4749-bae9-1ffa0aee7aa8 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.314450 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-4391fc24-7218-4a84-b672-7a101f9c4d41 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 01:13:48.315943 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 199/389] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/users/glance => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:13:48.326951 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a5517-4e16-4749-bae9-1ffa0aee7aa8 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.328560 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391fc24-7218-4a84-b672-7a101f9c4d41 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.338422 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12126e-db4b-4fbc-bd2e-cee9172e206f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.339095 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12126e-db4b-4fbc-bd2e-cee9172e206f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.339372 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12126e-db4b-4fbc-bd2e-cee9172e206f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.339643 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12126e-db4b-4fbc-bd2e-cee9172e206f admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.340364 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12126e-db4b-4fbc-bd2e-cee9172e206f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:48.340665 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12126e-db4b-4fbc-bd2e-cee9172e206f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.342942 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12126e-db4b-4fbc-bd2e-cee9172e206f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.343372 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391fc24-7218-4a84-b672-7a101f9c4d41 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.347952 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ff5e5-e33e-4b00-90ba-55fc1590d113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.348638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ff5e5-e33e-4b00-90ba-55fc1590d113 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.348959 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ff5e5-e33e-4b00-90ba-55fc1590d113 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.349236 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ff5e5-e33e-4b00-90ba-55fc1590d113 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.350068 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ff5e5-e33e-4b00-90ba-55fc1590d113 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:48.350374 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ff5e5-e33e-4b00-90ba-55fc1590d113 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.351375 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING py.warnings [None req-610ff5e5-e33e-4b00-90ba-55fc1590d113 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:48.351375 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: warnings.warn(msg) Aug 27 01:13:48.351375 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: Aug 27 01:13:48.352521 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ff5e5-e33e-4b00-90ba-55fc1590d113 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.358582 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 191/390] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:48.358582 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ebdf1-2f84-402b-8e79-4a666a162736 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.358582 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ebdf1-2f84-402b-8e79-4a666a162736 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.360863 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ebdf1-2f84-402b-8e79-4a666a162736 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.361123 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 192/391] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:48.367259 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777bd61-c7ae-4158-94f1-920bf5d557cf None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.367655 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777bd61-c7ae-4158-94f1-920bf5d557cf None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.368038 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777bd61-c7ae-4158-94f1-920bf5d557cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.386913 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-8777bd61-c7ae-4158-94f1-920bf5d557cf None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:48.388512 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8777bd61-c7ae-4158-94f1-920bf5d557cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:48.402492 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 193/392] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:48.403579 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777bd61-c7ae-4158-94f1-920bf5d557cf None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.409513 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 200/393] 10.222.0.25 () {56 vars in 1159 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:48.414871 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ff5e5-e33e-4b00-90ba-55fc1590d113 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.420920 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777bd61-c7ae-4158-94f1-920bf5d557cf None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.425625 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040cfc9-c544-48d5-90d9-64e4c8728d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.426708 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040cfc9-c544-48d5-90d9-64e4c8728d5f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.427134 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040cfc9-c544-48d5-90d9-64e4c8728d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.427538 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040cfc9-c544-48d5-90d9-64e4c8728d5f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.433743 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ff5e5-e33e-4b00-90ba-55fc1590d113 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.439025 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040cfc9-c544-48d5-90d9-64e4c8728d5f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.442826 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040cfc9-c544-48d5-90d9-64e4c8728d5f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.445068 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eaaeac-55dd-4031-bcb0-0df5e6c1787e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.447061 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eaaeac-55dd-4031-bcb0-0df5e6c1787e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.448276 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eaaeac-55dd-4031-bcb0-0df5e6c1787e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.448710 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eaaeac-55dd-4031-bcb0-0df5e6c1787e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.458362 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eaaeac-55dd-4031-bcb0-0df5e6c1787e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.460260 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eaaeac-55dd-4031-bcb0-0df5e6c1787e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.461526 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-2040cfc9-c544-48d5-90d9-64e4c8728d5f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 01:13:48.462904 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 194/394] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/users/nova => generated 82 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:48.468856 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040cfc9-c544-48d5-90d9-64e4c8728d5f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.476920 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 201/395] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:48.477684 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040cfc9-c544-48d5-90d9-64e4c8728d5f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.478121 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eaaeac-55dd-4031-bcb0-0df5e6c1787e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.482684 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786544d6-6758-497c-b63c-922b14f78eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.483594 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786544d6-6758-497c-b63c-922b14f78eee admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.483975 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786544d6-6758-497c-b63c-922b14f78eee admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.484346 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786544d6-6758-497c-b63c-922b14f78eee admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.489131 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eaaeac-55dd-4031-bcb0-0df5e6c1787e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.494795 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198f7e3-b036-42d9-a17b-ddbb85fab0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.495917 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786544d6-6758-497c-b63c-922b14f78eee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:48.496208 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198f7e3-b036-42d9-a17b-ddbb85fab0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.496628 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198f7e3-b036-42d9-a17b-ddbb85fab0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.497086 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198f7e3-b036-42d9-a17b-ddbb85fab0c3 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.498232 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198f7e3-b036-42d9-a17b-ddbb85fab0c3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:48.498698 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198f7e3-b036-42d9-a17b-ddbb85fab0c3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.500872 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198f7e3-b036-42d9-a17b-ddbb85fab0c3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.503660 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-786544d6-6758-497c-b63c-922b14f78eee admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:13:48.505043 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 195/396] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:48.505916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786544d6-6758-497c-b63c-922b14f78eee admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.522083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 202/397] 10.222.0.25 () {56 vars in 1155 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:48.527808 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786544d6-6758-497c-b63c-922b14f78eee admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.527808 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea22c8-6ec0-4774-a0d7-bed186959bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.528284 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198f7e3-b036-42d9-a17b-ddbb85fab0c3 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.529093 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea22c8-6ec0-4774-a0d7-bed186959bfe admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.529492 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea22c8-6ec0-4774-a0d7-bed186959bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.529868 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea22c8-6ec0-4774-a0d7-bed186959bfe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.541026 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea22c8-6ec0-4774-a0d7-bed186959bfe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.541213 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198f7e3-b036-42d9-a17b-ddbb85fab0c3 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.543495 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea22c8-6ec0-4774-a0d7-bed186959bfe admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.547862 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57c253-4605-4bdb-8bc9-200472884f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.548767 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57c253-4605-4bdb-8bc9-200472884f7b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.549244 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57c253-4605-4bdb-8bc9-200472884f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.549724 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57c253-4605-4bdb-8bc9-200472884f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.550619 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57c253-4605-4bdb-8bc9-200472884f7b admin admin] RBAC: Adding query filter params (name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:48.551137 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57c253-4605-4bdb-8bc9-200472884f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.553452 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57c253-4605-4bdb-8bc9-200472884f7b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.563609 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-86ea22c8-6ec0-4774-a0d7-bed186959bfe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:48.564053 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 203/398] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:48.565173 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57c253-4605-4bdb-8bc9-200472884f7b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.570273 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 196/399] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:48.571192 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea22c8-6ec0-4774-a0d7-bed186959bfe admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.580981 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57c253-4605-4bdb-8bc9-200472884f7b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.581488 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea22c8-6ec0-4774-a0d7-bed186959bfe admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.586088 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970e23f-c1ce-4cb6-a0ec-54e9a20368be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.587034 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b22f8-a6f1-4a4d-9c6b-d9803f5c2291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.587161 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970e23f-c1ce-4cb6-a0ec-54e9a20368be admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.587560 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970e23f-c1ce-4cb6-a0ec-54e9a20368be admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.587972 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970e23f-c1ce-4cb6-a0ec-54e9a20368be admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.588271 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b22f8-a6f1-4a4d-9c6b-d9803f5c2291 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.588647 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b22f8-a6f1-4a4d-9c6b-d9803f5c2291 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.589047 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b22f8-a6f1-4a4d-9c6b-d9803f5c2291 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.599291 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970e23f-c1ce-4cb6-a0ec-54e9a20368be admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.599950 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b22f8-a6f1-4a4d-9c6b-d9803f5c2291 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.601456 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970e23f-c1ce-4cb6-a0ec-54e9a20368be admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.602080 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b22f8-a6f1-4a4d-9c6b-d9803f5c2291 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.613491 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 204/400] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:48.614501 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970e23f-c1ce-4cb6-a0ec-54e9a20368be admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.624634 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970e23f-c1ce-4cb6-a0ec-54e9a20368be admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.627304 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-f24b22f8-a6f1-4a4d-9c6b-d9803f5c2291 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:48.632905 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 197/401] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:48.634736 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cc911-604f-4d4c-ab45-2b12cb6bc360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.635317 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b22f8-a6f1-4a4d-9c6b-d9803f5c2291 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.635890 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc911-604f-4d4c-ab45-2b12cb6bc360 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.636743 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc911-604f-4d4c-ab45-2b12cb6bc360 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.637532 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc911-604f-4d4c-ab45-2b12cb6bc360 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.640554 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cc911-604f-4d4c-ab45-2b12cb6bc360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:48.641067 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cc911-604f-4d4c-ab45-2b12cb6bc360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.642918 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cc911-604f-4d4c-ab45-2b12cb6bc360 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.651227 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b22f8-a6f1-4a4d-9c6b-d9803f5c2291 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.658420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f49f5a-0303-4fb5-a7a2-fc98917cae63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.659273 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 205/402] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:48.659679 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f49f5a-0303-4fb5-a7a2-fc98917cae63 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.660154 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f49f5a-0303-4fb5-a7a2-fc98917cae63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.660436 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cc911-604f-4d4c-ab45-2b12cb6bc360 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.660795 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f49f5a-0303-4fb5-a7a2-fc98917cae63 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.671161 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cc911-604f-4d4c-ab45-2b12cb6bc360 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.674657 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f49f5a-0303-4fb5-a7a2-fc98917cae63 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.675898 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434beb15-40dc-40c0-8d2a-c45f611534b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.676682 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434beb15-40dc-40c0-8d2a-c45f611534b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.677091 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434beb15-40dc-40c0-8d2a-c45f611534b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.677306 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f49f5a-0303-4fb5-a7a2-fc98917cae63 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.677571 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434beb15-40dc-40c0-8d2a-c45f611534b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.678587 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434beb15-40dc-40c0-8d2a-c45f611534b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:48.679002 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434beb15-40dc-40c0-8d2a-c45f611534b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.680779 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434beb15-40dc-40c0-8d2a-c45f611534b0 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.699165 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 206/403] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:48.700232 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434beb15-40dc-40c0-8d2a-c45f611534b0 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.706652 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-18f49f5a-0303-4fb5-a7a2-fc98917cae63 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:48.708213 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 198/404] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:48.709093 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f49f5a-0303-4fb5-a7a2-fc98917cae63 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.711925 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434beb15-40dc-40c0-8d2a-c45f611534b0 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.719639 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79cb8d-2cdc-49c3-9b94-2d0f5cbf5d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.720782 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79cb8d-2cdc-49c3-9b94-2d0f5cbf5d34 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.721584 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79cb8d-2cdc-49c3-9b94-2d0f5cbf5d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.722089 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79cb8d-2cdc-49c3-9b94-2d0f5cbf5d34 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.726492 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f49f5a-0303-4fb5-a7a2-fc98917cae63 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.731074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f339843-070b-49f9-bca4-5e55bcb3dbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.732383 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79cb8d-2cdc-49c3-9b94-2d0f5cbf5d34 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.732511 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f339843-070b-49f9-bca4-5e55bcb3dbfe admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.732704 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f339843-070b-49f9-bca4-5e55bcb3dbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.732988 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f339843-070b-49f9-bca4-5e55bcb3dbfe admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.736202 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79cb8d-2cdc-49c3-9b94-2d0f5cbf5d34 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.740767 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f339843-070b-49f9-bca4-5e55bcb3dbfe admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.743568 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f339843-070b-49f9-bca4-5e55bcb3dbfe admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.752994 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-0b79cb8d-2cdc-49c3-9b94-2d0f5cbf5d34 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:13:48.754322 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 207/405] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:48.755158 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79cb8d-2cdc-49c3-9b94-2d0f5cbf5d34 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.757654 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-2f339843-070b-49f9-bca4-5e55bcb3dbfe admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 01:13:48.759085 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 199/406] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/users/cinder => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:48.760642 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f339843-070b-49f9-bca4-5e55bcb3dbfe admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.770701 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f339843-070b-49f9-bca4-5e55bcb3dbfe admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.771786 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79cb8d-2cdc-49c3-9b94-2d0f5cbf5d34 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.775788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fe1df-a020-4487-8eb0-b741d6c58da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.776731 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fe1df-a020-4487-8eb0-b741d6c58da4 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.777095 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e159a8-b6a5-4a1f-8293-95bcaf40f4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.777523 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fe1df-a020-4487-8eb0-b741d6c58da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.777875 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e159a8-b6a5-4a1f-8293-95bcaf40f4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.778160 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fe1df-a020-4487-8eb0-b741d6c58da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.778271 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e159a8-b6a5-4a1f-8293-95bcaf40f4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.778638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e159a8-b6a5-4a1f-8293-95bcaf40f4b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.779527 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fe1df-a020-4487-8eb0-b741d6c58da4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:48.779633 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e159a8-b6a5-4a1f-8293-95bcaf40f4b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:48.779968 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e159a8-b6a5-4a1f-8293-95bcaf40f4b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.780296 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fe1df-a020-4487-8eb0-b741d6c58da4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.781492 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING py.warnings [None req-e22fe1df-a020-4487-8eb0-b741d6c58da4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:48.781492 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: warnings.warn(msg) Aug 27 01:13:48.781492 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: Aug 27 01:13:48.781958 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e159a8-b6a5-4a1f-8293-95bcaf40f4b2 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.783270 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fe1df-a020-4487-8eb0-b741d6c58da4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.800893 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 208/407] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:48.800893 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e159a8-b6a5-4a1f-8293-95bcaf40f4b2 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.807422 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e159a8-b6a5-4a1f-8293-95bcaf40f4b2 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.807862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 200/408] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:48.809072 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fe1df-a020-4487-8eb0-b741d6c58da4 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.812245 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee170bf-d6d6-4ef7-b20a-50903746816b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.813075 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee170bf-d6d6-4ef7-b20a-50903746816b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.813453 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee170bf-d6d6-4ef7-b20a-50903746816b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.813856 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee170bf-d6d6-4ef7-b20a-50903746816b admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.814840 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee170bf-d6d6-4ef7-b20a-50903746816b admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:48.815240 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee170bf-d6d6-4ef7-b20a-50903746816b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.818315 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee170bf-d6d6-4ef7-b20a-50903746816b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.820348 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fe1df-a020-4487-8eb0-b741d6c58da4 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.825234 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c595a8-9558-4e7b-a0eb-d4177a2d3534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.826229 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c595a8-9558-4e7b-a0eb-d4177a2d3534 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.826679 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c595a8-9558-4e7b-a0eb-d4177a2d3534 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.827101 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c595a8-9558-4e7b-a0eb-d4177a2d3534 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.835144 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c595a8-9558-4e7b-a0eb-d4177a2d3534 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.837304 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c595a8-9558-4e7b-a0eb-d4177a2d3534 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.839883 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 209/409] 10.222.0.25 () {56 vars in 1159 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:48.842016 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee170bf-d6d6-4ef7-b20a-50903746816b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.856552 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-79c595a8-9558-4e7b-a0eb-d4177a2d3534 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:13:48.858713 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 201/410] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:48.864610 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c595a8-9558-4e7b-a0eb-d4177a2d3534 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.864727 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee170bf-d6d6-4ef7-b20a-50903746816b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.872142 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c545620-4f9a-4492-b7ac-e7828f977c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.873512 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c545620-4f9a-4492-b7ac-e7828f977c72 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.873892 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c545620-4f9a-4492-b7ac-e7828f977c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.874309 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c545620-4f9a-4492-b7ac-e7828f977c72 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.875472 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c545620-4f9a-4492-b7ac-e7828f977c72 admin admin] RBAC: Adding query filter params (role.id=c72f13c7e83e471b8cc350d318503763, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=a59679a5d71249fc8cd65fbcf84e7bbd) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:48.875932 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c545620-4f9a-4492-b7ac-e7828f977c72 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.878789 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c545620-4f9a-4492-b7ac-e7828f977c72 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.880463 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c595a8-9558-4e7b-a0eb-d4177a2d3534 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.885418 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 210/411] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/role_assignments?user.id=a59679a5d71249fc8cd65fbcf84e7bbd&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=c72f13c7e83e471b8cc350d318503763 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:48.885541 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2f519-3cf1-4b0f-bdea-f9d2157f8395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.886326 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2f519-3cf1-4b0f-bdea-f9d2157f8395 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.886474 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c545620-4f9a-4492-b7ac-e7828f977c72 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.886883 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2f519-3cf1-4b0f-bdea-f9d2157f8395 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.887301 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2f519-3cf1-4b0f-bdea-f9d2157f8395 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.896621 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2f519-3cf1-4b0f-bdea-f9d2157f8395 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.898641 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c545620-4f9a-4492-b7ac-e7828f977c72 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.898887 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2f519-3cf1-4b0f-bdea-f9d2157f8395 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.912858 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 202/412] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:48.914414 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1205b0e-7bff-4195-8d01-92535e803f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.915253 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1205b0e-7bff-4195-8d01-92535e803f36 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.915710 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1205b0e-7bff-4195-8d01-92535e803f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.916129 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1205b0e-7bff-4195-8d01-92535e803f36 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.917109 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1205b0e-7bff-4195-8d01-92535e803f36 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:48.917561 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1205b0e-7bff-4195-8d01-92535e803f36 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.918701 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING py.warnings [None req-f1205b0e-7bff-4195-8d01-92535e803f36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:48.918701 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: warnings.warn(msg) Aug 27 01:13:48.918701 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: Aug 27 01:13:48.921022 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2f519-3cf1-4b0f-bdea-f9d2157f8395 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:48.925770 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1205b0e-7bff-4195-8d01-92535e803f36 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.944804 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2f519-3cf1-4b0f-bdea-f9d2157f8395 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:48.954389 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a8aea-1bd3-49ca-a9eb-f5df82074189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:48.955779 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a8aea-1bd3-49ca-a9eb-f5df82074189 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:48.956217 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a8aea-1bd3-49ca-a9eb-f5df82074189 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:48.956645 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a8aea-1bd3-49ca-a9eb-f5df82074189 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:48.972868 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 211/413] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:48.974166 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a8aea-1bd3-49ca-a9eb-f5df82074189 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:48.976196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a8aea-1bd3-49ca-a9eb-f5df82074189 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:48.978819 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1205b0e-7bff-4195-8d01-92535e803f36 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:49.002722 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-f96a8aea-1bd3-49ca-a9eb-f5df82074189 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:49.005567 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1205b0e-7bff-4195-8d01-92535e803f36 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:49.007741 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 203/414] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:49.012006 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bd408-9c99-45d3-9686-490787d3ca3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:49.012855 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bd408-9c99-45d3-9686-490787d3ca3f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.014623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a8aea-1bd3-49ca-a9eb-f5df82074189 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:49.017228 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bd408-9c99-45d3-9686-490787d3ca3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.017632 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bd408-9c99-45d3-9686-490787d3ca3f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.018613 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bd408-9c99-45d3-9686-490787d3ca3f admin admin] RBAC: Adding query filter params (role.id=c72f13c7e83e471b8cc350d318503763, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=249a7642a0284dde91a7719f732b2d70) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:49.019100 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bd408-9c99-45d3-9686-490787d3ca3f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:49.021170 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bd408-9c99-45d3-9686-490787d3ca3f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:49.027344 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a8aea-1bd3-49ca-a9eb-f5df82074189 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:49.027607 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 212/415] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:48 2021] GET /identity/v3/role_assignments?user.id=249a7642a0284dde91a7719f732b2d70&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=c72f13c7e83e471b8cc350d318503763 => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:49.036863 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c1e86-dae3-4d62-95a8-16a5bb30b446 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.036863 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c1e86-dae3-4d62-95a8-16a5bb30b446 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.036863 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c1e86-dae3-4d62-95a8-16a5bb30b446 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.036863 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 213/416] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:49.045265 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f628a-ae36-4ddc-906a-72d43ebcf30e None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.045599 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f628a-ae36-4ddc-906a-72d43ebcf30e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.045833 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f628a-ae36-4ddc-906a-72d43ebcf30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.051969 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2bb46-a7eb-49d7-9050-569829366851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:49.053961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2bb46-a7eb-49d7-9050-569829366851 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.054275 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2bb46-a7eb-49d7-9050-569829366851 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.054958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2bb46-a7eb-49d7-9050-569829366851 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.055758 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2bb46-a7eb-49d7-9050-569829366851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:49.056068 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2bb46-a7eb-49d7-9050-569829366851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:49.061145 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2bb46-a7eb-49d7-9050-569829366851 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:49.085940 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-c08f628a-ae36-4ddc-906a-72d43ebcf30e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:49.087209 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c08f628a-ae36-4ddc-906a-72d43ebcf30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:49.088673 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 204/417] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:49.095694 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2bb46-a7eb-49d7-9050-569829366851 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:49.102593 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 214/418] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:49.108367 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2bb46-a7eb-49d7-9050-569829366851 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:49.120482 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfd0c4-ca8b-4420-943e-fcd6e1810509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:49.121416 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfd0c4-ca8b-4420-943e-fcd6e1810509 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.121702 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfd0c4-ca8b-4420-943e-fcd6e1810509 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.121976 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfd0c4-ca8b-4420-943e-fcd6e1810509 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.136129 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f628a-ae36-4ddc-906a-72d43ebcf30e None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:49.137496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfd0c4-ca8b-4420-943e-fcd6e1810509 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:49.140693 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfd0c4-ca8b-4420-943e-fcd6e1810509 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:49.147482 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f628a-ae36-4ddc-906a-72d43ebcf30e None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:49.153854 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b51ec-e0e9-48eb-bd0a-180ddbd08926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:49.155063 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b51ec-e0e9-48eb-bd0a-180ddbd08926 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.155552 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b51ec-e0e9-48eb-bd0a-180ddbd08926 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.156073 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b51ec-e0e9-48eb-bd0a-180ddbd08926 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.157486 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-50dfd0c4-ca8b-4420-943e-fcd6e1810509 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:13:49.158920 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 205/419] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:49.165160 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfd0c4-ca8b-4420-943e-fcd6e1810509 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:49.170468 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b51ec-e0e9-48eb-bd0a-180ddbd08926 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:49.176181 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfd0c4-ca8b-4420-943e-fcd6e1810509 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:49.178329 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-168b51ec-e0e9-48eb-bd0a-180ddbd08926 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:13:49.179903 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 215/420] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:13:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:13:49.185530 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac0504-2cdb-41d5-b744-716307112e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:49.185530 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac0504-2cdb-41d5-b744-716307112e16 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.185530 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac0504-2cdb-41d5-b744-716307112e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.185530 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac0504-2cdb-41d5-b744-716307112e16 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.185886 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac0504-2cdb-41d5-b744-716307112e16 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:49.185886 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac0504-2cdb-41d5-b744-716307112e16 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:49.186398 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac0504-2cdb-41d5-b744-716307112e16 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:49.188470 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b51ec-e0e9-48eb-bd0a-180ddbd08926 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:49.199716 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b51ec-e0e9-48eb-bd0a-180ddbd08926 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:49.199922 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 206/421] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:13:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:49.206537 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac0504-2cdb-41d5-b744-716307112e16 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:49.210100 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e50b6-77cc-42fc-aec4-3eb57d3da26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:49.211083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e50b6-77cc-42fc-aec4-3eb57d3da26a admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.211580 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e50b6-77cc-42fc-aec4-3eb57d3da26a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.212094 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e50b6-77cc-42fc-aec4-3eb57d3da26a admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.213181 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e50b6-77cc-42fc-aec4-3eb57d3da26a admin admin] RBAC: Adding query filter params (name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:49.213700 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e50b6-77cc-42fc-aec4-3eb57d3da26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:49.215671 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e50b6-77cc-42fc-aec4-3eb57d3da26a admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:49.217263 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac0504-2cdb-41d5-b744-716307112e16 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:49.222571 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab59f78-fa46-40f8-9563-005795284237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:49.223235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab59f78-fa46-40f8-9563-005795284237 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.223648 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab59f78-fa46-40f8-9563-005795284237 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.223934 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab59f78-fa46-40f8-9563-005795284237 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.224763 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab59f78-fa46-40f8-9563-005795284237 admin admin] RBAC: Adding query filter params (role.id=c72f13c7e83e471b8cc350d318503763, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=686fb610b1ac47388bffbcfdf8f15907) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:49.225118 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab59f78-fa46-40f8-9563-005795284237 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:49.226987 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab59f78-fa46-40f8-9563-005795284237 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:49.228595 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 216/422] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:13:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:49.234029 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 207/423] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:49 2021] GET /identity/v3/role_assignments?user.id=686fb610b1ac47388bffbcfdf8f15907&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=c72f13c7e83e471b8cc350d318503763 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:49.238115 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e50b6-77cc-42fc-aec4-3eb57d3da26a admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:49.250102 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e50b6-77cc-42fc-aec4-3eb57d3da26a admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:49.254715 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab7aa9-9c27-43f5-8e7c-d337058dbe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:49.255530 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab7aa9-9c27-43f5-8e7c-d337058dbe25 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.255812 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab7aa9-9c27-43f5-8e7c-d337058dbe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.256085 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab7aa9-9c27-43f5-8e7c-d337058dbe25 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.268351 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab7aa9-9c27-43f5-8e7c-d337058dbe25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:49.270258 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab7aa9-9c27-43f5-8e7c-d337058dbe25 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:49.289868 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-d9ab7aa9-9c27-43f5-8e7c-d337058dbe25 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:49.291149 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 217/424] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:13:49.298165 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab59f78-fa46-40f8-9563-005795284237 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:49.314868 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab59f78-fa46-40f8-9563-005795284237 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:49.330553 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ef1c6-25b5-4013-b703-b7b302e745ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:49.331251 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ef1c6-25b5-4013-b703-b7b302e745ee admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.331521 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ef1c6-25b5-4013-b703-b7b302e745ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.331798 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ef1c6-25b5-4013-b703-b7b302e745ee admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.332517 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ef1c6-25b5-4013-b703-b7b302e745ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:49.332824 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ef1c6-25b5-4013-b703-b7b302e745ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:49.334465 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ef1c6-25b5-4013-b703-b7b302e745ee admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:49.354925 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 208/425] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:49.361975 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab7aa9-9c27-43f5-8e7c-d337058dbe25 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:49.378783 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab7aa9-9c27-43f5-8e7c-d337058dbe25 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:49.383388 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdf5bf-f348-43d9-859c-7780b9e1d6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:49.384197 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdf5bf-f348-43d9-859c-7780b9e1d6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.384475 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdf5bf-f348-43d9-859c-7780b9e1d6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.384751 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdf5bf-f348-43d9-859c-7780b9e1d6e3 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.402129 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fdf5bf-f348-43d9-859c-7780b9e1d6e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:49.404907 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fdf5bf-f348-43d9-859c-7780b9e1d6e3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:49.429710 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-c4fdf5bf-f348-43d9-859c-7780b9e1d6e3 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 01:13:49.430908 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 218/426] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:13:49 2021] GET /identity/v3/users/neutron => generated 85 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:49.437618 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ef1c6-25b5-4013-b703-b7b302e745ee admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:49.447589 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ef1c6-25b5-4013-b703-b7b302e745ee admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:49.457527 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2dc56-95c2-4293-bbd7-1002ba5ff3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:49.458217 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2dc56-95c2-4293-bbd7-1002ba5ff3fd admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.458500 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2dc56-95c2-4293-bbd7-1002ba5ff3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.458773 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2dc56-95c2-4293-bbd7-1002ba5ff3fd admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.459619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2dc56-95c2-4293-bbd7-1002ba5ff3fd admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:49.459928 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2dc56-95c2-4293-bbd7-1002ba5ff3fd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:49.460961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING py.warnings [None req-c4d2dc56-95c2-4293-bbd7-1002ba5ff3fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:49.460961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: warnings.warn(msg) Aug 27 01:13:49.460961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: Aug 27 01:13:49.462099 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2dc56-95c2-4293-bbd7-1002ba5ff3fd admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:49.510466 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 209/427] 10.222.0.25 () {56 vars in 1161 bytes} [Fri Aug 27 01:13:49 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:49.517972 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdf5bf-f348-43d9-859c-7780b9e1d6e3 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:49.534323 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdf5bf-f348-43d9-859c-7780b9e1d6e3 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:49.549474 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9655e-3d69-4d2e-9f88-98d8425835b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:49.550133 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9655e-3d69-4d2e-9f88-98d8425835b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.550416 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9655e-3d69-4d2e-9f88-98d8425835b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.550693 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9655e-3d69-4d2e-9f88-98d8425835b7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.564416 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9655e-3d69-4d2e-9f88-98d8425835b7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:49.566203 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9655e-3d69-4d2e-9f88-98d8425835b7 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:49.578289 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 219/428] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:49 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:49.584644 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2dc56-95c2-4293-bbd7-1002ba5ff3fd admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:49.595249 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2dc56-95c2-4293-bbd7-1002ba5ff3fd admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:49.606095 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d719c-cdb0-4ccd-a5ab-61f60e610e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:49.607088 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d719c-cdb0-4ccd-a5ab-61f60e610e25 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.607477 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d719c-cdb0-4ccd-a5ab-61f60e610e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.607755 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d719c-cdb0-4ccd-a5ab-61f60e610e25 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.620208 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d719c-cdb0-4ccd-a5ab-61f60e610e25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:49.622096 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d719c-cdb0-4ccd-a5ab-61f60e610e25 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:49.647164 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-647d719c-cdb0-4ccd-a5ab-61f60e610e25 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:49.649000 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 210/429] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:49.658465 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9655e-3d69-4d2e-9f88-98d8425835b7 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:49.678908 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9655e-3d69-4d2e-9f88-98d8425835b7 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:49.687775 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705e058-c7aa-4bd3-ae55-d2f1243105db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:49.688436 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705e058-c7aa-4bd3-ae55-d2f1243105db admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.688713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705e058-c7aa-4bd3-ae55-d2f1243105db admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.689007 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705e058-c7aa-4bd3-ae55-d2f1243105db admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.689725 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705e058-c7aa-4bd3-ae55-d2f1243105db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:49.690027 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705e058-c7aa-4bd3-ae55-d2f1243105db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:49.691598 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705e058-c7aa-4bd3-ae55-d2f1243105db admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:49.713864 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 220/430] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:49.719708 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d719c-cdb0-4ccd-a5ab-61f60e610e25 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:49.734333 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d719c-cdb0-4ccd-a5ab-61f60e610e25 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:49.740902 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e170185-ea5b-4dbf-b3ff-123a20e29bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:49.742161 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e170185-ea5b-4dbf-b3ff-123a20e29bab admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.742649 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e170185-ea5b-4dbf-b3ff-123a20e29bab admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.743145 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e170185-ea5b-4dbf-b3ff-123a20e29bab admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.757922 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e170185-ea5b-4dbf-b3ff-123a20e29bab admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:49.760046 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e170185-ea5b-4dbf-b3ff-123a20e29bab admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:49.782657 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-1e170185-ea5b-4dbf-b3ff-123a20e29bab admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:13:49.784257 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 211/431] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:49.790046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705e058-c7aa-4bd3-ae55-d2f1243105db admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:49.805720 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705e058-c7aa-4bd3-ae55-d2f1243105db admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:49.818156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e7b16-31ea-4cba-86f9-fbbbe2496e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:49.818810 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e7b16-31ea-4cba-86f9-fbbbe2496e8b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.819089 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e7b16-31ea-4cba-86f9-fbbbe2496e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.819364 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e7b16-31ea-4cba-86f9-fbbbe2496e8b admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.820140 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e7b16-31ea-4cba-86f9-fbbbe2496e8b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:49.820445 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e7b16-31ea-4cba-86f9-fbbbe2496e8b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:49.822313 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e7b16-31ea-4cba-86f9-fbbbe2496e8b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:49.842420 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 221/432] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:13:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:49.845287 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1006da-84ee-4bed-ad82-54506f41ab83 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.845578 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1006da-84ee-4bed-ad82-54506f41ab83 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.845865 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1006da-84ee-4bed-ad82-54506f41ab83 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.848607 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 212/433] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:49.848743 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e7b16-31ea-4cba-86f9-fbbbe2496e8b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:49.854742 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72ec97-8454-4201-9d63-c79cc040b1f7 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.855028 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72ec97-8454-4201-9d63-c79cc040b1f7 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.855305 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72ec97-8454-4201-9d63-c79cc040b1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.858902 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e7b16-31ea-4cba-86f9-fbbbe2496e8b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:49.863646 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebf811-9854-4e56-9bdc-7caea78abe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:49.864572 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebf811-9854-4e56-9bdc-7caea78abe98 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.865139 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebf811-9854-4e56-9bdc-7caea78abe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.866082 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebf811-9854-4e56-9bdc-7caea78abe98 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.867099 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebf811-9854-4e56-9bdc-7caea78abe98 admin admin] RBAC: Adding query filter params (role.id=c72f13c7e83e471b8cc350d318503763, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=2e2182e4d74047a399e7ffea63e7ce6e) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:49.867704 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebf811-9854-4e56-9bdc-7caea78abe98 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:49.869901 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebf811-9854-4e56-9bdc-7caea78abe98 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:49.877041 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 222/434] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:49 2021] GET /identity/v3/role_assignments?user.id=2e2182e4d74047a399e7ffea63e7ce6e&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=c72f13c7e83e471b8cc350d318503763 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:49.898005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-5f72ec97-8454-4201-9d63-c79cc040b1f7 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:49.899256 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-5f72ec97-8454-4201-9d63-c79cc040b1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:49.909190 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 213/435] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 27 01:13:49.956146 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebf811-9854-4e56-9bdc-7caea78abe98 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:49.967102 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebf811-9854-4e56-9bdc-7caea78abe98 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:49.976310 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e6d58-ed07-44a3-9558-b86f334ecee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:49.977616 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e6d58-ed07-44a3-9558-b86f334ecee6 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:49.978177 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e6d58-ed07-44a3-9558-b86f334ecee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:49.978693 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e6d58-ed07-44a3-9558-b86f334ecee6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:49.994780 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e6d58-ed07-44a3-9558-b86f334ecee6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:49.997146 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e6d58-ed07-44a3-9558-b86f334ecee6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:50.020520 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-138e6d58-ed07-44a3-9558-b86f334ecee6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:50.022165 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 223/436] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:50.028871 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72ec97-8454-4201-9d63-c79cc040b1f7 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:50.038737 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72ec97-8454-4201-9d63-c79cc040b1f7 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:50.048904 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a606265-b557-420b-bb59-c5c9604cf1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:50.050097 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a606265-b557-420b-bb59-c5c9604cf1ab admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:50.050649 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a606265-b557-420b-bb59-c5c9604cf1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:50.051155 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a606265-b557-420b-bb59-c5c9604cf1ab admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:50.052116 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a606265-b557-420b-bb59-c5c9604cf1ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:50.052631 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a606265-b557-420b-bb59-c5c9604cf1ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:50.054554 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a606265-b557-420b-bb59-c5c9604cf1ab admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:50.072274 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 214/437] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:50.079125 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e6d58-ed07-44a3-9558-b86f334ecee6 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:50.093842 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e6d58-ed07-44a3-9558-b86f334ecee6 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:50.099178 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38319c0-cfbc-4727-9745-baaca1d7e95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:50.100127 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38319c0-cfbc-4727-9745-baaca1d7e95e admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:50.100608 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38319c0-cfbc-4727-9745-baaca1d7e95e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:50.101130 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38319c0-cfbc-4727-9745-baaca1d7e95e admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:50.102039 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38319c0-cfbc-4727-9745-baaca1d7e95e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:50.104184 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38319c0-cfbc-4727-9745-baaca1d7e95e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:50.199586 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 224/438] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 01:13:50 2021] POST /identity/v3/users => generated 247 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:13:51.555904 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aa905-dd6b-48aa-aecb-bf2ad5477b68 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:51.556437 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aa905-dd6b-48aa-aecb-bf2ad5477b68 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:51.556437 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aa905-dd6b-48aa-aecb-bf2ad5477b68 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:51.558514 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 215/439] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:51.564553 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c431ba-4b71-4951-978c-650ad316faef None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:51.564979 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c431ba-4b71-4951-978c-650ad316faef None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:51.565204 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c431ba-4b71-4951-978c-650ad316faef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:51.583830 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-66c431ba-4b71-4951-978c-650ad316faef None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:51.585056 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-66c431ba-4b71-4951-978c-650ad316faef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:51.603122 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 225/440] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:51.649513 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06aa905-dd6b-48aa-aecb-bf2ad5477b68 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:51.666661 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06aa905-dd6b-48aa-aecb-bf2ad5477b68 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:51.671979 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6e14b-16e7-450e-bf15-09c8eeb64d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:51.672802 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6e14b-16e7-450e-bf15-09c8eeb64d48 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:51.673111 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6e14b-16e7-450e-bf15-09c8eeb64d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:51.673385 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6e14b-16e7-450e-bf15-09c8eeb64d48 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:51.695155 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6e14b-16e7-450e-bf15-09c8eeb64d48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:51.702827 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-2ac6e14b-16e7-450e-bf15-09c8eeb64d48 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:13:51.704442 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 216/441] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:13:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:51.711032 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c431ba-4b71-4951-978c-650ad316faef None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:51.720608 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c431ba-4b71-4951-978c-650ad316faef None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:51.729306 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522b50c-034c-4694-ac88-2c075e47fa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:51.729992 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522b50c-034c-4694-ac88-2c075e47fa17 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:51.730273 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522b50c-034c-4694-ac88-2c075e47fa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:51.730548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522b50c-034c-4694-ac88-2c075e47fa17 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:51.731307 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522b50c-034c-4694-ac88-2c075e47fa17 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:51.732155 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522b50c-034c-4694-ac88-2c075e47fa17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:51.733804 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522b50c-034c-4694-ac88-2c075e47fa17 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:51.749522 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 226/442] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:13:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:51.755813 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6e14b-16e7-450e-bf15-09c8eeb64d48 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:51.767979 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4081e76-e7b4-4770-ab53-599d1f278fbb None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:51.768267 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4081e76-e7b4-4770-ab53-599d1f278fbb None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:51.768552 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4081e76-e7b4-4770-ab53-599d1f278fbb None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:51.771717 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6e14b-16e7-450e-bf15-09c8eeb64d48 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:51.773473 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 227/443] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:51 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:51.776741 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf9705-0c14-46bf-8bb2-4db60f65b7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:51.777574 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9705-0c14-46bf-8bb2-4db60f65b7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:51.777934 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9705-0c14-46bf-8bb2-4db60f65b7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:51.779416 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9087b-231e-4b7f-ba04-520d0f3af3d3 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:51.779694 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9087b-231e-4b7f-ba04-520d0f3af3d3 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:51.779964 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9087b-231e-4b7f-ba04-520d0f3af3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:51.781719 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9705-0c14-46bf-8bb2-4db60f65b7b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:51.801625 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf9705-0c14-46bf-8bb2-4db60f65b7b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:51.803325 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-5cb9087b-231e-4b7f-ba04-520d0f3af3d3 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:51.803996 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf9705-0c14-46bf-8bb2-4db60f65b7b1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:51.804543 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-5cb9087b-231e-4b7f-ba04-520d0f3af3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:51.813436 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 228/444] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:51.827764 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-1edf9705-0c14-46bf-8bb2-4db60f65b7b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:51.829395 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 217/445] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:51.837553 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9087b-231e-4b7f-ba04-520d0f3af3d3 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:51.850338 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9087b-231e-4b7f-ba04-520d0f3af3d3 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:51.856997 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e98b1-75b0-42c7-941f-9dabada26a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:51.857717 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e98b1-75b0-42c7-941f-9dabada26a33 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:51.858009 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e98b1-75b0-42c7-941f-9dabada26a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:51.858285 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e98b1-75b0-42c7-941f-9dabada26a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:51.859009 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e98b1-75b0-42c7-941f-9dabada26a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:51.859313 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e98b1-75b0-42c7-941f-9dabada26a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:51.860934 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e98b1-75b0-42c7-941f-9dabada26a33 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:51.863845 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a08da-9a2e-43f3-abbf-68ab895f8af4 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:51.864186 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a08da-9a2e-43f3-abbf-68ab895f8af4 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:51.864466 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a08da-9a2e-43f3-abbf-68ab895f8af4 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:51.866864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 218/446] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:13:51.867281 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a08da-9a2e-43f3-abbf-68ab895f8af4 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:51.877669 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 229/447] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:51.878981 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84333a87-ceed-4d53-a7ee-6d0b13fff3c4 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:51.879270 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84333a87-ceed-4d53-a7ee-6d0b13fff3c4 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:51.879553 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84333a87-ceed-4d53-a7ee-6d0b13fff3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:51.888090 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a08da-9a2e-43f3-abbf-68ab895f8af4 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:51.899466 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad9674-27b1-4163-a791-5fb2c06a8e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:51.901209 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad9674-27b1-4163-a791-5fb2c06a8e82 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:51.901783 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad9674-27b1-4163-a791-5fb2c06a8e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:51.902242 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad9674-27b1-4163-a791-5fb2c06a8e82 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:51.906418 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-84333a87-ceed-4d53-a7ee-6d0b13fff3c4 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:51.907624 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-84333a87-ceed-4d53-a7ee-6d0b13fff3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:51.915303 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad9674-27b1-4163-a791-5fb2c06a8e82 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:51.916937 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 230/448] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:51.917718 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84333a87-ceed-4d53-a7ee-6d0b13fff3c4 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:51.925250 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-9bad9674-27b1-4163-a791-5fb2c06a8e82 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:13:51.926712 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 219/449] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:13:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:51.937131 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad9674-27b1-4163-a791-5fb2c06a8e82 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:51.940858 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84333a87-ceed-4d53-a7ee-6d0b13fff3c4 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:51.947882 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad9674-27b1-4163-a791-5fb2c06a8e82 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:51.950804 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b160c-8005-495f-842e-57cb63743807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:51.951944 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b160c-8005-495f-842e-57cb63743807 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:51.952270 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b160c-8005-495f-842e-57cb63743807 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:51.952555 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b160c-8005-495f-842e-57cb63743807 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:51.957721 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7faae6-d5c9-4418-8a2d-a9e68817d21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:51.960203 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7faae6-d5c9-4418-8a2d-a9e68817d21b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:51.960726 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7faae6-d5c9-4418-8a2d-a9e68817d21b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:51.961039 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7faae6-d5c9-4418-8a2d-a9e68817d21b admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:51.961795 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7faae6-d5c9-4418-8a2d-a9e68817d21b admin admin] RBAC: Adding query filter params (name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:51.962109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7faae6-d5c9-4418-8a2d-a9e68817d21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:51.963727 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7faae6-d5c9-4418-8a2d-a9e68817d21b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:51.973519 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b160c-8005-495f-842e-57cb63743807 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:51.975038 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 220/450] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:13:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:51.975924 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7faae6-d5c9-4418-8a2d-a9e68817d21b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:51.976276 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b160c-8005-495f-842e-57cb63743807 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:51.992031 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7faae6-d5c9-4418-8a2d-a9e68817d21b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:51.996490 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-b24b160c-8005-495f-842e-57cb63743807 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 01:13:51.996601 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4c030-7d97-4f5d-8f7c-b876d4264bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:51.997982 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4c030-7d97-4f5d-8f7c-b876d4264bff admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:51.998322 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4c030-7d97-4f5d-8f7c-b876d4264bff admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:51.998728 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4c030-7d97-4f5d-8f7c-b876d4264bff admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:51.999546 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 231/451] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Aug 27 01:13:51 2021] GET /identity/v3/users/nova => generated 82 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:52.000674 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b160c-8005-495f-842e-57cb63743807 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.016819 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4c030-7d97-4f5d-8f7c-b876d4264bff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:52.017978 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b160c-8005-495f-842e-57cb63743807 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.022767 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77989133-6824-4e2f-8d07-75fcbbe0ad78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.023883 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77989133-6824-4e2f-8d07-75fcbbe0ad78 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.024454 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77989133-6824-4e2f-8d07-75fcbbe0ad78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.024786 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-7df4c030-7d97-4f5d-8f7c-b876d4264bff admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:13:52.025215 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77989133-6824-4e2f-8d07-75fcbbe0ad78 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.026146 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 221/452] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:13:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:52.032545 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4c030-7d97-4f5d-8f7c-b876d4264bff admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.037729 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4c030-7d97-4f5d-8f7c-b876d4264bff admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.042241 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd78bc7-bec8-456e-b2aa-9cbfcd380df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.042898 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd78bc7-bec8-456e-b2aa-9cbfcd380df2 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.043182 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd78bc7-bec8-456e-b2aa-9cbfcd380df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.043458 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd78bc7-bec8-456e-b2aa-9cbfcd380df2 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.044187 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77989133-6824-4e2f-8d07-75fcbbe0ad78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.044384 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd78bc7-bec8-456e-b2aa-9cbfcd380df2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:52.044701 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd78bc7-bec8-456e-b2aa-9cbfcd380df2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.046733 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd78bc7-bec8-456e-b2aa-9cbfcd380df2 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.047027 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77989133-6824-4e2f-8d07-75fcbbe0ad78 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.065918 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-77989133-6824-4e2f-8d07-75fcbbe0ad78 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:52.066097 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 222/453] 10.222.0.25 () {56 vars in 1155 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:52.066852 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd78bc7-bec8-456e-b2aa-9cbfcd380df2 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.073264 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 232/454] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:52.074335 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77989133-6824-4e2f-8d07-75fcbbe0ad78 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.082256 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd78bc7-bec8-456e-b2aa-9cbfcd380df2 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.085162 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77989133-6824-4e2f-8d07-75fcbbe0ad78 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.087018 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d658c-945d-4452-befa-fdc6ce85cd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.087767 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d658c-945d-4452-befa-fdc6ce85cd99 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.088055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d658c-945d-4452-befa-fdc6ce85cd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.088333 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d658c-945d-4452-befa-fdc6ce85cd99 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.089292 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d658c-945d-4452-befa-fdc6ce85cd99 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:52.089616 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d658c-945d-4452-befa-fdc6ce85cd99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.091999 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecbf52-8218-4512-b817-0f7cccab70e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.092136 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d658c-945d-4452-befa-fdc6ce85cd99 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.093213 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecbf52-8218-4512-b817-0f7cccab70e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.093690 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecbf52-8218-4512-b817-0f7cccab70e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.094204 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecbf52-8218-4512-b817-0f7cccab70e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.100721 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 223/455] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:52.101584 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d658c-945d-4452-befa-fdc6ce85cd99 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.105934 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecbf52-8218-4512-b817-0f7cccab70e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.108241 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecbf52-8218-4512-b817-0f7cccab70e8 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.111395 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d658c-945d-4452-befa-fdc6ce85cd99 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.115780 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2ce52-ab6d-49cb-a41e-80a3ad0a247a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.116694 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2ce52-ab6d-49cb-a41e-80a3ad0a247a admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.116694 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2ce52-ab6d-49cb-a41e-80a3ad0a247a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.116998 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2ce52-ab6d-49cb-a41e-80a3ad0a247a admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.118021 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2ce52-ab6d-49cb-a41e-80a3ad0a247a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:52.118336 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2ce52-ab6d-49cb-a41e-80a3ad0a247a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.119929 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2ce52-ab6d-49cb-a41e-80a3ad0a247a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.130359 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-92ecbf52-8218-4512-b817-0f7cccab70e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:52.132414 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 233/456] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:52.132776 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 224/457] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:52.138603 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecbf52-8218-4512-b817-0f7cccab70e8 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.139123 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2ce52-ab6d-49cb-a41e-80a3ad0a247a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.149093 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2ce52-ab6d-49cb-a41e-80a3ad0a247a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.150331 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecbf52-8218-4512-b817-0f7cccab70e8 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.154787 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d80fe-44e9-42c6-aa37-890907709047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.155510 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d80fe-44e9-42c6-aa37-890907709047 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.155870 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d80fe-44e9-42c6-aa37-890907709047 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.156161 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d80fe-44e9-42c6-aa37-890907709047 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.156817 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84d21b-f9b0-459e-a082-cbd9736aac06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.156968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d80fe-44e9-42c6-aa37-890907709047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:52.157275 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d80fe-44e9-42c6-aa37-890907709047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.158256 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84d21b-f9b0-459e-a082-cbd9736aac06 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.158838 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84d21b-f9b0-459e-a082-cbd9736aac06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.158939 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d80fe-44e9-42c6-aa37-890907709047 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.159408 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84d21b-f9b0-459e-a082-cbd9736aac06 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.172638 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 225/458] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:52.174737 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84d21b-f9b0-459e-a082-cbd9736aac06 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.176911 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84d21b-f9b0-459e-a082-cbd9736aac06 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.178482 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d80fe-44e9-42c6-aa37-890907709047 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.188599 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d80fe-44e9-42c6-aa37-890907709047 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.193247 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602dd1e-ab59-415f-aaa8-15bc7c224d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.194035 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602dd1e-ab59-415f-aaa8-15bc7c224d8e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.194381 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602dd1e-ab59-415f-aaa8-15bc7c224d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.194710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602dd1e-ab59-415f-aaa8-15bc7c224d8e admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.198359 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-7d84d21b-f9b0-459e-a082-cbd9736aac06 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:52.199822 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 234/459] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:52.201562 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84d21b-f9b0-459e-a082-cbd9736aac06 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.204031 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602dd1e-ab59-415f-aaa8-15bc7c224d8e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.206664 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602dd1e-ab59-415f-aaa8-15bc7c224d8e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.213544 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84d21b-f9b0-459e-a082-cbd9736aac06 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.218539 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dafbb4-c5cd-4314-b1a6-7b55f5cad2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.219586 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dafbb4-c5cd-4314-b1a6-7b55f5cad2cc admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.220063 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dafbb4-c5cd-4314-b1a6-7b55f5cad2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.220532 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dafbb4-c5cd-4314-b1a6-7b55f5cad2cc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.222780 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-3602dd1e-ab59-415f-aaa8-15bc7c224d8e admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 01:13:52.223999 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 226/460] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/users/glance => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:52.229873 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602dd1e-ab59-415f-aaa8-15bc7c224d8e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.235701 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dafbb4-c5cd-4314-b1a6-7b55f5cad2cc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.235964 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602dd1e-ab59-415f-aaa8-15bc7c224d8e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.238232 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dafbb4-c5cd-4314-b1a6-7b55f5cad2cc admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.240977 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4ad68-9c9e-4f2d-b043-705309904d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.241719 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4ad68-9c9e-4f2d-b043-705309904d4a admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.242010 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4ad68-9c9e-4f2d-b043-705309904d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.242527 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4ad68-9c9e-4f2d-b043-705309904d4a admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.243081 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4ad68-9c9e-4f2d-b043-705309904d4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:52.243387 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4ad68-9c9e-4f2d-b043-705309904d4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.245244 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4ad68-9c9e-4f2d-b043-705309904d4a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.256661 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-a9dafbb4-c5cd-4314-b1a6-7b55f5cad2cc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:13:52.258903 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 235/461] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:52.259477 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 227/462] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:52.260459 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dafbb4-c5cd-4314-b1a6-7b55f5cad2cc admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.268421 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4ad68-9c9e-4f2d-b043-705309904d4a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.275840 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dafbb4-c5cd-4314-b1a6-7b55f5cad2cc admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.280595 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579f4b8-6f15-4771-89c9-33e932d4fbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.281335 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579f4b8-6f15-4771-89c9-33e932d4fbfd admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.281621 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579f4b8-6f15-4771-89c9-33e932d4fbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.281899 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579f4b8-6f15-4771-89c9-33e932d4fbfd admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.282324 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4ad68-9c9e-4f2d-b043-705309904d4a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.282979 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579f4b8-6f15-4771-89c9-33e932d4fbfd admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:52.283291 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579f4b8-6f15-4771-89c9-33e932d4fbfd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.285422 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579f4b8-6f15-4771-89c9-33e932d4fbfd admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.288243 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a44b4-1ef5-42f5-83c8-5d9cd86f67e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.290024 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a44b4-1ef5-42f5-83c8-5d9cd86f67e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.290511 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a44b4-1ef5-42f5-83c8-5d9cd86f67e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.290982 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a44b4-1ef5-42f5-83c8-5d9cd86f67e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.291979 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a44b4-1ef5-42f5-83c8-5d9cd86f67e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:52.292497 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a44b4-1ef5-42f5-83c8-5d9cd86f67e4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.296656 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a44b4-1ef5-42f5-83c8-5d9cd86f67e4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.305089 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 236/463] 10.222.0.25 () {56 vars in 1159 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:52.309048 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579f4b8-6f15-4771-89c9-33e932d4fbfd admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.315059 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 228/464] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:52.316278 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a44b4-1ef5-42f5-83c8-5d9cd86f67e4 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.326116 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579f4b8-6f15-4771-89c9-33e932d4fbfd admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.331507 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316e0d5-b19f-4f00-b363-bd77b441e3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.332295 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316e0d5-b19f-4f00-b363-bd77b441e3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.332411 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a44b4-1ef5-42f5-83c8-5d9cd86f67e4 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.332585 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316e0d5-b19f-4f00-b363-bd77b441e3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.332902 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316e0d5-b19f-4f00-b363-bd77b441e3d7 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.336891 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8226e6-17d7-400a-baae-f5e365f563f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.337669 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8226e6-17d7-400a-baae-f5e365f563f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.337956 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8226e6-17d7-400a-baae-f5e365f563f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.338233 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8226e6-17d7-400a-baae-f5e365f563f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.340427 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316e0d5-b19f-4f00-b363-bd77b441e3d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.343140 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316e0d5-b19f-4f00-b363-bd77b441e3d7 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.349822 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8226e6-17d7-400a-baae-f5e365f563f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.351665 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8226e6-17d7-400a-baae-f5e365f563f1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.356307 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-e316e0d5-b19f-4f00-b363-bd77b441e3d7 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 01:13:52.357673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 237/465] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/users/cinder => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:52.358259 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316e0d5-b19f-4f00-b363-bd77b441e3d7 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.367351 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316e0d5-b19f-4f00-b363-bd77b441e3d7 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.371715 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966b9db-de08-4a0c-b06d-23a5cb798cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.372205 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-eb8226e6-17d7-400a-baae-f5e365f563f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:52.372561 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966b9db-de08-4a0c-b06d-23a5cb798cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.372895 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966b9db-de08-4a0c-b06d-23a5cb798cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.373241 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966b9db-de08-4a0c-b06d-23a5cb798cbf admin admin] PATH_INFO: `/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/249a7642a0284dde91a7719f732b2d70/roles/c72f13c7e83e471b8cc350d318503763` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.373782 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 229/466] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:52.376862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a9f10-8160-4a34-bd3b-67751d620e8e None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.376862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a9f10-8160-4a34-bd3b-67751d620e8e None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.376862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a9f10-8160-4a34-bd3b-67751d620e8e None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.377328 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 230/467] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:52.378026 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a9f10-8160-4a34-bd3b-67751d620e8e None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.395306 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966b9db-de08-4a0c-b06d-23a5cb798cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0094d4fd0a114a2cbf5919f2a0e88e82, user_id=249a7642a0284dde91a7719f732b2d70, role_id=c72f13c7e83e471b8cc350d318503763)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.396796 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a9f10-8160-4a34-bd3b-67751d620e8e None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.397982 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966b9db-de08-4a0c-b06d-23a5cb798cbf admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.401942 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cecbca-65f3-4549-9dd2-9a5e2b4c91b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.402467 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cecbca-65f3-4549-9dd2-9a5e2b4c91b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.402772 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cecbca-65f3-4549-9dd2-9a5e2b4c91b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.403032 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cecbca-65f3-4549-9dd2-9a5e2b4c91b1 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.404471 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cecbca-65f3-4549-9dd2-9a5e2b4c91b1 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:52.404781 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cecbca-65f3-4549-9dd2-9a5e2b4c91b1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.406757 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cecbca-65f3-4549-9dd2-9a5e2b4c91b1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.424353 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 231/468] 10.222.0.25 () {56 vars in 1159 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:52.425578 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ac228-b1ca-4561-ba08-881e944ae0f5 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.425868 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ac228-b1ca-4561-ba08-881e944ae0f5 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.426147 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ac228-b1ca-4561-ba08-881e944ae0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.443056 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-a00ac228-b1ca-4561-ba08-881e944ae0f5 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:52.444340 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a00ac228-b1ca-4561-ba08-881e944ae0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:52.452651 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 232/469] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:52.453436 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ac228-b1ca-4561-ba08-881e944ae0f5 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.466900 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ac228-b1ca-4561-ba08-881e944ae0f5 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.471389 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23672e90-8e34-426d-affd-869a0f5dfa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.472036 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23672e90-8e34-426d-affd-869a0f5dfa38 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.472322 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23672e90-8e34-426d-affd-869a0f5dfa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.472627 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23672e90-8e34-426d-affd-869a0f5dfa38 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.473359 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23672e90-8e34-426d-affd-869a0f5dfa38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:52.473664 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23672e90-8e34-426d-affd-869a0f5dfa38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.475265 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23672e90-8e34-426d-affd-869a0f5dfa38 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.481012 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 238/470] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:13:52 2021] PUT /identity/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/249a7642a0284dde91a7719f732b2d70/roles/c72f13c7e83e471b8cc350d318503763 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:13:52.482680 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966b9db-de08-4a0c-b06d-23a5cb798cbf admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.487284 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 233/471] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:52.493725 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23672e90-8e34-426d-affd-869a0f5dfa38 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.504444 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23672e90-8e34-426d-affd-869a0f5dfa38 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.566369 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69243b3c-e385-47f7-9dfb-e1c4b7dff986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.567202 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69243b3c-e385-47f7-9dfb-e1c4b7dff986 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.567501 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69243b3c-e385-47f7-9dfb-e1c4b7dff986 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.567768 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69243b3c-e385-47f7-9dfb-e1c4b7dff986 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.569487 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966b9db-de08-4a0c-b06d-23a5cb798cbf admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.576522 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53383688-ca16-4326-ac05-9bc06d51e826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.578032 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53383688-ca16-4326-ac05-9bc06d51e826 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.578459 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53383688-ca16-4326-ac05-9bc06d51e826 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.578911 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53383688-ca16-4326-ac05-9bc06d51e826 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.580688 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69243b3c-e385-47f7-9dfb-e1c4b7dff986 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:52.587783 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-69243b3c-e385-47f7-9dfb-e1c4b7dff986 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:13:52.589219 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 234/472] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/roles/service => generated 85 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:52.590102 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69243b3c-e385-47f7-9dfb-e1c4b7dff986 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.592712 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53383688-ca16-4326-ac05-9bc06d51e826 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.594806 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53383688-ca16-4326-ac05-9bc06d51e826 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.602413 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69243b3c-e385-47f7-9dfb-e1c4b7dff986 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.607595 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a33a2-15be-45d8-a6c7-43ab941bee8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.608543 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a33a2-15be-45d8-a6c7-43ab941bee8f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.608969 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a33a2-15be-45d8-a6c7-43ab941bee8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.609351 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a33a2-15be-45d8-a6c7-43ab941bee8f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.617055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a33a2-15be-45d8-a6c7-43ab941bee8f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.617550 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-53383688-ca16-4326-ac05-9bc06d51e826 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:52.618996 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 239/473] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 137 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:52.619666 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a33a2-15be-45d8-a6c7-43ab941bee8f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.620285 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53383688-ca16-4326-ac05-9bc06d51e826 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.632556 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53383688-ca16-4326-ac05-9bc06d51e826 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.634412 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-b04a33a2-15be-45d8-a6c7-43ab941bee8f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:13:52.636068 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 235/474] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:52.638425 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e613e7-4387-4f22-bd9e-253f636dd55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.639332 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e613e7-4387-4f22-bd9e-253f636dd55d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.639857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e613e7-4387-4f22-bd9e-253f636dd55d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.640326 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e613e7-4387-4f22-bd9e-253f636dd55d admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.641389 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e613e7-4387-4f22-bd9e-253f636dd55d admin admin] RBAC: Adding query filter params (name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:52.642157 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e613e7-4387-4f22-bd9e-253f636dd55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.642771 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a33a2-15be-45d8-a6c7-43ab941bee8f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.644567 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e613e7-4387-4f22-bd9e-253f636dd55d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.653923 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a33a2-15be-45d8-a6c7-43ab941bee8f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.656900 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 240/475] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:52.658276 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e613e7-4387-4f22-bd9e-253f636dd55d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.658857 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569e973-9559-4923-b3c0-2b12901a0163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.659606 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569e973-9559-4923-b3c0-2b12901a0163 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.659964 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569e973-9559-4923-b3c0-2b12901a0163 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.660314 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569e973-9559-4923-b3c0-2b12901a0163 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.661158 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569e973-9559-4923-b3c0-2b12901a0163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:52.661533 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569e973-9559-4923-b3c0-2b12901a0163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.663244 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569e973-9559-4923-b3c0-2b12901a0163 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.675559 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e613e7-4387-4f22-bd9e-253f636dd55d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.678778 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 236/476] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:52.679966 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569e973-9559-4923-b3c0-2b12901a0163 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.686035 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0defca-9841-475d-b85c-9617ecccce0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.686993 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0defca-9841-475d-b85c-9617ecccce0a admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.687283 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0defca-9841-475d-b85c-9617ecccce0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.687562 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0defca-9841-475d-b85c-9617ecccce0a admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.689112 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0defca-9841-475d-b85c-9617ecccce0a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:52.689112 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0defca-9841-475d-b85c-9617ecccce0a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.690548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0defca-9841-475d-b85c-9617ecccce0a admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.693316 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569e973-9559-4923-b3c0-2b12901a0163 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.699855 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c397ac-6fee-44f4-b6c8-9266a33cfc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.701734 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c397ac-6fee-44f4-b6c8-9266a33cfc3f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.701734 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c397ac-6fee-44f4-b6c8-9266a33cfc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.701988 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c397ac-6fee-44f4-b6c8-9266a33cfc3f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.705560 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 241/477] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:52.706392 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0defca-9841-475d-b85c-9617ecccce0a admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.717751 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c397ac-6fee-44f4-b6c8-9266a33cfc3f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.718955 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0defca-9841-475d-b85c-9617ecccce0a admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.719653 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c397ac-6fee-44f4-b6c8-9266a33cfc3f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.725517 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed3176-2d0d-41da-9de1-477fed8fb78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.728548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed3176-2d0d-41da-9de1-477fed8fb78e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.728842 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed3176-2d0d-41da-9de1-477fed8fb78e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.729120 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed3176-2d0d-41da-9de1-477fed8fb78e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.737901 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed3176-2d0d-41da-9de1-477fed8fb78e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.739024 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-21c397ac-6fee-44f4-b6c8-9266a33cfc3f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:52.739858 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed3176-2d0d-41da-9de1-477fed8fb78e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.740614 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 237/478] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:52.741562 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c397ac-6fee-44f4-b6c8-9266a33cfc3f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.754469 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-d4ed3176-2d0d-41da-9de1-477fed8fb78e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:13:52.755852 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 242/479] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:52.756460 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed3176-2d0d-41da-9de1-477fed8fb78e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.757461 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c397ac-6fee-44f4-b6c8-9266a33cfc3f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.762527 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a14ee-80f7-4bff-8cda-2c2809eb9394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.764439 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a14ee-80f7-4bff-8cda-2c2809eb9394 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.765006 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a14ee-80f7-4bff-8cda-2c2809eb9394 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.765483 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a14ee-80f7-4bff-8cda-2c2809eb9394 admin admin] PATH_INFO: `/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/a59679a5d71249fc8cd65fbcf84e7bbd/roles/c72f13c7e83e471b8cc350d318503763` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.772498 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed3176-2d0d-41da-9de1-477fed8fb78e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.777328 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b77d0-b85a-40c0-bb40-01bbd2f85947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.778039 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b77d0-b85a-40c0-bb40-01bbd2f85947 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.778322 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b77d0-b85a-40c0-bb40-01bbd2f85947 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.778673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b77d0-b85a-40c0-bb40-01bbd2f85947 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.779537 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b77d0-b85a-40c0-bb40-01bbd2f85947 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:52.779896 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b77d0-b85a-40c0-bb40-01bbd2f85947 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.781649 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b77d0-b85a-40c0-bb40-01bbd2f85947 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.783710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a14ee-80f7-4bff-8cda-2c2809eb9394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0094d4fd0a114a2cbf5919f2a0e88e82, user_id=a59679a5d71249fc8cd65fbcf84e7bbd, role_id=c72f13c7e83e471b8cc350d318503763)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.786627 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a14ee-80f7-4bff-8cda-2c2809eb9394 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.797965 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 243/480] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:52.799063 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b77d0-b85a-40c0-bb40-01bbd2f85947 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.813561 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b77d0-b85a-40c0-bb40-01bbd2f85947 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.818046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791a87b-7689-4c0d-b563-348b8e64039b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.818738 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791a87b-7689-4c0d-b563-348b8e64039b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.819024 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791a87b-7689-4c0d-b563-348b8e64039b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.819302 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791a87b-7689-4c0d-b563-348b8e64039b admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.820132 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791a87b-7689-4c0d-b563-348b8e64039b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:52.820443 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791a87b-7689-4c0d-b563-348b8e64039b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.822391 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791a87b-7689-4c0d-b563-348b8e64039b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.836913 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 244/481] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:52.836913 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791a87b-7689-4c0d-b563-348b8e64039b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.846635 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791a87b-7689-4c0d-b563-348b8e64039b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:52.851181 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542881cb-30bb-4fff-95b7-97fd792a48ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:52.851969 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542881cb-30bb-4fff-95b7-97fd792a48ea admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:52.852252 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542881cb-30bb-4fff-95b7-97fd792a48ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:52.852525 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542881cb-30bb-4fff-95b7-97fd792a48ea admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:52.861715 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542881cb-30bb-4fff-95b7-97fd792a48ea admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:52.863067 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 238/482] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:13:52 2021] PUT /identity/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/a59679a5d71249fc8cd65fbcf84e7bbd/roles/c72f13c7e83e471b8cc350d318503763 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:13:52.868862 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542881cb-30bb-4fff-95b7-97fd792a48ea admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:52.869591 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a14ee-80f7-4bff-8cda-2c2809eb9394 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.887055 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-542881cb-30bb-4fff-95b7-97fd792a48ea admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 01:13:52.887368 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 245/483] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/users/neutron => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:52.896348 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542881cb-30bb-4fff-95b7-97fd792a48ea admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:52.912214 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542881cb-30bb-4fff-95b7-97fd792a48ea admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:53.005817 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a14ee-80f7-4bff-8cda-2c2809eb9394 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:53.017574 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ac53f-b88d-4959-a682-9f3341e9adf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:53.018954 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ac53f-b88d-4959-a682-9f3341e9adf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.019234 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ac53f-b88d-4959-a682-9f3341e9adf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.019511 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ac53f-b88d-4959-a682-9f3341e9adf0 admin admin] PATH_INFO: `/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/686fb610b1ac47388bffbcfdf8f15907/roles/c72f13c7e83e471b8cc350d318503763` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.036629 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c804bd-fb51-4c9a-a64c-d025c11b6f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:53.037403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c804bd-fb51-4c9a-a64c-d025c11b6f3d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.037685 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c804bd-fb51-4c9a-a64c-d025c11b6f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.037963 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c804bd-fb51-4c9a-a64c-d025c11b6f3d admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.038805 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c804bd-fb51-4c9a-a64c-d025c11b6f3d admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:53.039115 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c804bd-fb51-4c9a-a64c-d025c11b6f3d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:53.049300 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ac53f-b88d-4959-a682-9f3341e9adf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0094d4fd0a114a2cbf5919f2a0e88e82, user_id=686fb610b1ac47388bffbcfdf8f15907, role_id=c72f13c7e83e471b8cc350d318503763)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:53.049630 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c804bd-fb51-4c9a-a64c-d025c11b6f3d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:53.052039 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ac53f-b88d-4959-a682-9f3341e9adf0 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:53.069019 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 246/484] 10.222.0.25 () {56 vars in 1161 bytes} [Fri Aug 27 01:13:52 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:53.075731 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c804bd-fb51-4c9a-a64c-d025c11b6f3d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:53.093079 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c804bd-fb51-4c9a-a64c-d025c11b6f3d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:53.097715 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940218ac-3b29-42af-944e-48d7ed871993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:53.098507 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940218ac-3b29-42af-944e-48d7ed871993 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.098783 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940218ac-3b29-42af-944e-48d7ed871993 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.099056 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940218ac-3b29-42af-944e-48d7ed871993 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.110833 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940218ac-3b29-42af-944e-48d7ed871993 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:53.113019 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940218ac-3b29-42af-944e-48d7ed871993 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:53.132780 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-940218ac-3b29-42af-944e-48d7ed871993 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:53.134423 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 247/485] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:53.141606 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940218ac-3b29-42af-944e-48d7ed871993 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:53.149693 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 239/486] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:13:52 2021] PUT /identity/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/686fb610b1ac47388bffbcfdf8f15907/roles/c72f13c7e83e471b8cc350d318503763 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:13:53.166488 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940218ac-3b29-42af-944e-48d7ed871993 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:53.205789 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c082e08-3d28-411f-b20a-f003b4f2d97f None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.206427 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c082e08-3d28-411f-b20a-f003b4f2d97f None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.206907 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c082e08-3d28-411f-b20a-f003b4f2d97f None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.209171 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 240/487] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:53.215698 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f45c44-71c4-4e8a-a340-d2038298143f None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.216598 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f45c44-71c4-4e8a-a340-d2038298143f None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.217184 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f45c44-71c4-4e8a-a340-d2038298143f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.249246 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014f213-e831-4ad2-a5e3-5feb7e18e43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:53.250014 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014f213-e831-4ad2-a5e3-5feb7e18e43e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.250293 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014f213-e831-4ad2-a5e3-5feb7e18e43e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.250566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014f213-e831-4ad2-a5e3-5feb7e18e43e admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.251296 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014f213-e831-4ad2-a5e3-5feb7e18e43e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:53.251598 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014f213-e831-4ad2-a5e3-5feb7e18e43e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:53.256939 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014f213-e831-4ad2-a5e3-5feb7e18e43e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:53.261998 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-c0f45c44-71c4-4e8a-a340-d2038298143f None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:53.264326 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-c0f45c44-71c4-4e8a-a340-d2038298143f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:53.270729 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 248/488] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:53.277628 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014f213-e831-4ad2-a5e3-5feb7e18e43e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:53.282367 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 241/489] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:53.292460 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014f213-e831-4ad2-a5e3-5feb7e18e43e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:53.311361 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30506aa3-485e-4ee4-8ff1-3a9072dea8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:53.312176 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30506aa3-485e-4ee4-8ff1-3a9072dea8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.312455 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30506aa3-485e-4ee4-8ff1-3a9072dea8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.312724 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30506aa3-485e-4ee4-8ff1-3a9072dea8f4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.313718 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f45c44-71c4-4e8a-a340-d2038298143f None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:53.325056 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30506aa3-485e-4ee4-8ff1-3a9072dea8f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:53.327295 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30506aa3-485e-4ee4-8ff1-3a9072dea8f4 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:53.329509 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f45c44-71c4-4e8a-a340-d2038298143f None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:53.340537 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9121b3-9820-4017-8df5-44d21b24fb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:53.342397 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9121b3-9820-4017-8df5-44d21b24fb42 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.342888 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9121b3-9820-4017-8df5-44d21b24fb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.343363 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9121b3-9820-4017-8df5-44d21b24fb42 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.359192 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-30506aa3-485e-4ee4-8ff1-3a9072dea8f4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:13:53.363400 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 249/490] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:53.372058 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30506aa3-485e-4ee4-8ff1-3a9072dea8f4 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:53.374202 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9121b3-9820-4017-8df5-44d21b24fb42 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:53.381735 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-1e9121b3-9820-4017-8df5-44d21b24fb42 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:13:53.383107 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 242/491] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:13:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:13:53.391039 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9121b3-9820-4017-8df5-44d21b24fb42 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:53.391524 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30506aa3-485e-4ee4-8ff1-3a9072dea8f4 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:53.397254 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c629f89-875c-48bd-8f6e-5da186735669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:53.397912 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c629f89-875c-48bd-8f6e-5da186735669 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.398191 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c629f89-875c-48bd-8f6e-5da186735669 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.398462 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c629f89-875c-48bd-8f6e-5da186735669 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.399970 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c629f89-875c-48bd-8f6e-5da186735669 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:53.400282 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c629f89-875c-48bd-8f6e-5da186735669 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:53.402597 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c629f89-875c-48bd-8f6e-5da186735669 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:53.403335 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9121b3-9820-4017-8df5-44d21b24fb42 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:53.408951 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e150d-726f-4a87-ae71-41ff611403e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:53.410115 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e150d-726f-4a87-ae71-41ff611403e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.410630 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e150d-726f-4a87-ae71-41ff611403e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.411145 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e150d-726f-4a87-ae71-41ff611403e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.412109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e150d-726f-4a87-ae71-41ff611403e1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:53.412679 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e150d-726f-4a87-ae71-41ff611403e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:53.414621 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e150d-726f-4a87-ae71-41ff611403e1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:53.417212 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 250/492] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:13:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:53.425129 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c629f89-875c-48bd-8f6e-5da186735669 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:53.425886 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 243/493] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:13:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:53.432173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e150d-726f-4a87-ae71-41ff611403e1 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:53.435525 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c629f89-875c-48bd-8f6e-5da186735669 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:53.442476 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7375c-7453-4ce0-9870-b703dc8841d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:53.443650 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7375c-7453-4ce0-9870-b703dc8841d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.443934 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7375c-7453-4ce0-9870-b703dc8841d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.444212 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7375c-7453-4ce0-9870-b703dc8841d2 admin admin] PATH_INFO: `/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/2e2182e4d74047a399e7ffea63e7ce6e/roles/c72f13c7e83e471b8cc350d318503763` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.446270 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e150d-726f-4a87-ae71-41ff611403e1 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:53.453573 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a2e4a-927b-47b1-a6ac-d9aea6fb9072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:53.454653 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2e4a-927b-47b1-a6ac-d9aea6fb9072 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.455437 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2e4a-927b-47b1-a6ac-d9aea6fb9072 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.455911 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2e4a-927b-47b1-a6ac-d9aea6fb9072 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.461710 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7375c-7453-4ce0-9870-b703dc8841d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0094d4fd0a114a2cbf5919f2a0e88e82, user_id=2e2182e4d74047a399e7ffea63e7ce6e, role_id=c72f13c7e83e471b8cc350d318503763)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:53.464844 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7375c-7453-4ce0-9870-b703dc8841d2 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:53.468083 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a2e4a-927b-47b1-a6ac-d9aea6fb9072 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:53.470410 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a2e4a-927b-47b1-a6ac-d9aea6fb9072 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:53.491149 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-5f2a2e4a-927b-47b1-a6ac-d9aea6fb9072 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:53.492472 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 244/494] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:53.499166 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a2e4a-927b-47b1-a6ac-d9aea6fb9072 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:53.509053 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a2e4a-927b-47b1-a6ac-d9aea6fb9072 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:53.513884 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f53602-8e7b-40a3-9a1d-cede32c7431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:53.520259 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f53602-8e7b-40a3-9a1d-cede32c7431a admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.520259 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f53602-8e7b-40a3-9a1d-cede32c7431a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.520259 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f53602-8e7b-40a3-9a1d-cede32c7431a admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.520259 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f53602-8e7b-40a3-9a1d-cede32c7431a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:53.520259 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f53602-8e7b-40a3-9a1d-cede32c7431a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:53.520259 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f53602-8e7b-40a3-9a1d-cede32c7431a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:53.530792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 245/495] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:53.536825 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f53602-8e7b-40a3-9a1d-cede32c7431a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:53.550520 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 251/496] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:13:53 2021] PUT /identity/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/2e2182e4d74047a399e7ffea63e7ce6e/roles/c72f13c7e83e471b8cc350d318503763 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:13:53.553901 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f53602-8e7b-40a3-9a1d-cede32c7431a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:53.624676 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9709304-fd8a-4b77-8f7a-feeb92fd45ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:53.625719 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9709304-fd8a-4b77-8f7a-feeb92fd45ea admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.626102 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9709304-fd8a-4b77-8f7a-feeb92fd45ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.626475 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9709304-fd8a-4b77-8f7a-feeb92fd45ea admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.634613 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9709304-fd8a-4b77-8f7a-feeb92fd45ea admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:53.636949 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9709304-fd8a-4b77-8f7a-feeb92fd45ea admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:53.652877 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-c9709304-fd8a-4b77-8f7a-feeb92fd45ea admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 01:13:53.655066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 246/497] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:13:53 2021] GET /identity/v3/users/swift => generated 83 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:13:53.661293 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7375c-7453-4ce0-9870-b703dc8841d2 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:53.672494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7375c-7453-4ce0-9870-b703dc8841d2 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:53.677306 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecfa49-33d1-458c-bd80-f570433986af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:53.678148 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecfa49-33d1-458c-bd80-f570433986af admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.678529 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecfa49-33d1-458c-bd80-f570433986af admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.678926 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecfa49-33d1-458c-bd80-f570433986af admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.679956 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ecfa49-33d1-458c-bd80-f570433986af admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:53.680364 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ecfa49-33d1-458c-bd80-f570433986af admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:53.682478 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ecfa49-33d1-458c-bd80-f570433986af admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:53.703919 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 252/498] 10.222.0.25 () {56 vars in 1157 bytes} [Fri Aug 27 01:13:53 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:53.710812 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9709304-fd8a-4b77-8f7a-feeb92fd45ea admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:53.721436 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9709304-fd8a-4b77-8f7a-feeb92fd45ea admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:53.726305 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e11b7-81f2-485b-9d29-109df5199a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:53.727107 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e11b7-81f2-485b-9d29-109df5199a76 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.727514 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e11b7-81f2-485b-9d29-109df5199a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.727903 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e11b7-81f2-485b-9d29-109df5199a76 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.737790 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e11b7-81f2-485b-9d29-109df5199a76 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:53.739760 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e11b7-81f2-485b-9d29-109df5199a76 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:53.750960 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 247/499] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:53 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:53.757717 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecfa49-33d1-458c-bd80-f570433986af admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:53.769289 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecfa49-33d1-458c-bd80-f570433986af admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:53.774136 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7789a9-e5cb-46b6-ad1e-a6e56131d0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:53.775104 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7789a9-e5cb-46b6-ad1e-a6e56131d0ac admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.775479 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7789a9-e5cb-46b6-ad1e-a6e56131d0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.775855 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7789a9-e5cb-46b6-ad1e-a6e56131d0ac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.787676 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7789a9-e5cb-46b6-ad1e-a6e56131d0ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:53.789790 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7789a9-e5cb-46b6-ad1e-a6e56131d0ac admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:53.815006 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-9e7789a9-e5cb-46b6-ad1e-a6e56131d0ac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:53.816455 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 253/500] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:53.823262 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e11b7-81f2-485b-9d29-109df5199a76 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:53.834101 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e11b7-81f2-485b-9d29-109df5199a76 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:53.838781 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c34f85-9244-4dd6-9acb-53848df4be98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:53.839576 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c34f85-9244-4dd6-9acb-53848df4be98 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.840004 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c34f85-9244-4dd6-9acb-53848df4be98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.840382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c34f85-9244-4dd6-9acb-53848df4be98 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.841580 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c34f85-9244-4dd6-9acb-53848df4be98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:53.842068 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c34f85-9244-4dd6-9acb-53848df4be98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:53.843837 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c34f85-9244-4dd6-9acb-53848df4be98 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:53.856337 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 248/501] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:53.863187 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7789a9-e5cb-46b6-ad1e-a6e56131d0ac admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:53.873899 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7789a9-e5cb-46b6-ad1e-a6e56131d0ac admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:53.878641 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1b15a-bf39-4cf5-88bc-a065d1662435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:53.879580 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1b15a-bf39-4cf5-88bc-a065d1662435 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.879960 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1b15a-bf39-4cf5-88bc-a065d1662435 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.880333 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1b15a-bf39-4cf5-88bc-a065d1662435 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.888250 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1b15a-bf39-4cf5-88bc-a065d1662435 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:53.890433 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1b15a-bf39-4cf5-88bc-a065d1662435 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:53.904023 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-bdb1b15a-bf39-4cf5-88bc-a065d1662435 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:13:53.905706 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 254/502] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:53.912104 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c34f85-9244-4dd6-9acb-53848df4be98 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:53.922810 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c34f85-9244-4dd6-9acb-53848df4be98 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:53.928157 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25d787-72af-4f1f-8ca2-3465169ae8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:53.928955 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25d787-72af-4f1f-8ca2-3465169ae8ab admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.929340 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25d787-72af-4f1f-8ca2-3465169ae8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.929715 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25d787-72af-4f1f-8ca2-3465169ae8ab admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.930596 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f25d787-72af-4f1f-8ca2-3465169ae8ab admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:53.931005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f25d787-72af-4f1f-8ca2-3465169ae8ab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:53.932969 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f25d787-72af-4f1f-8ca2-3465169ae8ab admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:53.946170 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 249/503] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:13:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:53.953910 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1b15a-bf39-4cf5-88bc-a065d1662435 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:53.965213 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1b15a-bf39-4cf5-88bc-a065d1662435 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:53.970375 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fca951-11e8-4d0c-9fd6-ae83013cf62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:53.971128 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fca951-11e8-4d0c-9fd6-ae83013cf62b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:53.971550 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fca951-11e8-4d0c-9fd6-ae83013cf62b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:53.971923 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fca951-11e8-4d0c-9fd6-ae83013cf62b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:53.972930 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fca951-11e8-4d0c-9fd6-ae83013cf62b admin admin] RBAC: Adding query filter params (role.id=c72f13c7e83e471b8cc350d318503763, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=d48536f4437240b79cf10961de9cc108) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:53.973359 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fca951-11e8-4d0c-9fd6-ae83013cf62b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:53.975305 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fca951-11e8-4d0c-9fd6-ae83013cf62b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:53.982120 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 255/504] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:53 2021] GET /identity/v3/role_assignments?user.id=d48536f4437240b79cf10961de9cc108&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=c72f13c7e83e471b8cc350d318503763 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:55.044508 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45858150-f514-4ee1-8d95-6f79780cead8 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:55.045127 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45858150-f514-4ee1-8d95-6f79780cead8 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:55.045295 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45858150-f514-4ee1-8d95-6f79780cead8 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:55.047318 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 250/505] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:55.053110 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafb62f-892a-4a63-ae2a-488f21bd3dfd None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:55.053635 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafb62f-892a-4a63-ae2a-488f21bd3dfd None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:55.053781 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafb62f-892a-4a63-ae2a-488f21bd3dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:55.082708 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-2fafb62f-892a-4a63-ae2a-488f21bd3dfd None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:55.083929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-2fafb62f-892a-4a63-ae2a-488f21bd3dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:55.096990 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 256/506] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:55.132476 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45858150-f514-4ee1-8d95-6f79780cead8 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:55.150792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45858150-f514-4ee1-8d95-6f79780cead8 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:55.159111 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b95091-f7e7-4ab0-bb2f-f94b09284f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:55.159935 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b95091-f7e7-4ab0-bb2f-f94b09284f75 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:55.160221 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b95091-f7e7-4ab0-bb2f-f94b09284f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:55.160496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b95091-f7e7-4ab0-bb2f-f94b09284f75 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:55.175825 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b95091-f7e7-4ab0-bb2f-f94b09284f75 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:55.182849 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-e2b95091-f7e7-4ab0-bb2f-f94b09284f75 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:13:55.184071 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 251/507] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:13:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:55.190697 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafb62f-892a-4a63-ae2a-488f21bd3dfd None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:55.206716 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafb62f-892a-4a63-ae2a-488f21bd3dfd None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:55.216579 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd44cb-e534-485d-960f-4ec69ee2b03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:55.217274 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd44cb-e534-485d-960f-4ec69ee2b03f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:55.217556 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd44cb-e534-485d-960f-4ec69ee2b03f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:55.217835 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd44cb-e534-485d-960f-4ec69ee2b03f admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:55.218577 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd44cb-e534-485d-960f-4ec69ee2b03f admin admin] RBAC: Adding query filter params (name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:55.218879 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd44cb-e534-485d-960f-4ec69ee2b03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:55.220761 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd44cb-e534-485d-960f-4ec69ee2b03f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:55.232867 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 257/508] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:13:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:55.239039 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b95091-f7e7-4ab0-bb2f-f94b09284f75 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:55.254206 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b95091-f7e7-4ab0-bb2f-f94b09284f75 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:55.258654 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cc8b6-aff0-4d20-ae41-d72767322502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:55.259437 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cc8b6-aff0-4d20-ae41-d72767322502 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:55.259714 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cc8b6-aff0-4d20-ae41-d72767322502 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:55.259984 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cc8b6-aff0-4d20-ae41-d72767322502 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:55.275537 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cc8b6-aff0-4d20-ae41-d72767322502 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:55.277447 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cc8b6-aff0-4d20-ae41-d72767322502 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:55.303043 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-226cc8b6-aff0-4d20-ae41-d72767322502 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:55.304264 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 252/509] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:55.311358 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd44cb-e534-485d-960f-4ec69ee2b03f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:55.322371 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd44cb-e534-485d-960f-4ec69ee2b03f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:55.329706 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0d46c-519d-4a57-a982-b608722a415b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:55.330962 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0d46c-519d-4a57-a982-b608722a415b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:55.331435 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0d46c-519d-4a57-a982-b608722a415b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:55.331898 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0d46c-519d-4a57-a982-b608722a415b admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:55.332816 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0d46c-519d-4a57-a982-b608722a415b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:55.333332 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0d46c-519d-4a57-a982-b608722a415b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:55.335099 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0d46c-519d-4a57-a982-b608722a415b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:55.352672 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 258/510] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:55.359183 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cc8b6-aff0-4d20-ae41-d72767322502 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:55.373984 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cc8b6-aff0-4d20-ae41-d72767322502 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:55.378466 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e89c86-0574-4c31-8df6-ef1c7b30c66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:55.379246 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e89c86-0574-4c31-8df6-ef1c7b30c66f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:55.379521 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e89c86-0574-4c31-8df6-ef1c7b30c66f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:55.379791 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e89c86-0574-4c31-8df6-ef1c7b30c66f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:55.402143 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e89c86-0574-4c31-8df6-ef1c7b30c66f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:55.404564 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e89c86-0574-4c31-8df6-ef1c7b30c66f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:55.423329 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-90e89c86-0574-4c31-8df6-ef1c7b30c66f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 01:13:55.424605 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 253/511] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Aug 27 01:13:55 2021] GET /identity/v3/users/nova => generated 82 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:55.431001 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0d46c-519d-4a57-a982-b608722a415b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:55.443000 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0d46c-519d-4a57-a982-b608722a415b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:55.456634 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81674be5-30b7-4463-9862-b614523175b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:55.457682 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81674be5-30b7-4463-9862-b614523175b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:55.458189 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81674be5-30b7-4463-9862-b614523175b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:55.458676 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81674be5-30b7-4463-9862-b614523175b8 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:55.459801 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81674be5-30b7-4463-9862-b614523175b8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:55.460300 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81674be5-30b7-4463-9862-b614523175b8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:55.462409 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81674be5-30b7-4463-9862-b614523175b8 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:55.490848 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 259/512] 10.222.0.25 () {56 vars in 1155 bytes} [Fri Aug 27 01:13:55 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:55.496547 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e89c86-0574-4c31-8df6-ef1c7b30c66f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:55.514460 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e89c86-0574-4c31-8df6-ef1c7b30c66f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:55.518871 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb690b-6e57-48b8-a1f4-06523a383ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:55.519519 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb690b-6e57-48b8-a1f4-06523a383ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:55.519798 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb690b-6e57-48b8-a1f4-06523a383ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:55.520116 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb690b-6e57-48b8-a1f4-06523a383ed9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:55.536412 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb690b-6e57-48b8-a1f4-06523a383ed9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:55.538177 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb690b-6e57-48b8-a1f4-06523a383ed9 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:55.550436 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 254/513] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:55.556520 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81674be5-30b7-4463-9862-b614523175b8 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:55.566933 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81674be5-30b7-4463-9862-b614523175b8 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:55.580270 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e030c-36d0-45f0-9e23-a01148ad3807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:55.581411 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e030c-36d0-45f0-9e23-a01148ad3807 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:55.581883 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e030c-36d0-45f0-9e23-a01148ad3807 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:55.582363 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e030c-36d0-45f0-9e23-a01148ad3807 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:55.594287 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e030c-36d0-45f0-9e23-a01148ad3807 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:55.596447 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e030c-36d0-45f0-9e23-a01148ad3807 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:55.626770 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-7b0e030c-36d0-45f0-9e23-a01148ad3807 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:55.628312 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 260/514] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:55.634467 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb690b-6e57-48b8-a1f4-06523a383ed9 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:55.655667 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb690b-6e57-48b8-a1f4-06523a383ed9 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:55.660085 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bf459-5596-4025-b744-269ad9023579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:55.660740 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bf459-5596-4025-b744-269ad9023579 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:55.661048 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bf459-5596-4025-b744-269ad9023579 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:55.661318 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bf459-5596-4025-b744-269ad9023579 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:55.662025 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293bf459-5596-4025-b744-269ad9023579 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:55.662327 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293bf459-5596-4025-b744-269ad9023579 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:55.663883 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293bf459-5596-4025-b744-269ad9023579 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:55.690258 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 255/515] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:55.696136 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e030c-36d0-45f0-9e23-a01148ad3807 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:55.706930 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e030c-36d0-45f0-9e23-a01148ad3807 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:55.720634 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b14ba1-41a3-44a4-a898-52649ba8b26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:55.721706 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b14ba1-41a3-44a4-a898-52649ba8b26a admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:55.722201 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b14ba1-41a3-44a4-a898-52649ba8b26a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:55.722662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b14ba1-41a3-44a4-a898-52649ba8b26a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:55.736734 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b14ba1-41a3-44a4-a898-52649ba8b26a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:55.738949 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b14ba1-41a3-44a4-a898-52649ba8b26a admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:55.758378 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-98b14ba1-41a3-44a4-a898-52649ba8b26a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:13:55.759591 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 261/516] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:55.766038 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bf459-5596-4025-b744-269ad9023579 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:55.782801 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bf459-5596-4025-b744-269ad9023579 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:55.787229 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f1d76-9058-4905-93d6-07426ce00e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:55.787888 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f1d76-9058-4905-93d6-07426ce00e6e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:55.788164 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f1d76-9058-4905-93d6-07426ce00e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:55.788431 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f1d76-9058-4905-93d6-07426ce00e6e admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:55.789231 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f1d76-9058-4905-93d6-07426ce00e6e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:55.789535 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f1d76-9058-4905-93d6-07426ce00e6e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:55.791376 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f1d76-9058-4905-93d6-07426ce00e6e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:55.812604 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 256/517] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:13:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:55.818563 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b14ba1-41a3-44a4-a898-52649ba8b26a admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:55.833914 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b14ba1-41a3-44a4-a898-52649ba8b26a admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:55.841561 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b7ef8-d249-4633-b8e6-a0fe2af9cb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:55.842216 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b7ef8-d249-4633-b8e6-a0fe2af9cb80 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:55.842551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b7ef8-d249-4633-b8e6-a0fe2af9cb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:55.842828 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b7ef8-d249-4633-b8e6-a0fe2af9cb80 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:55.843754 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b7ef8-d249-4633-b8e6-a0fe2af9cb80 admin admin] RBAC: Adding query filter params (role.id=c72f13c7e83e471b8cc350d318503763, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=249a7642a0284dde91a7719f732b2d70) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:55.844072 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b7ef8-d249-4633-b8e6-a0fe2af9cb80 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:55.845992 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b7ef8-d249-4633-b8e6-a0fe2af9cb80 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:55.858271 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 262/518] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:55 2021] GET /identity/v3/role_assignments?user.id=249a7642a0284dde91a7719f732b2d70&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=c72f13c7e83e471b8cc350d318503763 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:55.945340 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda52214-a0b2-42c8-954d-a3f011ee9712 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:55.945663 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda52214-a0b2-42c8-954d-a3f011ee9712 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:55.945892 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda52214-a0b2-42c8-954d-a3f011ee9712 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:55.948079 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 257/519] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:55.967228 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff72ce9-b5e4-4234-b7dc-1f82be4ce6f0 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:55.967539 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff72ce9-b5e4-4234-b7dc-1f82be4ce6f0 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:55.967793 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff72ce9-b5e4-4234-b7dc-1f82be4ce6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:55.978378 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdc386-7184-4f26-b563-889b956e13ea None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:55.978660 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdc386-7184-4f26-b563-889b956e13ea None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:55.978931 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdc386-7184-4f26-b563-889b956e13ea None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:55.980974 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 258/520] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:13:55.987613 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186f701-3247-40bf-9a6f-61f97134169e None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:55.987893 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186f701-3247-40bf-9a6f-61f97134169e None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:55.988169 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186f701-3247-40bf-9a6f-61f97134169e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:55.993138 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-1ff72ce9-b5e4-4234-b7dc-1f82be4ce6f0 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:55.994395 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-1ff72ce9-b5e4-4234-b7dc-1f82be4ce6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:56.006666 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 263/521] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:56.007164 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-a186f701-3247-40bf-9a6f-61f97134169e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:56.008485 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a186f701-3247-40bf-9a6f-61f97134169e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:56.018001 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 259/522] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:56.042201 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff72ce9-b5e4-4234-b7dc-1f82be4ce6f0 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.050899 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186f701-3247-40bf-9a6f-61f97134169e None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.053121 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff72ce9-b5e4-4234-b7dc-1f82be4ce6f0 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.062248 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fee3b-e788-4b4a-9d6a-0600a5e3ff3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.064395 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fee3b-e788-4b4a-9d6a-0600a5e3ff3a admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.064629 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fee3b-e788-4b4a-9d6a-0600a5e3ff3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.064945 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fee3b-e788-4b4a-9d6a-0600a5e3ff3a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.068594 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186f701-3247-40bf-9a6f-61f97134169e None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.078622 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fee3b-e788-4b4a-9d6a-0600a5e3ff3a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:56.083066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253ca3a-f27d-4055-89a4-13e15e91f0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.083887 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253ca3a-f27d-4055-89a4-13e15e91f0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.084168 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253ca3a-f27d-4055-89a4-13e15e91f0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.084441 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253ca3a-f27d-4055-89a4-13e15e91f0f7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.086849 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-ec7fee3b-e788-4b4a-9d6a-0600a5e3ff3a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:13:56.088468 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 264/523] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:56.096091 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fee3b-e788-4b4a-9d6a-0600a5e3ff3a admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.106004 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253ca3a-f27d-4055-89a4-13e15e91f0f7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:56.116936 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fee3b-e788-4b4a-9d6a-0600a5e3ff3a admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.117515 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-3253ca3a-f27d-4055-89a4-13e15e91f0f7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:13:56.119162 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 260/524] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:13:56.124741 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189678b3-fe8e-476d-a49e-4b2cfa07c74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.126224 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253ca3a-f27d-4055-89a4-13e15e91f0f7 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.126928 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189678b3-fe8e-476d-a49e-4b2cfa07c74d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.127209 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189678b3-fe8e-476d-a49e-4b2cfa07c74d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.129370 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189678b3-fe8e-476d-a49e-4b2cfa07c74d admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.130195 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189678b3-fe8e-476d-a49e-4b2cfa07c74d admin admin] RBAC: Adding query filter params (name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:56.130508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189678b3-fe8e-476d-a49e-4b2cfa07c74d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.132180 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189678b3-fe8e-476d-a49e-4b2cfa07c74d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.137266 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253ca3a-f27d-4055-89a4-13e15e91f0f7 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.142907 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ec557-c979-460a-86c2-447595ef7e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.143567 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ec557-c979-460a-86c2-447595ef7e6f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.143700 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 265/525] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:56.143901 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ec557-c979-460a-86c2-447595ef7e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.144179 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ec557-c979-460a-86c2-447595ef7e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.145080 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ec557-c979-460a-86c2-447595ef7e6f admin admin] RBAC: Adding query filter params (name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:56.145394 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ec557-c979-460a-86c2-447595ef7e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.147140 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ec557-c979-460a-86c2-447595ef7e6f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.154097 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189678b3-fe8e-476d-a49e-4b2cfa07c74d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.159028 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 261/526] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:56.169381 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189678b3-fe8e-476d-a49e-4b2cfa07c74d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.170919 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ec557-c979-460a-86c2-447595ef7e6f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.177857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10e402-c6d8-4802-bee2-e3a2a1efce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.179010 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10e402-c6d8-4802-bee2-e3a2a1efce65 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.179468 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10e402-c6d8-4802-bee2-e3a2a1efce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.179914 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10e402-c6d8-4802-bee2-e3a2a1efce65 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.189941 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ec557-c979-460a-86c2-447595ef7e6f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.194856 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10e402-c6d8-4802-bee2-e3a2a1efce65 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.197988 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10e402-c6d8-4802-bee2-e3a2a1efce65 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.198915 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032017d-10a3-4a9f-b4b5-1fd724a43407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.199993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032017d-10a3-4a9f-b4b5-1fd724a43407 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.201102 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032017d-10a3-4a9f-b4b5-1fd724a43407 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.201575 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032017d-10a3-4a9f-b4b5-1fd724a43407 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.220846 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-ea10e402-c6d8-4802-bee2-e3a2a1efce65 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:56.221607 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032017d-10a3-4a9f-b4b5-1fd724a43407 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.222167 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 266/527] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:56.223891 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032017d-10a3-4a9f-b4b5-1fd724a43407 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.228488 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10e402-c6d8-4802-bee2-e3a2a1efce65 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.241150 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10e402-c6d8-4802-bee2-e3a2a1efce65 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.245628 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d53068-8dd5-4295-9930-8b8cac973473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.246326 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d53068-8dd5-4295-9930-8b8cac973473 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.246601 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d53068-8dd5-4295-9930-8b8cac973473 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.246870 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d53068-8dd5-4295-9930-8b8cac973473 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.247615 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d53068-8dd5-4295-9930-8b8cac973473 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:56.248080 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d53068-8dd5-4295-9930-8b8cac973473 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.249191 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-4032017d-10a3-4a9f-b4b5-1fd724a43407 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:56.249693 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d53068-8dd5-4295-9930-8b8cac973473 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.250652 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 262/528] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:56.252047 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4daf8f-d368-4488-8501-300ff37ce4fa None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.252950 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4daf8f-d368-4488-8501-300ff37ce4fa None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.253272 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4daf8f-d368-4488-8501-300ff37ce4fa None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.255078 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 263/529] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:56.260557 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4daf8f-d368-4488-8501-300ff37ce4fa None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.262571 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 267/530] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:56.269252 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df1ccb-550e-450d-a4aa-48e413f04fa5 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.269537 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df1ccb-550e-450d-a4aa-48e413f04fa5 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.269811 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df1ccb-550e-450d-a4aa-48e413f04fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.274162 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4daf8f-d368-4488-8501-300ff37ce4fa None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.282316 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66066f07-5611-4ae5-89a2-7ecb1db14999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.282982 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66066f07-5611-4ae5-89a2-7ecb1db14999 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.283333 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66066f07-5611-4ae5-89a2-7ecb1db14999 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.283586 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66066f07-5611-4ae5-89a2-7ecb1db14999 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.284328 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66066f07-5611-4ae5-89a2-7ecb1db14999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:56.284630 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66066f07-5611-4ae5-89a2-7ecb1db14999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.286344 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66066f07-5611-4ae5-89a2-7ecb1db14999 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.289101 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-60df1ccb-550e-450d-a4aa-48e413f04fa5 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:56.290395 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-60df1ccb-550e-450d-a4aa-48e413f04fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:56.300511 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 268/531] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:56.301497 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df1ccb-550e-450d-a4aa-48e413f04fa5 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.302521 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 264/532] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:56.308472 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66066f07-5611-4ae5-89a2-7ecb1db14999 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.314696 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df1ccb-550e-450d-a4aa-48e413f04fa5 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.320277 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4a12b-5db9-44be-bd29-85a4302bd0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.321057 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66066f07-5611-4ae5-89a2-7ecb1db14999 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.321175 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4a12b-5db9-44be-bd29-85a4302bd0bc admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.321419 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4a12b-5db9-44be-bd29-85a4302bd0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.321690 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4a12b-5db9-44be-bd29-85a4302bd0bc admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.327164 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f91f9-0789-4647-bbff-fdd78e17d1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.328140 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f91f9-0789-4647-bbff-fdd78e17d1ba admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.328618 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f91f9-0789-4647-bbff-fdd78e17d1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.329173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f91f9-0789-4647-bbff-fdd78e17d1ba admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.330706 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4a12b-5db9-44be-bd29-85a4302bd0bc admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.332788 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4a12b-5db9-44be-bd29-85a4302bd0bc admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.338904 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f91f9-0789-4647-bbff-fdd78e17d1ba admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.341986 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f91f9-0789-4647-bbff-fdd78e17d1ba admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.350064 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-b0d4a12b-5db9-44be-bd29-85a4302bd0bc admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 01:13:56.350453 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 269/533] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/users/glance => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:56.351285 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4a12b-5db9-44be-bd29-85a4302bd0bc admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.357670 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-1e2f91f9-0789-4647-bbff-fdd78e17d1ba admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 01:13:56.359195 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 265/534] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/users/cinder => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:56.359969 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f91f9-0789-4647-bbff-fdd78e17d1ba admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.372487 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4a12b-5db9-44be-bd29-85a4302bd0bc admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.375483 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f91f9-0789-4647-bbff-fdd78e17d1ba admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.380092 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca62322-d0f0-4b81-8737-b9de68d95e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.380739 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ea68a-7b21-4691-9be5-2c4c7045c5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.380999 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca62322-d0f0-4b81-8737-b9de68d95e14 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.381373 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca62322-d0f0-4b81-8737-b9de68d95e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.381739 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca62322-d0f0-4b81-8737-b9de68d95e14 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.382209 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ea68a-7b21-4691-9be5-2c4c7045c5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.382681 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ea68a-7b21-4691-9be5-2c4c7045c5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.382817 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca62322-d0f0-4b81-8737-b9de68d95e14 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:56.383225 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca62322-d0f0-4b81-8737-b9de68d95e14 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.383357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ea68a-7b21-4691-9be5-2c4c7045c5b4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.385249 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca62322-d0f0-4b81-8737-b9de68d95e14 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.397417 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ea68a-7b21-4691-9be5-2c4c7045c5b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:56.404044 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 266/535] 10.222.0.25 () {56 vars in 1159 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:56.405058 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca62322-d0f0-4b81-8737-b9de68d95e14 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.406512 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-d36ea68a-7b21-4691-9be5-2c4c7045c5b4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:13:56.408124 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 270/536] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:56.414069 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ea68a-7b21-4691-9be5-2c4c7045c5b4 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.422350 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca62322-d0f0-4b81-8737-b9de68d95e14 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.426715 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ea68a-7b21-4691-9be5-2c4c7045c5b4 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.427119 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051fa0d-ba4e-400f-9426-5a26a6167b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.427933 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051fa0d-ba4e-400f-9426-5a26a6167b3f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.428304 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051fa0d-ba4e-400f-9426-5a26a6167b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.428719 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051fa0d-ba4e-400f-9426-5a26a6167b3f admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.429778 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051fa0d-ba4e-400f-9426-5a26a6167b3f admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:56.430189 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051fa0d-ba4e-400f-9426-5a26a6167b3f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.432231 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051fa0d-ba4e-400f-9426-5a26a6167b3f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.432457 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1581b-7fe2-461d-b8b3-e2f1c500caf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.433280 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1581b-7fe2-461d-b8b3-e2f1c500caf5 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.433720 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1581b-7fe2-461d-b8b3-e2f1c500caf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.434136 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1581b-7fe2-461d-b8b3-e2f1c500caf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.436888 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1581b-7fe2-461d-b8b3-e2f1c500caf5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:56.437364 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1581b-7fe2-461d-b8b3-e2f1c500caf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.439098 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1581b-7fe2-461d-b8b3-e2f1c500caf5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.450866 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 271/537] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:56.451837 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 267/538] 10.222.0.25 () {56 vars in 1159 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:56.452029 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1581b-7fe2-461d-b8b3-e2f1c500caf5 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.458225 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051fa0d-ba4e-400f-9426-5a26a6167b3f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.462851 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1581b-7fe2-461d-b8b3-e2f1c500caf5 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.468980 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1ad1f-04ec-4f2b-80c4-a286300f62b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.469196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051fa0d-ba4e-400f-9426-5a26a6167b3f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.470045 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1ad1f-04ec-4f2b-80c4-a286300f62b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.470591 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1ad1f-04ec-4f2b-80c4-a286300f62b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.471091 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1ad1f-04ec-4f2b-80c4-a286300f62b3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.474260 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976e334-73a5-440c-b887-d37d0ddad8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.475177 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976e334-73a5-440c-b887-d37d0ddad8ef admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.475567 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976e334-73a5-440c-b887-d37d0ddad8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.475986 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976e334-73a5-440c-b887-d37d0ddad8ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.481356 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1ad1f-04ec-4f2b-80c4-a286300f62b3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.483302 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1ad1f-04ec-4f2b-80c4-a286300f62b3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.487409 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976e334-73a5-440c-b887-d37d0ddad8ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.489471 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976e334-73a5-440c-b887-d37d0ddad8ef admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.495149 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 272/539] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:56.496116 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1ad1f-04ec-4f2b-80c4-a286300f62b3 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.508756 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1ad1f-04ec-4f2b-80c4-a286300f62b3 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.513525 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-9976e334-73a5-440c-b887-d37d0ddad8ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:56.513799 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1547d36-aa75-41cb-835e-e80b40c3d1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.514595 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1547d36-aa75-41cb-835e-e80b40c3d1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.515046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1547d36-aa75-41cb-835e-e80b40c3d1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.515459 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 268/540] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:56.515571 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1547d36-aa75-41cb-835e-e80b40c3d1e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.521478 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976e334-73a5-440c-b887-d37d0ddad8ef admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.524444 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1547d36-aa75-41cb-835e-e80b40c3d1e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.526423 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1547d36-aa75-41cb-835e-e80b40c3d1e4 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.532625 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976e334-73a5-440c-b887-d37d0ddad8ef admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.537430 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beed833-7e47-4b60-9c7d-9fa55369c7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.538011 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 273/541] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:56.538382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beed833-7e47-4b60-9c7d-9fa55369c7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.538847 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beed833-7e47-4b60-9c7d-9fa55369c7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.539251 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beed833-7e47-4b60-9c7d-9fa55369c7f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.539411 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1547d36-aa75-41cb-835e-e80b40c3d1e4 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.548570 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1547d36-aa75-41cb-835e-e80b40c3d1e4 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.550651 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beed833-7e47-4b60-9c7d-9fa55369c7f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.552685 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beed833-7e47-4b60-9c7d-9fa55369c7f2 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.553733 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d892f8-31b5-4bd1-836c-26a6653cb260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.554535 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d892f8-31b5-4bd1-836c-26a6653cb260 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.555086 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d892f8-31b5-4bd1-836c-26a6653cb260 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.555509 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d892f8-31b5-4bd1-836c-26a6653cb260 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.556379 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d892f8-31b5-4bd1-836c-26a6653cb260 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:56.556855 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d892f8-31b5-4bd1-836c-26a6653cb260 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.558551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d892f8-31b5-4bd1-836c-26a6653cb260 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.571478 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 274/542] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:56.572198 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-6beed833-7e47-4b60-9c7d-9fa55369c7f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:56.572741 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d892f8-31b5-4bd1-836c-26a6653cb260 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.580022 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 269/543] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:56.580579 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beed833-7e47-4b60-9c7d-9fa55369c7f2 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.584169 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d892f8-31b5-4bd1-836c-26a6653cb260 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.589149 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241f5c8-328d-461c-88d9-0474ad963758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.590235 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241f5c8-328d-461c-88d9-0474ad963758 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.590664 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241f5c8-328d-461c-88d9-0474ad963758 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.591769 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241f5c8-328d-461c-88d9-0474ad963758 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.598158 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beed833-7e47-4b60-9c7d-9fa55369c7f2 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.603706 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a9dfd-fd45-4ea6-9d3b-f971d57c494a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.604695 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a9dfd-fd45-4ea6-9d3b-f971d57c494a admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.605151 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a9dfd-fd45-4ea6-9d3b-f971d57c494a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.605595 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a9dfd-fd45-4ea6-9d3b-f971d57c494a admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.605860 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241f5c8-328d-461c-88d9-0474ad963758 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.608295 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241f5c8-328d-461c-88d9-0474ad963758 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.614157 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a9dfd-fd45-4ea6-9d3b-f971d57c494a admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.616442 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a9dfd-fd45-4ea6-9d3b-f971d57c494a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.626949 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-2241f5c8-328d-461c-88d9-0474ad963758 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:56.628336 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 275/544] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:56.629516 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241f5c8-328d-461c-88d9-0474ad963758 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.631926 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-010a9dfd-fd45-4ea6-9d3b-f971d57c494a admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 01:13:56.633520 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 270/545] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/users/neutron => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:56.637835 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a9dfd-fd45-4ea6-9d3b-f971d57c494a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.640549 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241f5c8-328d-461c-88d9-0474ad963758 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.645193 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48f7f8-2dd4-472f-920f-6db6d2fa889c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.646089 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48f7f8-2dd4-472f-920f-6db6d2fa889c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.646509 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48f7f8-2dd4-472f-920f-6db6d2fa889c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.646929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48f7f8-2dd4-472f-920f-6db6d2fa889c admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.647792 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48f7f8-2dd4-472f-920f-6db6d2fa889c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:56.648242 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48f7f8-2dd4-472f-920f-6db6d2fa889c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.650012 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48f7f8-2dd4-472f-920f-6db6d2fa889c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.650261 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a9dfd-fd45-4ea6-9d3b-f971d57c494a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.655969 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f848f4f-7ed9-4a02-b504-507ee17f847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.656781 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f848f4f-7ed9-4a02-b504-507ee17f847c admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.657179 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f848f4f-7ed9-4a02-b504-507ee17f847c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.657547 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f848f4f-7ed9-4a02-b504-507ee17f847c admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.658491 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f848f4f-7ed9-4a02-b504-507ee17f847c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:56.658965 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f848f4f-7ed9-4a02-b504-507ee17f847c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.660659 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f848f4f-7ed9-4a02-b504-507ee17f847c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.666631 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 276/546] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:56.668073 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48f7f8-2dd4-472f-920f-6db6d2fa889c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.672869 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 271/547] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:56.673997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672859bd-2f5e-4c68-9670-299cd4b645e5 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.674287 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672859bd-2f5e-4c68-9670-299cd4b645e5 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.674567 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672859bd-2f5e-4c68-9670-299cd4b645e5 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.677215 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 272/548] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:56.677215 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672859bd-2f5e-4c68-9670-299cd4b645e5 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.684329 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48f7f8-2dd4-472f-920f-6db6d2fa889c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.688756 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179220e4-f60b-44b4-a6e9-da9250726a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.689573 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179220e4-f60b-44b4-a6e9-da9250726a31 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.689921 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179220e4-f60b-44b4-a6e9-da9250726a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.690294 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179220e4-f60b-44b4-a6e9-da9250726a31 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.690976 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672859bd-2f5e-4c68-9670-299cd4b645e5 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.691336 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179220e4-f60b-44b4-a6e9-da9250726a31 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:56.691745 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179220e4-f60b-44b4-a6e9-da9250726a31 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.693674 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179220e4-f60b-44b4-a6e9-da9250726a31 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.695253 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38830e-94a8-4bc8-9a21-76e204a642b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.695993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38830e-94a8-4bc8-9a21-76e204a642b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.696283 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38830e-94a8-4bc8-9a21-76e204a642b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.696562 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38830e-94a8-4bc8-9a21-76e204a642b6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.703895 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38830e-94a8-4bc8-9a21-76e204a642b6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.706160 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38830e-94a8-4bc8-9a21-76e204a642b6 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.712143 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 277/549] 10.222.0.25 () {56 vars in 1161 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:56.718043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179220e4-f60b-44b4-a6e9-da9250726a31 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.719911 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-9e38830e-94a8-4bc8-9a21-76e204a642b6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:13:56.721415 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 273/550] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:56.724989 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbf57a-dddc-4a64-bfdf-232edb818d46 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.724989 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbf57a-dddc-4a64-bfdf-232edb818d46 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.724989 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbf57a-dddc-4a64-bfdf-232edb818d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.730530 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179220e4-f60b-44b4-a6e9-da9250726a31 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.733172 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fba8c-6088-4d70-9cab-7c68166dcff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.734032 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fba8c-6088-4d70-9cab-7c68166dcff0 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.734481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fba8c-6088-4d70-9cab-7c68166dcff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.734826 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fba8c-6088-4d70-9cab-7c68166dcff0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.742026 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fba8c-6088-4d70-9cab-7c68166dcff0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.744052 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fba8c-6088-4d70-9cab-7c68166dcff0 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.745429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-34bbf57a-dddc-4a64-bfdf-232edb818d46 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:56.746738 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-34bbf57a-dddc-4a64-bfdf-232edb818d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:56.754478 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 274/551] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:56.755303 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbf57a-dddc-4a64-bfdf-232edb818d46 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.757794 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-1e5fba8c-6088-4d70-9cab-7c68166dcff0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:13:56.765450 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 278/552] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:56.766498 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fba8c-6088-4d70-9cab-7c68166dcff0 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.770902 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbf57a-dddc-4a64-bfdf-232edb818d46 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.775664 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12df658-3fdb-4218-9ae2-b831ec36b5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.776418 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12df658-3fdb-4218-9ae2-b831ec36b5aa admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.776810 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12df658-3fdb-4218-9ae2-b831ec36b5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.777180 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12df658-3fdb-4218-9ae2-b831ec36b5aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.777525 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fba8c-6088-4d70-9cab-7c68166dcff0 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.783137 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e944c1-d03a-4c86-b93e-20bb9d3f759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.783868 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e944c1-d03a-4c86-b93e-20bb9d3f759d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.784150 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e944c1-d03a-4c86-b93e-20bb9d3f759d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.784427 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e944c1-d03a-4c86-b93e-20bb9d3f759d admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.785235 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e944c1-d03a-4c86-b93e-20bb9d3f759d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:56.785544 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e944c1-d03a-4c86-b93e-20bb9d3f759d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.787350 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e944c1-d03a-4c86-b93e-20bb9d3f759d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.788572 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12df658-3fdb-4218-9ae2-b831ec36b5aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.790433 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12df658-3fdb-4218-9ae2-b831ec36b5aa admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.799895 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 279/553] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:56.805129 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 275/554] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:56.805271 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e944c1-d03a-4c86-b93e-20bb9d3f759d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.805362 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12df658-3fdb-4218-9ae2-b831ec36b5aa admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.810871 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e944c1-d03a-4c86-b93e-20bb9d3f759d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.815563 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d641b9-47c2-4382-a145-32c998211034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.815912 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d641b9-47c2-4382-a145-32c998211034 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.816193 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d641b9-47c2-4382-a145-32c998211034 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.816461 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d641b9-47c2-4382-a145-32c998211034 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.817298 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d641b9-47c2-4382-a145-32c998211034 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:56.817621 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d641b9-47c2-4382-a145-32c998211034 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.818927 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12df658-3fdb-4218-9ae2-b831ec36b5aa admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.819422 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d641b9-47c2-4382-a145-32c998211034 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.823648 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cf350-5100-4c88-8ad7-abb52d6857b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.824374 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cf350-5100-4c88-8ad7-abb52d6857b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.824653 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cf350-5100-4c88-8ad7-abb52d6857b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.824966 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cf350-5100-4c88-8ad7-abb52d6857b6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.832781 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 280/555] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:56.833622 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d641b9-47c2-4382-a145-32c998211034 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.842324 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cf350-5100-4c88-8ad7-abb52d6857b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:56.847886 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d641b9-47c2-4382-a145-32c998211034 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.849184 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-5d6cf350-5100-4c88-8ad7-abb52d6857b6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:13:56.850501 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 276/556] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:56.851133 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cf350-5100-4c88-8ad7-abb52d6857b6 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.855229 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b3988-af14-43dd-9288-ea4a70d6676e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.856948 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b3988-af14-43dd-9288-ea4a70d6676e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.857588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b3988-af14-43dd-9288-ea4a70d6676e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.858023 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b3988-af14-43dd-9288-ea4a70d6676e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.858879 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b3988-af14-43dd-9288-ea4a70d6676e admin admin] RBAC: Adding query filter params (role.id=c72f13c7e83e471b8cc350d318503763, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=a59679a5d71249fc8cd65fbcf84e7bbd) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:56.859177 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b3988-af14-43dd-9288-ea4a70d6676e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.861036 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b3988-af14-43dd-9288-ea4a70d6676e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.861217 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cf350-5100-4c88-8ad7-abb52d6857b6 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.865816 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb38a0-146b-4686-a171-e89752677086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.866576 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb38a0-146b-4686-a171-e89752677086 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.866863 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb38a0-146b-4686-a171-e89752677086 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.877294 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb38a0-146b-4686-a171-e89752677086 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.877525 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 281/557] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/role_assignments?user.id=a59679a5d71249fc8cd65fbcf84e7bbd&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=c72f13c7e83e471b8cc350d318503763 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:56.877525 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b3988-af14-43dd-9288-ea4a70d6676e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.886401 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b3988-af14-43dd-9288-ea4a70d6676e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.888535 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb38a0-146b-4686-a171-e89752677086 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.890724 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb38a0-146b-4686-a171-e89752677086 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.892134 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3474bcf-592f-4e0f-9245-f84451b530a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.893077 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3474bcf-592f-4e0f-9245-f84451b530a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.893556 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3474bcf-592f-4e0f-9245-f84451b530a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.893976 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3474bcf-592f-4e0f-9245-f84451b530a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.894966 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3474bcf-592f-4e0f-9245-f84451b530a6 admin admin] RBAC: Adding query filter params (role.id=c72f13c7e83e471b8cc350d318503763, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=686fb610b1ac47388bffbcfdf8f15907) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:56.895440 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3474bcf-592f-4e0f-9245-f84451b530a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.897512 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3474bcf-592f-4e0f-9245-f84451b530a6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.912213 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-30fb38a0-146b-4686-a171-e89752677086 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:56.912902 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 282/558] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/role_assignments?user.id=686fb610b1ac47388bffbcfdf8f15907&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=c72f13c7e83e471b8cc350d318503763 => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:56.914020 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3474bcf-592f-4e0f-9245-f84451b530a6 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.920269 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 277/559] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:56.921537 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb38a0-146b-4686-a171-e89752677086 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.930882 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3474bcf-592f-4e0f-9245-f84451b530a6 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.937006 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c51112-45f1-4010-87c2-8369110f9278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.938008 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c51112-45f1-4010-87c2-8369110f9278 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.938519 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c51112-45f1-4010-87c2-8369110f9278 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.938963 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c51112-45f1-4010-87c2-8369110f9278 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.939899 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c51112-45f1-4010-87c2-8369110f9278 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:56.940389 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c51112-45f1-4010-87c2-8369110f9278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.942357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c51112-45f1-4010-87c2-8369110f9278 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.946866 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb38a0-146b-4686-a171-e89752677086 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.956915 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 283/560] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:56.958463 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4f41f-b8bb-43d4-aaa8-817e07a77d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.959343 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4f41f-b8bb-43d4-aaa8-817e07a77d04 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.959823 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4f41f-b8bb-43d4-aaa8-817e07a77d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.960346 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4f41f-b8bb-43d4-aaa8-817e07a77d04 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.961248 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4f41f-b8bb-43d4-aaa8-817e07a77d04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:56.961747 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4f41f-b8bb-43d4-aaa8-817e07a77d04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:56.963517 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c51112-45f1-4010-87c2-8369110f9278 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:56.969878 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4f41f-b8bb-43d4-aaa8-817e07a77d04 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:56.985022 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c51112-45f1-4010-87c2-8369110f9278 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:56.990370 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fa1f0-9bab-4369-ba91-aecde12f15fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:56.991444 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fa1f0-9bab-4369-ba91-aecde12f15fa admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:56.991952 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fa1f0-9bab-4369-ba91-aecde12f15fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:56.992398 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fa1f0-9bab-4369-ba91-aecde12f15fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:56.993144 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 278/561] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:57.001706 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4f41f-b8bb-43d4-aaa8-817e07a77d04 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:57.008302 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fa1f0-9bab-4369-ba91-aecde12f15fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:57.010541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fa1f0-9bab-4369-ba91-aecde12f15fa admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:57.020889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4f41f-b8bb-43d4-aaa8-817e07a77d04 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:57.030304 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-5d2fa1f0-9bab-4369-ba91-aecde12f15fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:57.031780 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4221090-1f72-41eb-8e2a-fa40986276fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:57.032157 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 284/562] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:13:57.032747 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4221090-1f72-41eb-8e2a-fa40986276fa admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:57.033054 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4221090-1f72-41eb-8e2a-fa40986276fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:57.033389 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4221090-1f72-41eb-8e2a-fa40986276fa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:57.038540 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fa1f0-9bab-4369-ba91-aecde12f15fa admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:57.050143 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4221090-1f72-41eb-8e2a-fa40986276fa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:57.050609 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fa1f0-9bab-4369-ba91-aecde12f15fa admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:57.052151 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4221090-1f72-41eb-8e2a-fa40986276fa admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:57.056326 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15923d71-d8ef-4f13-9795-969c7decc9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:57.057745 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15923d71-d8ef-4f13-9795-969c7decc9af admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:57.058293 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15923d71-d8ef-4f13-9795-969c7decc9af admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:57.058714 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15923d71-d8ef-4f13-9795-969c7decc9af admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:57.059840 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15923d71-d8ef-4f13-9795-969c7decc9af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:57.060351 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15923d71-d8ef-4f13-9795-969c7decc9af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:57.062365 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15923d71-d8ef-4f13-9795-969c7decc9af admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:57.076710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-e4221090-1f72-41eb-8e2a-fa40986276fa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:13:57.077583 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 285/563] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:57.081565 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 279/564] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:13:57.084080 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15923d71-d8ef-4f13-9795-969c7decc9af admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:57.090255 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4221090-1f72-41eb-8e2a-fa40986276fa admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:57.097357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15923d71-d8ef-4f13-9795-969c7decc9af admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:57.102643 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4221090-1f72-41eb-8e2a-fa40986276fa admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:57.103161 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d546b-5292-4b51-9af5-b360119c6a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:57.104418 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d546b-5292-4b51-9af5-b360119c6a04 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:57.104939 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d546b-5292-4b51-9af5-b360119c6a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:57.105452 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d546b-5292-4b51-9af5-b360119c6a04 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:57.108442 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52008b-3245-4249-8af3-2cb3ae8897b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:57.109312 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52008b-3245-4249-8af3-2cb3ae8897b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:57.109667 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52008b-3245-4249-8af3-2cb3ae8897b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:57.109996 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52008b-3245-4249-8af3-2cb3ae8897b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:57.110904 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52008b-3245-4249-8af3-2cb3ae8897b1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:57.111280 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52008b-3245-4249-8af3-2cb3ae8897b1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:57.113336 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52008b-3245-4249-8af3-2cb3ae8897b1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:57.121384 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d546b-5292-4b51-9af5-b360119c6a04 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:57.124745 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d546b-5292-4b51-9af5-b360119c6a04 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:57.127104 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 280/565] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:13:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:57.134053 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52008b-3245-4249-8af3-2cb3ae8897b1 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:57.142000 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-240d546b-5292-4b51-9af5-b360119c6a04 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 01:13:57.143721 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 286/566] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:13:57 2021] GET /identity/v3/users/swift => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:13:57.146568 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52008b-3245-4249-8af3-2cb3ae8897b1 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:57.150894 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d546b-5292-4b51-9af5-b360119c6a04 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:57.152026 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93058a2-fa74-4ab6-b879-2343175fb32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:57.152699 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93058a2-fa74-4ab6-b879-2343175fb32a admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:57.153035 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93058a2-fa74-4ab6-b879-2343175fb32a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:57.153950 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93058a2-fa74-4ab6-b879-2343175fb32a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:57.155348 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93058a2-fa74-4ab6-b879-2343175fb32a admin admin] RBAC: Adding query filter params (role.id=c72f13c7e83e471b8cc350d318503763, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=2e2182e4d74047a399e7ffea63e7ce6e) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:57.155669 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93058a2-fa74-4ab6-b879-2343175fb32a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:57.158731 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93058a2-fa74-4ab6-b879-2343175fb32a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:57.162591 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d546b-5292-4b51-9af5-b360119c6a04 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:57.166170 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 281/567] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:57 2021] GET /identity/v3/role_assignments?user.id=2e2182e4d74047a399e7ffea63e7ce6e&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=c72f13c7e83e471b8cc350d318503763 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:57.167993 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3ee84-1adb-4a13-b5e5-729bb192e437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:57.168778 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3ee84-1adb-4a13-b5e5-729bb192e437 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:57.169347 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3ee84-1adb-4a13-b5e5-729bb192e437 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:57.169451 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3ee84-1adb-4a13-b5e5-729bb192e437 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:57.170420 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3ee84-1adb-4a13-b5e5-729bb192e437 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:57.170735 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3ee84-1adb-4a13-b5e5-729bb192e437 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:57.172684 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3ee84-1adb-4a13-b5e5-729bb192e437 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:57.195419 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 287/568] 10.222.0.25 () {56 vars in 1157 bytes} [Fri Aug 27 01:13:57 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:57.203250 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93058a2-fa74-4ab6-b879-2343175fb32a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:57.214702 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93058a2-fa74-4ab6-b879-2343175fb32a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:57.221064 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb740f2-10ea-4331-add4-d1fa366fe07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:57.222049 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb740f2-10ea-4331-add4-d1fa366fe07b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:57.222329 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb740f2-10ea-4331-add4-d1fa366fe07b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:57.222692 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb740f2-10ea-4331-add4-d1fa366fe07b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:57.235126 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb740f2-10ea-4331-add4-d1fa366fe07b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:57.237107 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb740f2-10ea-4331-add4-d1fa366fe07b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:57.264540 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-bbb740f2-10ea-4331-add4-d1fa366fe07b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:57.266306 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 282/569] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:57.272619 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3ee84-1adb-4a13-b5e5-729bb192e437 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:57.285495 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3ee84-1adb-4a13-b5e5-729bb192e437 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:57.297448 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0f40e-faf0-4680-a048-7084aea1fa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:57.299695 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0f40e-faf0-4680-a048-7084aea1fa14 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:57.299991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0f40e-faf0-4680-a048-7084aea1fa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:57.300324 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0f40e-faf0-4680-a048-7084aea1fa14 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:57.304646 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0f40e-faf0-4680-a048-7084aea1fa14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:57.304646 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0f40e-faf0-4680-a048-7084aea1fa14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:57.306381 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0f40e-faf0-4680-a048-7084aea1fa14 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:57.328960 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 288/570] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:57.335747 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb740f2-10ea-4331-add4-d1fa366fe07b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:57.350820 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb740f2-10ea-4331-add4-d1fa366fe07b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:57.359003 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8731050-45af-4b10-93ea-cdda10701b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:57.359928 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8731050-45af-4b10-93ea-cdda10701b0b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:57.360308 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8731050-45af-4b10-93ea-cdda10701b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:57.360679 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8731050-45af-4b10-93ea-cdda10701b0b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:57.368867 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8731050-45af-4b10-93ea-cdda10701b0b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:57.370952 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8731050-45af-4b10-93ea-cdda10701b0b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:57.385749 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-b8731050-45af-4b10-93ea-cdda10701b0b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:13:57.387368 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 283/571] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:57.394297 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0f40e-faf0-4680-a048-7084aea1fa14 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:57.405909 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0f40e-faf0-4680-a048-7084aea1fa14 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:57.410493 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc1116-0fb2-4eab-90dc-ec930a94238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:57.411157 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc1116-0fb2-4eab-90dc-ec930a94238d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:57.411441 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc1116-0fb2-4eab-90dc-ec930a94238d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:57.411773 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc1116-0fb2-4eab-90dc-ec930a94238d admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:57.412572 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc1116-0fb2-4eab-90dc-ec930a94238d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:57.412961 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc1116-0fb2-4eab-90dc-ec930a94238d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:57.414897 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc1116-0fb2-4eab-90dc-ec930a94238d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:57.430157 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 289/572] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:13:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:57.437275 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8731050-45af-4b10-93ea-cdda10701b0b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:57.451426 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8731050-45af-4b10-93ea-cdda10701b0b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:57.459001 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddecd2c-f4d4-45e4-be7f-5120718478d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:57.460063 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddecd2c-f4d4-45e4-be7f-5120718478d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:57.460445 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddecd2c-f4d4-45e4-be7f-5120718478d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:57.460817 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddecd2c-f4d4-45e4-be7f-5120718478d5 admin admin] PATH_INFO: `/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/d48536f4437240b79cf10961de9cc108/roles/c72f13c7e83e471b8cc350d318503763` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:57.481988 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddecd2c-f4d4-45e4-be7f-5120718478d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0094d4fd0a114a2cbf5919f2a0e88e82, user_id=d48536f4437240b79cf10961de9cc108, role_id=c72f13c7e83e471b8cc350d318503763)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:57.485420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddecd2c-f4d4-45e4-be7f-5120718478d5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:57.650678 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 284/573] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:13:57 2021] PUT /identity/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/d48536f4437240b79cf10961de9cc108/roles/c72f13c7e83e471b8cc350d318503763 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:13:58.494532 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14abdb-850c-4393-9489-eddd8be33dd1 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:58.495168 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14abdb-850c-4393-9489-eddd8be33dd1 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:58.495168 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14abdb-850c-4393-9489-eddd8be33dd1 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:58.497155 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 290/574] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:58.503635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf7de5-288c-4f2c-a436-783dc9bb14fd None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:58.504136 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf7de5-288c-4f2c-a436-783dc9bb14fd None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:58.504288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf7de5-288c-4f2c-a436-783dc9bb14fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:58.525053 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-93cf7de5-288c-4f2c-a436-783dc9bb14fd None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:58.526288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-93cf7de5-288c-4f2c-a436-783dc9bb14fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:58.601213 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 285/575] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:58.650332 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14abdb-850c-4393-9489-eddd8be33dd1 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:58.669898 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14abdb-850c-4393-9489-eddd8be33dd1 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:58.674484 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c8cb1-e8f8-4d77-a470-4601ac78496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:58.675276 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c8cb1-e8f8-4d77-a470-4601ac78496f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:58.675557 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c8cb1-e8f8-4d77-a470-4601ac78496f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:58.675832 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c8cb1-e8f8-4d77-a470-4601ac78496f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:58.691628 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c8cb1-e8f8-4d77-a470-4601ac78496f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:13:58.698630 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-c81c8cb1-e8f8-4d77-a470-4601ac78496f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:13:58.700028 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 291/576] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:13:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:58.707372 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf7de5-288c-4f2c-a436-783dc9bb14fd None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:58.721396 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf7de5-288c-4f2c-a436-783dc9bb14fd None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:58.728785 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b102a8-f48b-4d19-8c07-862b866df74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:58.729514 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b102a8-f48b-4d19-8c07-862b866df74b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:58.729805 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b102a8-f48b-4d19-8c07-862b866df74b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:58.730081 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b102a8-f48b-4d19-8c07-862b866df74b admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:58.730822 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b102a8-f48b-4d19-8c07-862b866df74b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:58.731123 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b102a8-f48b-4d19-8c07-862b866df74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:58.733020 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b102a8-f48b-4d19-8c07-862b866df74b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:58.744160 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 286/577] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:13:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:58.751380 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c8cb1-e8f8-4d77-a470-4601ac78496f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:58.766065 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c8cb1-e8f8-4d77-a470-4601ac78496f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:58.776786 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ee52b-3ad5-4372-8a15-aecd95d193de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:58.777827 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ee52b-3ad5-4372-8a15-aecd95d193de admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:58.779074 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ee52b-3ad5-4372-8a15-aecd95d193de admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:58.779549 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ee52b-3ad5-4372-8a15-aecd95d193de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:58.800477 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ee52b-3ad5-4372-8a15-aecd95d193de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:58.802656 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ee52b-3ad5-4372-8a15-aecd95d193de admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:58.825208 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-bb7ee52b-3ad5-4372-8a15-aecd95d193de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:58.826801 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 292/578] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:58.833716 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b102a8-f48b-4d19-8c07-862b866df74b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:58.850176 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b102a8-f48b-4d19-8c07-862b866df74b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:58.862013 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9b825-321e-4524-b95c-6ebfa9d04826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:58.862681 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9b825-321e-4524-b95c-6ebfa9d04826 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:58.862959 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9b825-321e-4524-b95c-6ebfa9d04826 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:58.863230 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9b825-321e-4524-b95c-6ebfa9d04826 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:58.863948 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9b825-321e-4524-b95c-6ebfa9d04826 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:58.864252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9b825-321e-4524-b95c-6ebfa9d04826 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:58.865926 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9b825-321e-4524-b95c-6ebfa9d04826 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:58.880333 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 287/579] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:58.886442 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ee52b-3ad5-4372-8a15-aecd95d193de admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:58.901739 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ee52b-3ad5-4372-8a15-aecd95d193de admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:58.909231 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426331df-132f-4f68-8ef6-75f68e0b6f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:58.910029 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426331df-132f-4f68-8ef6-75f68e0b6f29 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:58.910314 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426331df-132f-4f68-8ef6-75f68e0b6f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:58.910593 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426331df-132f-4f68-8ef6-75f68e0b6f29 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:58.920597 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426331df-132f-4f68-8ef6-75f68e0b6f29 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:58.922654 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426331df-132f-4f68-8ef6-75f68e0b6f29 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:58.939886 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-426331df-132f-4f68-8ef6-75f68e0b6f29 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 01:13:58.941118 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 293/580] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Aug 27 01:13:58 2021] GET /identity/v3/users/nova => generated 82 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:58.947485 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9b825-321e-4524-b95c-6ebfa9d04826 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:58.959148 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9b825-321e-4524-b95c-6ebfa9d04826 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:58.967855 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c329345-7b60-41e4-890c-c606d53bcd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:58.968580 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c329345-7b60-41e4-890c-c606d53bcd1b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:58.968892 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c329345-7b60-41e4-890c-c606d53bcd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:58.969179 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c329345-7b60-41e4-890c-c606d53bcd1b admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:58.970022 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c329345-7b60-41e4-890c-c606d53bcd1b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:58.970335 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c329345-7b60-41e4-890c-c606d53bcd1b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:58.972252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c329345-7b60-41e4-890c-c606d53bcd1b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:58.996933 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 288/581] 10.222.0.25 () {56 vars in 1155 bytes} [Fri Aug 27 01:13:58 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:59.003940 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426331df-132f-4f68-8ef6-75f68e0b6f29 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:59.015105 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426331df-132f-4f68-8ef6-75f68e0b6f29 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:59.025041 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4effccb-a427-4987-91c8-c6b5a9942832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:59.025826 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4effccb-a427-4987-91c8-c6b5a9942832 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:59.026116 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4effccb-a427-4987-91c8-c6b5a9942832 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:59.026396 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4effccb-a427-4987-91c8-c6b5a9942832 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:59.038092 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4effccb-a427-4987-91c8-c6b5a9942832 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:59.039855 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4effccb-a427-4987-91c8-c6b5a9942832 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:59.051535 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 294/582] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:13:59 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:13:59.057686 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c329345-7b60-41e4-890c-c606d53bcd1b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:59.068512 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c329345-7b60-41e4-890c-c606d53bcd1b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:59.078104 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865adcce-feec-4234-8bc5-c64a8f127baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:59.079002 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865adcce-feec-4234-8bc5-c64a8f127baa admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:59.079291 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865adcce-feec-4234-8bc5-c64a8f127baa admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:59.079568 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865adcce-feec-4234-8bc5-c64a8f127baa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:59.093477 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865adcce-feec-4234-8bc5-c64a8f127baa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:59.095385 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865adcce-feec-4234-8bc5-c64a8f127baa admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:59.123895 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-865adcce-feec-4234-8bc5-c64a8f127baa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:59.125352 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 289/583] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:59.131559 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4effccb-a427-4987-91c8-c6b5a9942832 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:59.144009 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4effccb-a427-4987-91c8-c6b5a9942832 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:59.148702 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd709fbc-09fe-461a-bae7-562f551db56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:59.149389 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd709fbc-09fe-461a-bae7-562f551db56b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:59.149674 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd709fbc-09fe-461a-bae7-562f551db56b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:59.149954 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd709fbc-09fe-461a-bae7-562f551db56b admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:59.150672 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd709fbc-09fe-461a-bae7-562f551db56b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:59.150985 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd709fbc-09fe-461a-bae7-562f551db56b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:59.152704 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd709fbc-09fe-461a-bae7-562f551db56b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:59.175242 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 295/584] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:59.183531 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865adcce-feec-4234-8bc5-c64a8f127baa admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:59.195156 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865adcce-feec-4234-8bc5-c64a8f127baa admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:59.205741 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1994e-3aff-4409-a8f0-aea58cfbff82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:59.206538 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1994e-3aff-4409-a8f0-aea58cfbff82 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:59.206820 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1994e-3aff-4409-a8f0-aea58cfbff82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:59.207098 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1994e-3aff-4409-a8f0-aea58cfbff82 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:59.214704 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1994e-3aff-4409-a8f0-aea58cfbff82 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:59.217350 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1994e-3aff-4409-a8f0-aea58cfbff82 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:59.237136 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-a5e1994e-3aff-4409-a8f0-aea58cfbff82 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:13:59.238659 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 290/585] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:13:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:59.244804 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd709fbc-09fe-461a-bae7-562f551db56b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:59.258263 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd709fbc-09fe-461a-bae7-562f551db56b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:59.268252 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7565d-261e-4f26-9e13-a3327db52965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:59.268939 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7565d-261e-4f26-9e13-a3327db52965 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:59.269229 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7565d-261e-4f26-9e13-a3327db52965 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:59.269512 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7565d-261e-4f26-9e13-a3327db52965 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:59.270305 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7565d-261e-4f26-9e13-a3327db52965 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:59.270615 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7565d-261e-4f26-9e13-a3327db52965 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:59.272597 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7565d-261e-4f26-9e13-a3327db52965 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:59.297250 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 296/586] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:13:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:59.303854 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1994e-3aff-4409-a8f0-aea58cfbff82 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:59.319031 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1994e-3aff-4409-a8f0-aea58cfbff82 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:59.328986 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce426c-b7c1-4bd7-8a3f-9d7ce8c4acb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:59.329900 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce426c-b7c1-4bd7-8a3f-9d7ce8c4acb5 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:59.330186 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce426c-b7c1-4bd7-8a3f-9d7ce8c4acb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:59.330459 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce426c-b7c1-4bd7-8a3f-9d7ce8c4acb5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:59.331285 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce426c-b7c1-4bd7-8a3f-9d7ce8c4acb5 admin admin] RBAC: Adding query filter params (role.id=faadc5010ffb447ba5280e491c2ea2f5, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=249a7642a0284dde91a7719f732b2d70) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:59.331592 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce426c-b7c1-4bd7-8a3f-9d7ce8c4acb5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:59.333444 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce426c-b7c1-4bd7-8a3f-9d7ce8c4acb5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:59.344200 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 291/587] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:13:59 2021] GET /identity/v3/role_assignments?user.id=249a7642a0284dde91a7719f732b2d70&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=faadc5010ffb447ba5280e491c2ea2f5 => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:59.647525 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a26c9-2ab4-485b-b957-aede626eae9c None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:59.648210 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a26c9-2ab4-485b-b957-aede626eae9c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:59.648210 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a26c9-2ab4-485b-b957-aede626eae9c None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:59.650105 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 297/588] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:59.659327 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c11e0-4c12-4f85-afeb-7d5096c1a17b None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:59.659327 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c11e0-4c12-4f85-afeb-7d5096c1a17b None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:59.659327 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c11e0-4c12-4f85-afeb-7d5096c1a17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:59.677884 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-676c11e0-4c12-4f85-afeb-7d5096c1a17b None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:59.679428 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-676c11e0-4c12-4f85-afeb-7d5096c1a17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:59.690435 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 292/589] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:13:59.716118 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a26c9-2ab4-485b-b957-aede626eae9c None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:59.738674 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a26c9-2ab4-485b-b957-aede626eae9c None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:59.749500 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44939a0e-0621-4d91-9fa1-a9cf67d41fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:59.750310 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44939a0e-0621-4d91-9fa1-a9cf67d41fca admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:59.750596 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44939a0e-0621-4d91-9fa1-a9cf67d41fca admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:59.750877 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44939a0e-0621-4d91-9fa1-a9cf67d41fca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:59.765969 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44939a0e-0621-4d91-9fa1-a9cf67d41fca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:59.767802 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44939a0e-0621-4d91-9fa1-a9cf67d41fca admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:59.783486 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104f491-ef6b-4520-a4e3-b9d9bc2062e8 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:59.784085 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104f491-ef6b-4520-a4e3-b9d9bc2062e8 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:59.784582 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104f491-ef6b-4520-a4e3-b9d9bc2062e8 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:59.786826 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 293/590] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:13:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:13:59.789366 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-44939a0e-0621-4d91-9fa1-a9cf67d41fca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:13:59.789366 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 298/591] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:13:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:13:59.792770 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fd3c2-2b92-4f23-b2ea-4184b4fed05e None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:59.793080 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fd3c2-2b92-4f23-b2ea-4184b4fed05e None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:59.793356 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fd3c2-2b92-4f23-b2ea-4184b4fed05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:59.798546 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44939a0e-0621-4d91-9fa1-a9cf67d41fca admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:59.814404 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44939a0e-0621-4d91-9fa1-a9cf67d41fca admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:59.816718 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-3e9fd3c2-2b92-4f23-b2ea-4184b4fed05e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:13:59.817937 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-3e9fd3c2-2b92-4f23-b2ea-4184b4fed05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:13:59.824297 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38109736-5bb3-4d89-8e82-c8dd55b88dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:59.825556 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38109736-5bb3-4d89-8e82-c8dd55b88dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:59.825883 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38109736-5bb3-4d89-8e82-c8dd55b88dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:59.826161 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38109736-5bb3-4d89-8e82-c8dd55b88dd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:59.826886 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38109736-5bb3-4d89-8e82-c8dd55b88dd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:59.827192 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38109736-5bb3-4d89-8e82-c8dd55b88dd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:59.828781 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38109736-5bb3-4d89-8e82-c8dd55b88dd9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:59.839465 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 294/592] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:13:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:13:59.855324 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 299/593] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:13:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:13:59.861489 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fd3c2-2b92-4f23-b2ea-4184b4fed05e None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:59.865527 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38109736-5bb3-4d89-8e82-c8dd55b88dd9 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:59.871165 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fd3c2-2b92-4f23-b2ea-4184b4fed05e None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:59.877091 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38109736-5bb3-4d89-8e82-c8dd55b88dd9 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:59.881537 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13fbfa-8faa-4974-b9bc-6936080b2f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:59.882210 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13fbfa-8faa-4974-b9bc-6936080b2f04 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:59.882492 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13fbfa-8faa-4974-b9bc-6936080b2f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:59.882761 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13fbfa-8faa-4974-b9bc-6936080b2f04 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:59.883481 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13fbfa-8faa-4974-b9bc-6936080b2f04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:59.885408 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13fbfa-8faa-4974-b9bc-6936080b2f04 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:59.897128 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc88ccd-6e0a-488b-92a6-6ada5a0520c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:59.897992 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc88ccd-6e0a-488b-92a6-6ada5a0520c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:59.898215 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc88ccd-6e0a-488b-92a6-6ada5a0520c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:59.898490 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc88ccd-6e0a-488b-92a6-6ada5a0520c9 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:59.899149 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc88ccd-6e0a-488b-92a6-6ada5a0520c9 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:59.900150 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING py.warnings [None req-9fc88ccd-6e0a-488b-92a6-6ada5a0520c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:59.900150 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: warnings.warn(msg) Aug 27 01:13:59.900150 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: Aug 27 01:13:59.901051 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc88ccd-6e0a-488b-92a6-6ada5a0520c9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:59.917055 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-9fc88ccd-6e0a-488b-92a6-6ada5a0520c9 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 01:13:59.918549 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 300/594] 10.222.0.25 () {56 vars in 1151 bytes} [Fri Aug 27 01:13:59 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:13:59.926515 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc88ccd-6e0a-488b-92a6-6ada5a0520c9 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:59.938009 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc88ccd-6e0a-488b-92a6-6ada5a0520c9 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:59.943254 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cbbe3-99b1-40c4-8ef1-efe686ea647f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:59.943966 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cbbe3-99b1-40c4-8ef1-efe686ea647f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:59.944251 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cbbe3-99b1-40c4-8ef1-efe686ea647f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:59.944529 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cbbe3-99b1-40c4-8ef1-efe686ea647f admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:59.945383 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cbbe3-99b1-40c4-8ef1-efe686ea647f admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:59.945789 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cbbe3-99b1-40c4-8ef1-efe686ea647f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:59.946873 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING py.warnings [None req-e36cbbe3-99b1-40c4-8ef1-efe686ea647f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:13:59.946873 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: warnings.warn(msg) Aug 27 01:13:59.946873 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: Aug 27 01:13:59.947947 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cbbe3-99b1-40c4-8ef1-efe686ea647f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:59.959587 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 301/595] 10.222.0.25 () {56 vars in 1146 bytes} [Fri Aug 27 01:13:59 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:13:59.960870 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cbbe3-99b1-40c4-8ef1-efe686ea647f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:13:59.971899 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cbbe3-99b1-40c4-8ef1-efe686ea647f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:13:59.976992 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52721d-80e7-4b67-82e7-8ce00c265fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:13:59.977774 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52721d-80e7-4b67-82e7-8ce00c265fcc admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:13:59.978059 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52721d-80e7-4b67-82e7-8ce00c265fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:13:59.980991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52721d-80e7-4b67-82e7-8ce00c265fcc admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:13:59.980991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52721d-80e7-4b67-82e7-8ce00c265fcc admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:13:59.980991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52721d-80e7-4b67-82e7-8ce00c265fcc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:13:59.982491 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52721d-80e7-4b67-82e7-8ce00c265fcc admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:13:59.984285 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 295/596] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 01:13:59 2021] POST /identity/v3/users => generated 254 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:13:59.994817 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 302/597] 10.222.0.25 () {56 vars in 1146 bytes} [Fri Aug 27 01:13:59 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:00.169370 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d031f8-76a1-472e-89a0-ade0e5bc5d80 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:00.169699 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d031f8-76a1-472e-89a0-ade0e5bc5d80 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:00.169942 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d031f8-76a1-472e-89a0-ade0e5bc5d80 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:00.172392 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 296/598] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:00.178944 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5899cd-0088-426d-9bbf-abfe04e6fd64 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:00.179276 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5899cd-0088-426d-9bbf-abfe04e6fd64 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:00.179506 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5899cd-0088-426d-9bbf-abfe04e6fd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:00.199421 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-3c5899cd-0088-426d-9bbf-abfe04e6fd64 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:00.201369 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-3c5899cd-0088-426d-9bbf-abfe04e6fd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:00.219281 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 303/599] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:00.243590 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d031f8-76a1-472e-89a0-ade0e5bc5d80 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:00.257801 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d031f8-76a1-472e-89a0-ade0e5bc5d80 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:00.263350 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458253a-d755-4182-afdb-ff5f61583e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:00.264118 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458253a-d755-4182-afdb-ff5f61583e67 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:00.264400 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458253a-d755-4182-afdb-ff5f61583e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:00.264675 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458253a-d755-4182-afdb-ff5f61583e67 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:00.265388 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458253a-d755-4182-afdb-ff5f61583e67 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:00.266395 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING py.warnings [None req-9458253a-d755-4182-afdb-ff5f61583e67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:14:00.266395 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: warnings.warn(msg) Aug 27 01:14:00.266395 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: Aug 27 01:14:00.267278 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458253a-d755-4182-afdb-ff5f61583e67 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:00.281146 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-9458253a-d755-4182-afdb-ff5f61583e67 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 01:14:00.282521 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 297/600] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:00 2021] GET /identity/v3/services/network => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:00.289211 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5899cd-0088-426d-9bbf-abfe04e6fd64 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:00.298440 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5899cd-0088-426d-9bbf-abfe04e6fd64 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:00.303018 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633172a-89dd-4245-9dde-e65880b69063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:00.303683 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633172a-89dd-4245-9dde-e65880b69063 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:00.303957 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633172a-89dd-4245-9dde-e65880b69063 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:00.304232 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633172a-89dd-4245-9dde-e65880b69063 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:00.304970 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633172a-89dd-4245-9dde-e65880b69063 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:00.305278 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633172a-89dd-4245-9dde-e65880b69063 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:00.306857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633172a-89dd-4245-9dde-e65880b69063 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:00.312209 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 304/601] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 01:14:00 2021] GET /identity/v3/services?name=network => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:00.318225 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458253a-d755-4182-afdb-ff5f61583e67 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:00.328389 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458253a-d755-4182-afdb-ff5f61583e67 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:00.333268 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2ec08-350f-437e-a847-73a95aa9006e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:00.333926 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2ec08-350f-437e-a847-73a95aa9006e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:00.334207 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2ec08-350f-437e-a847-73a95aa9006e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:00.334481 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2ec08-350f-437e-a847-73a95aa9006e admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:00.335191 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2ec08-350f-437e-a847-73a95aa9006e admin admin] RBAC: Adding query filter params (type=network) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:00.335497 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2ec08-350f-437e-a847-73a95aa9006e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:00.336777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING py.warnings [None req-20a2ec08-350f-437e-a847-73a95aa9006e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:14:00.336777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: warnings.warn(msg) Aug 27 01:14:00.336777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: Aug 27 01:14:00.337688 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2ec08-350f-437e-a847-73a95aa9006e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:00.345281 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 298/602] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 01:14:00 2021] GET /identity/v3/services?type=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:00.469360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d1ca5-5525-4803-b65d-a3e9083f560e None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:00.469648 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d1ca5-5525-4803-b65d-a3e9083f560e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:00.469827 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d1ca5-5525-4803-b65d-a3e9083f560e None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:00.472079 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 305/603] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:00.477973 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721a656-34dd-45a3-87b9-e89a82d7d19c None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:00.478260 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721a656-34dd-45a3-87b9-e89a82d7d19c None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:00.478540 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721a656-34dd-45a3-87b9-e89a82d7d19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:00.500038 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b721a656-34dd-45a3-87b9-e89a82d7d19c None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:00.501308 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b721a656-34dd-45a3-87b9-e89a82d7d19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:00.509641 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 299/604] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:00.535318 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d1ca5-5525-4803-b65d-a3e9083f560e None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:00.548403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d1ca5-5525-4803-b65d-a3e9083f560e None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:00.553918 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed533f6-3f60-4a17-95d9-e2e709010f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:00.554712 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed533f6-3f60-4a17-95d9-e2e709010f29 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:00.554993 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed533f6-3f60-4a17-95d9-e2e709010f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:00.555266 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed533f6-3f60-4a17-95d9-e2e709010f29 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:00.567624 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed533f6-3f60-4a17-95d9-e2e709010f29 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:14:00.574426 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-9ed533f6-3f60-4a17-95d9-e2e709010f29 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:14:00.576026 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 306/605] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:14:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:00.582588 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721a656-34dd-45a3-87b9-e89a82d7d19c None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:00.592075 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721a656-34dd-45a3-87b9-e89a82d7d19c None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:00.600328 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a88db-db7a-4368-b52d-795a965a0f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:00.601047 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a88db-db7a-4368-b52d-795a965a0f72 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:00.601334 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a88db-db7a-4368-b52d-795a965a0f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:00.601614 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a88db-db7a-4368-b52d-795a965a0f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:00.602371 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a88db-db7a-4368-b52d-795a965a0f72 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:00.602682 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a88db-db7a-4368-b52d-795a965a0f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:00.604274 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a88db-db7a-4368-b52d-795a965a0f72 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:00.614974 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 300/606] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:14:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:00.621134 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed533f6-3f60-4a17-95d9-e2e709010f29 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:00.633908 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed533f6-3f60-4a17-95d9-e2e709010f29 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:00.642013 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d69881-4fc9-41a5-9b48-854812b7e649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:00.642797 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d69881-4fc9-41a5-9b48-854812b7e649 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:00.643077 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d69881-4fc9-41a5-9b48-854812b7e649 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:00.643349 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d69881-4fc9-41a5-9b48-854812b7e649 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:00.664509 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d69881-4fc9-41a5-9b48-854812b7e649 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:00.666377 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d69881-4fc9-41a5-9b48-854812b7e649 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:00.683654 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-77d69881-4fc9-41a5-9b48-854812b7e649 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:00.685406 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 307/607] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:00.691679 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a88db-db7a-4368-b52d-795a965a0f72 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:00.707426 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a88db-db7a-4368-b52d-795a965a0f72 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:00.721437 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162e4f4-ea84-4c80-8520-36f4b3568e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:00.722052 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162e4f4-ea84-4c80-8520-36f4b3568e8d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:00.722344 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162e4f4-ea84-4c80-8520-36f4b3568e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:00.722623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162e4f4-ea84-4c80-8520-36f4b3568e8d admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:00.723355 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162e4f4-ea84-4c80-8520-36f4b3568e8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:00.723666 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162e4f4-ea84-4c80-8520-36f4b3568e8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:00.725295 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162e4f4-ea84-4c80-8520-36f4b3568e8d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:00.743593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 301/608] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:00.755486 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d69881-4fc9-41a5-9b48-854812b7e649 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:00.771369 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d69881-4fc9-41a5-9b48-854812b7e649 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:00.781368 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686823db-5fda-40e7-b6b1-6909524bcbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:00.782162 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686823db-5fda-40e7-b6b1-6909524bcbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:00.782439 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686823db-5fda-40e7-b6b1-6909524bcbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:00.782713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686823db-5fda-40e7-b6b1-6909524bcbd1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:00.801975 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686823db-5fda-40e7-b6b1-6909524bcbd1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:00.803988 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686823db-5fda-40e7-b6b1-6909524bcbd1 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:00.821203 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-686823db-5fda-40e7-b6b1-6909524bcbd1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 01:14:00.822675 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 308/609] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:14:00 2021] GET /identity/v3/users/swift => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:00.829923 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162e4f4-ea84-4c80-8520-36f4b3568e8d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:00.843080 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162e4f4-ea84-4c80-8520-36f4b3568e8d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:00.857487 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a777bf7-0c6a-444f-97c0-629ef99091ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:00.858172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a777bf7-0c6a-444f-97c0-629ef99091ed admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:00.858458 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a777bf7-0c6a-444f-97c0-629ef99091ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:00.858738 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a777bf7-0c6a-444f-97c0-629ef99091ed admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:00.859581 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a777bf7-0c6a-444f-97c0-629ef99091ed admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:00.859894 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a777bf7-0c6a-444f-97c0-629ef99091ed admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:00.861781 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a777bf7-0c6a-444f-97c0-629ef99091ed admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:00.880277 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 302/610] 10.222.0.25 () {56 vars in 1157 bytes} [Fri Aug 27 01:14:00 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:00.886504 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686823db-5fda-40e7-b6b1-6909524bcbd1 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:00.900360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686823db-5fda-40e7-b6b1-6909524bcbd1 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:00.910273 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b2f95-6b3f-4b14-87f1-7f1aa637f34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:00.910920 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b2f95-6b3f-4b14-87f1-7f1aa637f34e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:00.911198 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b2f95-6b3f-4b14-87f1-7f1aa637f34e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:00.911469 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b2f95-6b3f-4b14-87f1-7f1aa637f34e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:00.924967 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b2f95-6b3f-4b14-87f1-7f1aa637f34e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:00.926697 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b2f95-6b3f-4b14-87f1-7f1aa637f34e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:00.938617 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 309/611] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:14:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:14:00.945034 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a777bf7-0c6a-444f-97c0-629ef99091ed admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:00.955153 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a777bf7-0c6a-444f-97c0-629ef99091ed admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:00.968718 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3d4b9-ef72-4538-bae2-6d9b75b93458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:00.969539 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3d4b9-ef72-4538-bae2-6d9b75b93458 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:00.969825 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3d4b9-ef72-4538-bae2-6d9b75b93458 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:00.970099 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3d4b9-ef72-4538-bae2-6d9b75b93458 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:00.983081 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3d4b9-ef72-4538-bae2-6d9b75b93458 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:00.984866 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3d4b9-ef72-4538-bae2-6d9b75b93458 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:01.009308 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-5ac3d4b9-ef72-4538-bae2-6d9b75b93458 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:01.010844 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 303/612] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:01.017182 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b2f95-6b3f-4b14-87f1-7f1aa637f34e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:01.039675 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b2f95-6b3f-4b14-87f1-7f1aa637f34e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:01.056291 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f387cf-1209-4dad-9e34-e961aa8a5b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:01.056992 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f387cf-1209-4dad-9e34-e961aa8a5b62 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:01.057272 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f387cf-1209-4dad-9e34-e961aa8a5b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:01.057544 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f387cf-1209-4dad-9e34-e961aa8a5b62 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:01.058262 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f387cf-1209-4dad-9e34-e961aa8a5b62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:01.058563 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f387cf-1209-4dad-9e34-e961aa8a5b62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:01.060189 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f387cf-1209-4dad-9e34-e961aa8a5b62 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:01.080145 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 310/613] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:01.086312 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3d4b9-ef72-4538-bae2-6d9b75b93458 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:01.097189 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3d4b9-ef72-4538-bae2-6d9b75b93458 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:01.114521 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa60aee-66ab-4f77-a59d-31ef48349ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:01.115325 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa60aee-66ab-4f77-a59d-31ef48349ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:01.115610 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa60aee-66ab-4f77-a59d-31ef48349ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:01.115886 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa60aee-66ab-4f77-a59d-31ef48349ab1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:01.128082 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa60aee-66ab-4f77-a59d-31ef48349ab1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:01.130081 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa60aee-66ab-4f77-a59d-31ef48349ab1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:01.149692 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-5fa60aee-66ab-4f77-a59d-31ef48349ab1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:14:01.151188 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 304/614] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:01.158145 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f387cf-1209-4dad-9e34-e961aa8a5b62 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:01.174381 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f387cf-1209-4dad-9e34-e961aa8a5b62 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:01.185124 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cc583-59a0-4a33-b0ec-243d3d9ba134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:01.185792 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cc583-59a0-4a33-b0ec-243d3d9ba134 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:01.186073 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cc583-59a0-4a33-b0ec-243d3d9ba134 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:01.186349 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cc583-59a0-4a33-b0ec-243d3d9ba134 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:01.187134 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cc583-59a0-4a33-b0ec-243d3d9ba134 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:01.187440 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cc583-59a0-4a33-b0ec-243d3d9ba134 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:01.189303 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cc583-59a0-4a33-b0ec-243d3d9ba134 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:01.210035 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 311/615] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:14:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:01.216752 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa60aee-66ab-4f77-a59d-31ef48349ab1 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:01.235792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa60aee-66ab-4f77-a59d-31ef48349ab1 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:01.240495 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcd850-88a0-403b-a68d-c0c7425c0a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:01.241170 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcd850-88a0-403b-a68d-c0c7425c0a6c admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:01.241455 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcd850-88a0-403b-a68d-c0c7425c0a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:01.241825 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcd850-88a0-403b-a68d-c0c7425c0a6c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:01.242654 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcd850-88a0-403b-a68d-c0c7425c0a6c admin admin] RBAC: Adding query filter params (role.id=c72f13c7e83e471b8cc350d318503763, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=d48536f4437240b79cf10961de9cc108) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:01.242968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcd850-88a0-403b-a68d-c0c7425c0a6c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:01.244794 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcd850-88a0-403b-a68d-c0c7425c0a6c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:01.255656 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 305/616] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:14:01 2021] GET /identity/v3/role_assignments?user.id=d48536f4437240b79cf10961de9cc108&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=c72f13c7e83e471b8cc350d318503763 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:02.174413 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bd943-c7b5-4aa7-b427-9148749280bf None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:02.175117 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bd943-c7b5-4aa7-b427-9148749280bf None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:02.175117 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bd943-c7b5-4aa7-b427-9148749280bf None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:02.177088 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 312/617] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:02.183145 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45576e8-62b7-45bb-811b-26899ddfc54f None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:02.183660 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45576e8-62b7-45bb-811b-26899ddfc54f None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:02.183815 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45576e8-62b7-45bb-811b-26899ddfc54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:02.209847 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b45576e8-62b7-45bb-811b-26899ddfc54f None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:02.211059 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b45576e8-62b7-45bb-811b-26899ddfc54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:02.222942 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 306/618] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:14:02.254141 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bd943-c7b5-4aa7-b427-9148749280bf None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:02.270458 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bd943-c7b5-4aa7-b427-9148749280bf None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:02.278583 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0703314-a5ae-4ae9-a855-0abe6845dc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:02.279382 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0703314-a5ae-4ae9-a855-0abe6845dc8f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:02.279669 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0703314-a5ae-4ae9-a855-0abe6845dc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:02.279943 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0703314-a5ae-4ae9-a855-0abe6845dc8f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:02.295072 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0703314-a5ae-4ae9-a855-0abe6845dc8f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:14:02.301467 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-f0703314-a5ae-4ae9-a855-0abe6845dc8f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:14:02.303005 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 313/619] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:14:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:02.310141 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45576e8-62b7-45bb-811b-26899ddfc54f None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:02.323135 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45576e8-62b7-45bb-811b-26899ddfc54f None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:02.332153 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6f0cb-4514-4137-a83d-2ae01558bc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:02.332853 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6f0cb-4514-4137-a83d-2ae01558bc0e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:02.333136 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6f0cb-4514-4137-a83d-2ae01558bc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:02.333419 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6f0cb-4514-4137-a83d-2ae01558bc0e admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:02.334180 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6f0cb-4514-4137-a83d-2ae01558bc0e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:02.334491 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6f0cb-4514-4137-a83d-2ae01558bc0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:02.336119 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6f0cb-4514-4137-a83d-2ae01558bc0e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:02.350116 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 307/620] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:14:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:02.357690 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0703314-a5ae-4ae9-a855-0abe6845dc8f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:02.373547 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0703314-a5ae-4ae9-a855-0abe6845dc8f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:02.384707 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbf901-3e3c-49c5-88e8-865b66c7714f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:02.385890 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbf901-3e3c-49c5-88e8-865b66c7714f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:02.386374 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbf901-3e3c-49c5-88e8-865b66c7714f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:02.386851 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbf901-3e3c-49c5-88e8-865b66c7714f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:02.404321 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bbf901-3e3c-49c5-88e8-865b66c7714f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:02.406531 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bbf901-3e3c-49c5-88e8-865b66c7714f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:02.431075 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-81bbf901-3e3c-49c5-88e8-865b66c7714f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:02.436960 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 314/621] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:02.439839 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6f0cb-4514-4137-a83d-2ae01558bc0e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:02.449621 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6f0cb-4514-4137-a83d-2ae01558bc0e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:02.455735 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b0ce9-f93f-41bd-a96a-d38a50833080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:02.456399 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b0ce9-f93f-41bd-a96a-d38a50833080 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:02.456683 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b0ce9-f93f-41bd-a96a-d38a50833080 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:02.456997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b0ce9-f93f-41bd-a96a-d38a50833080 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:02.457722 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b0ce9-f93f-41bd-a96a-d38a50833080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:02.458030 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b0ce9-f93f-41bd-a96a-d38a50833080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:02.459752 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b0ce9-f93f-41bd-a96a-d38a50833080 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:02.476946 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 308/622] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:02.478753 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbf901-3e3c-49c5-88e8-865b66c7714f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:02.489445 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbf901-3e3c-49c5-88e8-865b66c7714f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:02.493992 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2d0f7-3a50-4221-b7bf-2405c40dd953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:02.494776 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2d0f7-3a50-4221-b7bf-2405c40dd953 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:02.495060 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2d0f7-3a50-4221-b7bf-2405c40dd953 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:02.495339 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2d0f7-3a50-4221-b7bf-2405c40dd953 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:02.503966 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2d0f7-3a50-4221-b7bf-2405c40dd953 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:02.506050 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2d0f7-3a50-4221-b7bf-2405c40dd953 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:02.520808 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-bdc2d0f7-3a50-4221-b7bf-2405c40dd953 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 01:14:02.527490 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 315/623] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Aug 27 01:14:02 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:02.530109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b0ce9-f93f-41bd-a96a-d38a50833080 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:02.539931 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b0ce9-f93f-41bd-a96a-d38a50833080 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:02.545423 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c3f58-3ce6-4a54-b600-a660ca7e1bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:02.546124 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c3f58-3ce6-4a54-b600-a660ca7e1bab admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:02.546409 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c3f58-3ce6-4a54-b600-a660ca7e1bab admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:02.546688 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c3f58-3ce6-4a54-b600-a660ca7e1bab admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:02.547552 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c3f58-3ce6-4a54-b600-a660ca7e1bab admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:02.547867 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c3f58-3ce6-4a54-b600-a660ca7e1bab admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:02.549844 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c3f58-3ce6-4a54-b600-a660ca7e1bab admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:02.576204 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 309/624] 10.222.0.25 () {56 vars in 1155 bytes} [Fri Aug 27 01:14:02 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:02.581913 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2d0f7-3a50-4221-b7bf-2405c40dd953 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:02.593637 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2d0f7-3a50-4221-b7bf-2405c40dd953 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:02.598394 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c59a1d-ae93-4cf4-9141-984ef2aeb4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:02.599192 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c59a1d-ae93-4cf4-9141-984ef2aeb4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:02.599471 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c59a1d-ae93-4cf4-9141-984ef2aeb4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:02.599749 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c59a1d-ae93-4cf4-9141-984ef2aeb4f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:02.611915 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c59a1d-ae93-4cf4-9141-984ef2aeb4f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:02.613815 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c59a1d-ae93-4cf4-9141-984ef2aeb4f3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:02.633549 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-e7c59a1d-ae93-4cf4-9141-984ef2aeb4f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:02.640960 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 316/625] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:02.642537 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c3f58-3ce6-4a54-b600-a660ca7e1bab admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:02.645593 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e757527-0985-464f-b8ee-91d1634949c6 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:02.646386 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e757527-0985-464f-b8ee-91d1634949c6 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:02.647086 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e757527-0985-464f-b8ee-91d1634949c6 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:02.651043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 317/626] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:02 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:02.652787 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c3f58-3ce6-4a54-b600-a660ca7e1bab admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:02.657458 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd3530-1740-411a-a49a-d91998e3308f None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:02.658004 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd3530-1740-411a-a49a-d91998e3308f None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:02.658438 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e057f-506e-497b-99fc-b538c3816cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:02.658718 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd3530-1740-411a-a49a-d91998e3308f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:02.659143 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e057f-506e-497b-99fc-b538c3816cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:02.659431 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e057f-506e-497b-99fc-b538c3816cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:02.659713 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e057f-506e-497b-99fc-b538c3816cf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:02.660433 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e057f-506e-497b-99fc-b538c3816cf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:02.660741 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e057f-506e-497b-99fc-b538c3816cf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:02.663957 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e057f-506e-497b-99fc-b538c3816cf9 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:02.676304 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 310/627] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:02.683237 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e057f-506e-497b-99fc-b538c3816cf9 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:02.702182 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e057f-506e-497b-99fc-b538c3816cf9 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:02.702556 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-05fd3530-1740-411a-a49a-d91998e3308f None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:02.703772 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-05fd3530-1740-411a-a49a-d91998e3308f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:02.711292 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01882e-5aed-4a04-88e2-c816d8a9b3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:02.713989 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01882e-5aed-4a04-88e2-c816d8a9b3dc admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:02.714546 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01882e-5aed-4a04-88e2-c816d8a9b3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:02.715194 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01882e-5aed-4a04-88e2-c816d8a9b3dc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:02.724691 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 318/628] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:14:02.729138 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01882e-5aed-4a04-88e2-c816d8a9b3dc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:02.732660 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01882e-5aed-4a04-88e2-c816d8a9b3dc admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:02.748301 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-bf01882e-5aed-4a04-88e2-c816d8a9b3dc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:14:02.755567 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 311/629] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:02.757339 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd3530-1740-411a-a49a-d91998e3308f None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:02.769150 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd3530-1740-411a-a49a-d91998e3308f None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:02.770527 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01882e-5aed-4a04-88e2-c816d8a9b3dc admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:02.783563 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28740d71-bed7-43a9-8cd6-7fc185e75a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:02.784675 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28740d71-bed7-43a9-8cd6-7fc185e75a12 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:02.785201 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28740d71-bed7-43a9-8cd6-7fc185e75a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:02.785790 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28740d71-bed7-43a9-8cd6-7fc185e75a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:02.786782 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28740d71-bed7-43a9-8cd6-7fc185e75a12 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:02.787544 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28740d71-bed7-43a9-8cd6-7fc185e75a12 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:02.791845 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01882e-5aed-4a04-88e2-c816d8a9b3dc admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:02.792751 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28740d71-bed7-43a9-8cd6-7fc185e75a12 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:02.802310 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5577c20-46eb-4b80-aafc-24122e7e7b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:02.804956 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5577c20-46eb-4b80-aafc-24122e7e7b56 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:02.805454 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5577c20-46eb-4b80-aafc-24122e7e7b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:02.805972 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5577c20-46eb-4b80-aafc-24122e7e7b56 admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:02.806925 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5577c20-46eb-4b80-aafc-24122e7e7b56 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:02.808889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING py.warnings [None req-b5577c20-46eb-4b80-aafc-24122e7e7b56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:14:02.808889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: warnings.warn(msg) Aug 27 01:14:02.808889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: Aug 27 01:14:02.812483 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5577c20-46eb-4b80-aafc-24122e7e7b56 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:02.825435 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 319/630] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:14:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:02.831839 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6da13-22c0-4dee-bf29-ef44b1d59811 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:02.836965 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6da13-22c0-4dee-bf29-ef44b1d59811 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:02.836965 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6da13-22c0-4dee-bf29-ef44b1d59811 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:02.836965 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 320/631] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:14:02.836965 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6da13-22c0-4dee-bf29-ef44b1d59811 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:02.850562 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6da13-22c0-4dee-bf29-ef44b1d59811 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:02.855564 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d513e-3e66-4583-971c-75219fd9631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:02.857769 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d513e-3e66-4583-971c-75219fd9631e admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:02.858260 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d513e-3e66-4583-971c-75219fd9631e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:02.858740 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d513e-3e66-4583-971c-75219fd9631e admin admin] PATH_INFO: `/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/249a7642a0284dde91a7719f732b2d70/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:02.861071 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d513e-3e66-4583-971c-75219fd9631e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0094d4fd0a114a2cbf5919f2a0e88e82, user_id=249a7642a0284dde91a7719f732b2d70, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:02.865194 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d513e-3e66-4583-971c-75219fd9631e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:02.920480 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 312/632] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 01:14:02 2021] POST /identity/v3/services => generated 251 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:14:02.922314 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc8547-8f44-4e9b-991c-28b66d722a7f None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:02.922857 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc8547-8f44-4e9b-991c-28b66d722a7f None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:02.923450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc8547-8f44-4e9b-991c-28b66d722a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:02.947955 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 321/633] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:14:02 2021] PUT /identity/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/249a7642a0284dde91a7719f732b2d70/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:14:02.953296 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-51cc8547-8f44-4e9b-991c-28b66d722a7f None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:02.957071 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-51cc8547-8f44-4e9b-991c-28b66d722a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:03.057179 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 313/634] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:02 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:03.058442 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2032e-6ee7-4a62-8cdb-193263ff78a5 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:03.058734 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2032e-6ee7-4a62-8cdb-193263ff78a5 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:03.059014 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2032e-6ee7-4a62-8cdb-193263ff78a5 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:03.070155 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 322/635] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:03 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:03.072482 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9ccd7-5f55-4480-9628-8be00f979f68 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:03.073101 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9ccd7-5f55-4480-9628-8be00f979f68 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:03.073583 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9ccd7-5f55-4480-9628-8be00f979f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:03.083974 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2032e-6ee7-4a62-8cdb-193263ff78a5 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:03.101506 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-cfe9ccd7-5f55-4480-9628-8be00f979f68 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:03.103266 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-cfe9ccd7-5f55-4480-9628-8be00f979f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:03.108191 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2032e-6ee7-4a62-8cdb-193263ff78a5 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:03.113232 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccc587-77f5-4af7-84fa-e3b5bfdfaf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:03.113920 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccc587-77f5-4af7-84fa-e3b5bfdfaf3f admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:03.114207 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccc587-77f5-4af7-84fa-e3b5bfdfaf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:03.114486 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccc587-77f5-4af7-84fa-e3b5bfdfaf3f admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:03.116278 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccc587-77f5-4af7-84fa-e3b5bfdfaf3f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:03.116425 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING py.warnings [None req-dfccc587-77f5-4af7-84fa-e3b5bfdfaf3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:14:03.116425 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: warnings.warn(msg) Aug 27 01:14:03.116425 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: Aug 27 01:14:03.117439 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccc587-77f5-4af7-84fa-e3b5bfdfaf3f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:03.120912 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 314/636] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:03 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:03.145752 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9ccd7-5f55-4480-9628-8be00f979f68 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:03.156712 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9ccd7-5f55-4480-9628-8be00f979f68 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:03.162369 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce709e-9a60-444d-b9eb-ecc8e51fde4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:03.163766 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce709e-9a60-444d-b9eb-ecc8e51fde4e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:03.164414 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce709e-9a60-444d-b9eb-ecc8e51fde4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:03.165015 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce709e-9a60-444d-b9eb-ecc8e51fde4e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:03.179980 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce709e-9a60-444d-b9eb-ecc8e51fde4e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:14:03.188019 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-04ce709e-9a60-444d-b9eb-ecc8e51fde4e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:14:03.190986 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 315/637] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:14:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:03.196742 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce709e-9a60-444d-b9eb-ecc8e51fde4e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:03.201168 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 323/638] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 01:14:03 2021] POST /identity/v3/services => generated 240 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:14:03.211054 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce709e-9a60-444d-b9eb-ecc8e51fde4e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:03.228400 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b48fe-b24e-43ae-a3d6-ecad81a0efc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:03.232710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b48fe-b24e-43ae-a3d6-ecad81a0efc3 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:03.232710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b48fe-b24e-43ae-a3d6-ecad81a0efc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:03.232710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b48fe-b24e-43ae-a3d6-ecad81a0efc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:03.232710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b48fe-b24e-43ae-a3d6-ecad81a0efc3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:03.232710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b48fe-b24e-43ae-a3d6-ecad81a0efc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:03.233135 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b48fe-b24e-43ae-a3d6-ecad81a0efc3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:03.242859 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 316/639] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:14:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:03.249398 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccc587-77f5-4af7-84fa-e3b5bfdfaf3f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:03.262326 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccc587-77f5-4af7-84fa-e3b5bfdfaf3f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:03.267607 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3123ae-bf3a-410d-bf3a-242b4a20dab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:03.268887 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3123ae-bf3a-410d-bf3a-242b4a20dab6 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:03.269404 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3123ae-bf3a-410d-bf3a-242b4a20dab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:03.269886 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3123ae-bf3a-410d-bf3a-242b4a20dab6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:03.283527 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3123ae-bf3a-410d-bf3a-242b4a20dab6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:03.285780 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3123ae-bf3a-410d-bf3a-242b4a20dab6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:03.304111 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-8f3123ae-bf3a-410d-bf3a-242b4a20dab6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:03.306073 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 324/640] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:03.313282 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b48fe-b24e-43ae-a3d6-ecad81a0efc3 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:03.333987 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b48fe-b24e-43ae-a3d6-ecad81a0efc3 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:03.340432 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6946f-fc0a-49bd-acfb-a62c45c736f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:03.342263 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6946f-fc0a-49bd-acfb-a62c45c736f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:03.342705 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6946f-fc0a-49bd-acfb-a62c45c736f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:03.343184 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6946f-fc0a-49bd-acfb-a62c45c736f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:03.344109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6946f-fc0a-49bd-acfb-a62c45c736f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:03.344577 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6946f-fc0a-49bd-acfb-a62c45c736f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:03.346454 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6946f-fc0a-49bd-acfb-a62c45c736f8 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:03.361918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 317/641] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:03.368368 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3123ae-bf3a-410d-bf3a-242b4a20dab6 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:03.379506 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3123ae-bf3a-410d-bf3a-242b4a20dab6 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:03.384349 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa55bb0-5ef9-4204-a836-8f63a3fca288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:03.385406 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa55bb0-5ef9-4204-a836-8f63a3fca288 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:03.385844 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa55bb0-5ef9-4204-a836-8f63a3fca288 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:03.386266 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa55bb0-5ef9-4204-a836-8f63a3fca288 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:03.399458 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa55bb0-5ef9-4204-a836-8f63a3fca288 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:03.401830 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa55bb0-5ef9-4204-a836-8f63a3fca288 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:03.423913 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-7fa55bb0-5ef9-4204-a836-8f63a3fca288 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 01:14:03.425523 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 325/642] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Aug 27 01:14:03 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:03.431714 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6946f-fc0a-49bd-acfb-a62c45c736f8 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:03.444663 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6946f-fc0a-49bd-acfb-a62c45c736f8 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:03.451544 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7fa5f-d33e-4641-ba4a-2c5633986d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:03.452156 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7fa5f-d33e-4641-ba4a-2c5633986d35 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:03.452436 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7fa5f-d33e-4641-ba4a-2c5633986d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:03.452705 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7fa5f-d33e-4641-ba4a-2c5633986d35 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:03.453580 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7fa5f-d33e-4641-ba4a-2c5633986d35 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:03.453886 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7fa5f-d33e-4641-ba4a-2c5633986d35 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:03.456036 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7fa5f-d33e-4641-ba4a-2c5633986d35 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:03.484001 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 318/643] 10.222.0.25 () {56 vars in 1171 bytes} [Fri Aug 27 01:14:03 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:03.489916 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa55bb0-5ef9-4204-a836-8f63a3fca288 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:03.502441 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa55bb0-5ef9-4204-a836-8f63a3fca288 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:03.509821 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28022c42-192b-4007-8544-1f81b97e73d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:03.510476 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28022c42-192b-4007-8544-1f81b97e73d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:03.510760 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28022c42-192b-4007-8544-1f81b97e73d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:03.511038 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28022c42-192b-4007-8544-1f81b97e73d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:03.522024 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28022c42-192b-4007-8544-1f81b97e73d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:03.523844 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28022c42-192b-4007-8544-1f81b97e73d5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:03.539861 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 326/644] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:14:03 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:14:03.546458 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7fa5f-d33e-4641-ba4a-2c5633986d35 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:03.561905 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7fa5f-d33e-4641-ba4a-2c5633986d35 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:03.568813 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6adcb-6203-4e73-871a-89082cc78acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:03.569681 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6adcb-6203-4e73-871a-89082cc78acc admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:03.569963 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6adcb-6203-4e73-871a-89082cc78acc admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:03.570235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6adcb-6203-4e73-871a-89082cc78acc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:03.590939 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6adcb-6203-4e73-871a-89082cc78acc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:03.592783 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6adcb-6203-4e73-871a-89082cc78acc admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:03.620147 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-27d6adcb-6203-4e73-871a-89082cc78acc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:03.621891 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 319/645] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:03.628341 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28022c42-192b-4007-8544-1f81b97e73d5 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:03.644893 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28022c42-192b-4007-8544-1f81b97e73d5 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:03.655957 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de128182-ae0c-47fd-b540-f1d7add62a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:03.656776 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de128182-ae0c-47fd-b540-f1d7add62a92 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:03.657357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de128182-ae0c-47fd-b540-f1d7add62a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:03.657857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de128182-ae0c-47fd-b540-f1d7add62a92 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:03.659325 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de128182-ae0c-47fd-b540-f1d7add62a92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:03.659858 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de128182-ae0c-47fd-b540-f1d7add62a92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:03.662733 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de128182-ae0c-47fd-b540-f1d7add62a92 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:03.683351 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 327/646] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:03.689789 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6adcb-6203-4e73-871a-89082cc78acc admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:03.708544 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6adcb-6203-4e73-871a-89082cc78acc admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:03.712982 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb036e-cd28-4a40-a417-a308905d32e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:03.713762 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb036e-cd28-4a40-a417-a308905d32e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:03.714049 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb036e-cd28-4a40-a417-a308905d32e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:03.714326 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb036e-cd28-4a40-a417-a308905d32e9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:03.729958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb036e-cd28-4a40-a417-a308905d32e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:03.731967 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb036e-cd28-4a40-a417-a308905d32e9 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:03.748302 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-6fcb036e-cd28-4a40-a417-a308905d32e9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:14:03.749829 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 320/647] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:03.756185 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de128182-ae0c-47fd-b540-f1d7add62a92 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:03.770578 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de128182-ae0c-47fd-b540-f1d7add62a92 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:03.778924 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88530346-f739-4704-8425-e8fa0b0e411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:03.779646 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88530346-f739-4704-8425-e8fa0b0e411b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:03.779936 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88530346-f739-4704-8425-e8fa0b0e411b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:03.780214 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88530346-f739-4704-8425-e8fa0b0e411b admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:03.781080 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88530346-f739-4704-8425-e8fa0b0e411b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:03.781395 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88530346-f739-4704-8425-e8fa0b0e411b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:03.783347 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88530346-f739-4704-8425-e8fa0b0e411b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:03.800734 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 328/648] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:14:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:03.807088 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb036e-cd28-4a40-a417-a308905d32e9 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:03.822941 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb036e-cd28-4a40-a417-a308905d32e9 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:03.833149 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca13f62-ea71-418c-9f83-3af858cca24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:03.833800 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca13f62-ea71-418c-9f83-3af858cca24e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:03.834085 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca13f62-ea71-418c-9f83-3af858cca24e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:03.834362 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca13f62-ea71-418c-9f83-3af858cca24e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:03.835194 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca13f62-ea71-418c-9f83-3af858cca24e admin admin] RBAC: Adding query filter params (role.id=c72f13c7e83e471b8cc350d318503763, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=3f65fb7e73db469f8b171c3126005427) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:03.835509 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca13f62-ea71-418c-9f83-3af858cca24e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:03.837419 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca13f62-ea71-418c-9f83-3af858cca24e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:03.849019 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 321/649] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:14:03 2021] GET /identity/v3/role_assignments?user.id=3f65fb7e73db469f8b171c3126005427&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=c72f13c7e83e471b8cc350d318503763 => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:04.797237 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab797b3c-a8e3-4acf-afdf-35a801e74284 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:04.797737 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab797b3c-a8e3-4acf-afdf-35a801e74284 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:04.797737 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab797b3c-a8e3-4acf-afdf-35a801e74284 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:04.799777 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 329/650] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:04.805582 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bc784-ea05-4861-a67f-954afe21bdc1 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:04.805992 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bc784-ea05-4861-a67f-954afe21bdc1 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:04.806174 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bc784-ea05-4861-a67f-954afe21bdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:04.831239 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-0a5bc784-ea05-4861-a67f-954afe21bdc1 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:04.832478 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-0a5bc784-ea05-4861-a67f-954afe21bdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:04.844795 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 322/651] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:04 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:04.877106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab797b3c-a8e3-4acf-afdf-35a801e74284 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:04.894418 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab797b3c-a8e3-4acf-afdf-35a801e74284 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:04.899010 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523efad-8a1b-4355-b906-22b26e65f3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:04.899798 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523efad-8a1b-4355-b906-22b26e65f3cb admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:04.900082 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523efad-8a1b-4355-b906-22b26e65f3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:04.900358 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523efad-8a1b-4355-b906-22b26e65f3cb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:04.915265 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523efad-8a1b-4355-b906-22b26e65f3cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:14:04.922516 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-f523efad-8a1b-4355-b906-22b26e65f3cb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:14:04.923716 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 330/652] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:14:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:04.930484 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bc784-ea05-4861-a67f-954afe21bdc1 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:04.940379 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bc784-ea05-4861-a67f-954afe21bdc1 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:04.947574 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5971e-bbf5-4d94-b346-c7e29bb1b944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:04.948236 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5971e-bbf5-4d94-b346-c7e29bb1b944 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:04.948522 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5971e-bbf5-4d94-b346-c7e29bb1b944 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:04.948802 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5971e-bbf5-4d94-b346-c7e29bb1b944 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:04.949575 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5971e-bbf5-4d94-b346-c7e29bb1b944 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:04.950992 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5971e-bbf5-4d94-b346-c7e29bb1b944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:04.952666 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5971e-bbf5-4d94-b346-c7e29bb1b944 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:04.964290 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 323/653] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:14:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:04.971083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523efad-8a1b-4355-b906-22b26e65f3cb admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:04.986417 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523efad-8a1b-4355-b906-22b26e65f3cb admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:04.993432 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab3bae-0054-4218-807e-a61d337e4582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:04.994228 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab3bae-0054-4218-807e-a61d337e4582 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:04.994508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab3bae-0054-4218-807e-a61d337e4582 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:04.994784 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab3bae-0054-4218-807e-a61d337e4582 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:05.005784 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab3bae-0054-4218-807e-a61d337e4582 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:05.007623 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab3bae-0054-4218-807e-a61d337e4582 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:05.031100 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-6fab3bae-0054-4218-807e-a61d337e4582 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:05.032522 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 331/654] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:05.038644 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5971e-bbf5-4d94-b346-c7e29bb1b944 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:05.049713 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5971e-bbf5-4d94-b346-c7e29bb1b944 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:05.057092 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43892dd-19cb-4183-911c-ee56701ee271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:05.057756 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43892dd-19cb-4183-911c-ee56701ee271 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:05.058043 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43892dd-19cb-4183-911c-ee56701ee271 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:05.058322 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43892dd-19cb-4183-911c-ee56701ee271 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:05.059073 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43892dd-19cb-4183-911c-ee56701ee271 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:05.059986 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43892dd-19cb-4183-911c-ee56701ee271 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:05.061623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43892dd-19cb-4183-911c-ee56701ee271 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:05.080175 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 324/655] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:05.086647 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab3bae-0054-4218-807e-a61d337e4582 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:05.097910 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab3bae-0054-4218-807e-a61d337e4582 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:05.107426 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef8624-490a-4c88-8410-84701d63f105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:05.108562 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef8624-490a-4c88-8410-84701d63f105 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:05.109108 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef8624-490a-4c88-8410-84701d63f105 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:05.109608 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef8624-490a-4c88-8410-84701d63f105 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:05.121858 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef8624-490a-4c88-8410-84701d63f105 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:05.124240 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef8624-490a-4c88-8410-84701d63f105 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:05.144512 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-bfef8624-490a-4c88-8410-84701d63f105 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 01:14:05.146013 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 332/656] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:14:05 2021] GET /identity/v3/users/swift => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:05.152357 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43892dd-19cb-4183-911c-ee56701ee271 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:05.166164 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43892dd-19cb-4183-911c-ee56701ee271 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:05.181533 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250683f-ed74-4d53-8661-bade23f263cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:05.182218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250683f-ed74-4d53-8661-bade23f263cc admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:05.182501 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250683f-ed74-4d53-8661-bade23f263cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:05.182780 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250683f-ed74-4d53-8661-bade23f263cc admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:05.183625 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250683f-ed74-4d53-8661-bade23f263cc admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:05.183936 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250683f-ed74-4d53-8661-bade23f263cc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:05.186432 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250683f-ed74-4d53-8661-bade23f263cc admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:05.209101 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 325/657] 10.222.0.25 () {56 vars in 1157 bytes} [Fri Aug 27 01:14:05 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:05.215673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef8624-490a-4c88-8410-84701d63f105 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:05.229972 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef8624-490a-4c88-8410-84701d63f105 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:05.240866 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2e921-b682-4f55-8a5b-9b24e43286ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:05.242004 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2e921-b682-4f55-8a5b-9b24e43286ae admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:05.242502 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2e921-b682-4f55-8a5b-9b24e43286ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:05.242989 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2e921-b682-4f55-8a5b-9b24e43286ae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:05.257152 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2e921-b682-4f55-8a5b-9b24e43286ae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:05.259269 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2e921-b682-4f55-8a5b-9b24e43286ae admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:05.273769 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 333/658] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:14:05 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:14:05.280361 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250683f-ed74-4d53-8661-bade23f263cc admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:05.295570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250683f-ed74-4d53-8661-bade23f263cc admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:05.311115 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296fb54-85b8-491d-a9fd-f697ed3ba438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:05.311848 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296fb54-85b8-491d-a9fd-f697ed3ba438 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:05.312133 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296fb54-85b8-491d-a9fd-f697ed3ba438 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:05.312411 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296fb54-85b8-491d-a9fd-f697ed3ba438 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:05.328270 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296fb54-85b8-491d-a9fd-f697ed3ba438 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:05.330427 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296fb54-85b8-491d-a9fd-f697ed3ba438 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:05.361602 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-f296fb54-85b8-491d-a9fd-f697ed3ba438 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:05.362876 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 326/659] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:05.370378 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2e921-b682-4f55-8a5b-9b24e43286ae admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:05.383947 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2e921-b682-4f55-8a5b-9b24e43286ae admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:05.392638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2d854-0052-45e5-92aa-f980ad364a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:05.393697 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2d854-0052-45e5-92aa-f980ad364a8e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:05.394186 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2d854-0052-45e5-92aa-f980ad364a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:05.394663 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2d854-0052-45e5-92aa-f980ad364a8e admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:05.395582 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2d854-0052-45e5-92aa-f980ad364a8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:05.396147 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2d854-0052-45e5-92aa-f980ad364a8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:05.397979 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2d854-0052-45e5-92aa-f980ad364a8e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:05.421880 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 334/660] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:05.427712 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296fb54-85b8-491d-a9fd-f697ed3ba438 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:05.443715 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296fb54-85b8-491d-a9fd-f697ed3ba438 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:05.461553 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4503bc-10b9-4196-8a7d-469c7d11f952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:05.462356 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4503bc-10b9-4196-8a7d-469c7d11f952 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:05.462640 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4503bc-10b9-4196-8a7d-469c7d11f952 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:05.462918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4503bc-10b9-4196-8a7d-469c7d11f952 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:05.471365 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4503bc-10b9-4196-8a7d-469c7d11f952 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:05.473374 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4503bc-10b9-4196-8a7d-469c7d11f952 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:05.490386 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-0d4503bc-10b9-4196-8a7d-469c7d11f952 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:14:05.491859 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 327/661] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:05.499785 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2d854-0052-45e5-92aa-f980ad364a8e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:05.514424 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2d854-0052-45e5-92aa-f980ad364a8e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:05.524798 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf0c7d-433e-41f7-876b-dd33be84eb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:05.525492 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf0c7d-433e-41f7-876b-dd33be84eb88 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:05.525773 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf0c7d-433e-41f7-876b-dd33be84eb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:05.526079 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf0c7d-433e-41f7-876b-dd33be84eb88 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:05.526831 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf0c7d-433e-41f7-876b-dd33be84eb88 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:05.527136 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf0c7d-433e-41f7-876b-dd33be84eb88 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:05.529823 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf0c7d-433e-41f7-876b-dd33be84eb88 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:05.551079 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 335/662] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:14:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:05.557823 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4503bc-10b9-4196-8a7d-469c7d11f952 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:05.573879 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4503bc-10b9-4196-8a7d-469c7d11f952 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:05.580005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd25478-fd14-42d7-a360-a05cfd4bf1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:05.580660 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd25478-fd14-42d7-a360-a05cfd4bf1dd admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:05.580972 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd25478-fd14-42d7-a360-a05cfd4bf1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:05.581250 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd25478-fd14-42d7-a360-a05cfd4bf1dd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:05.582077 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd25478-fd14-42d7-a360-a05cfd4bf1dd admin admin] RBAC: Adding query filter params (role.id=faadc5010ffb447ba5280e491c2ea2f5, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=d48536f4437240b79cf10961de9cc108) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:05.582386 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd25478-fd14-42d7-a360-a05cfd4bf1dd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:05.584238 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd25478-fd14-42d7-a360-a05cfd4bf1dd admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:05.594838 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 328/663] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:14:05 2021] GET /identity/v3/role_assignments?user.id=d48536f4437240b79cf10961de9cc108&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=faadc5010ffb447ba5280e491c2ea2f5 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:05.746935 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7988f47-c183-4221-9abc-f6e2817d5a94 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:05.747224 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7988f47-c183-4221-9abc-f6e2817d5a94 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:05.747483 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7988f47-c183-4221-9abc-f6e2817d5a94 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:05.749810 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 336/664] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:05.756123 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783f5fe-e6c8-4dec-9f6f-076343443a3b None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:05.756428 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783f5fe-e6c8-4dec-9f6f-076343443a3b None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:05.759993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783f5fe-e6c8-4dec-9f6f-076343443a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:05.786118 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b783f5fe-e6c8-4dec-9f6f-076343443a3b None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:05.787355 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b783f5fe-e6c8-4dec-9f6f-076343443a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:05.802711 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 329/665] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:05 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:05.833367 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8be24e-8106-4073-bf0c-e6a239d25c35 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:05.833880 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8be24e-8106-4073-bf0c-e6a239d25c35 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:05.833880 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8be24e-8106-4073-bf0c-e6a239d25c35 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:05.835919 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 337/666] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:05.842486 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117eaea-8cad-4dab-b62e-658018c61672 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:05.842999 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8be24e-8106-4073-bf0c-e6a239d25c35 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:05.843087 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117eaea-8cad-4dab-b62e-658018c61672 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:05.843259 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117eaea-8cad-4dab-b62e-658018c61672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:05.863764 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8be24e-8106-4073-bf0c-e6a239d25c35 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:05.864236 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-6117eaea-8cad-4dab-b62e-658018c61672 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:05.865606 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-6117eaea-8cad-4dab-b62e-658018c61672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:05.870401 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e957d-6042-4fbb-9c37-761860fff565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:05.871305 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e957d-6042-4fbb-9c37-761860fff565 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:05.871651 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e957d-6042-4fbb-9c37-761860fff565 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:05.871934 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e957d-6042-4fbb-9c37-761860fff565 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:05.875331 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 330/667] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:05 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:05.891798 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e957d-6042-4fbb-9c37-761860fff565 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:14:05.898555 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-e06e957d-6042-4fbb-9c37-761860fff565 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:14:05.899159 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117eaea-8cad-4dab-b62e-658018c61672 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:05.900049 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 338/668] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:14:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:05.907141 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e957d-6042-4fbb-9c37-761860fff565 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:05.911669 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117eaea-8cad-4dab-b62e-658018c61672 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:05.914389 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aaf746-0de1-462d-9e69-2791e849f175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:05.915202 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf746-0de1-462d-9e69-2791e849f175 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:05.915603 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf746-0de1-462d-9e69-2791e849f175 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:05.916783 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf746-0de1-462d-9e69-2791e849f175 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:05.917032 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aaf746-0de1-462d-9e69-2791e849f175 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:05.919705 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aaf746-0de1-462d-9e69-2791e849f175 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:05.920471 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e957d-6042-4fbb-9c37-761860fff565 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:05.925419 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205f94e-bc85-416b-b715-3aeadf977aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:05.926230 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205f94e-bc85-416b-b715-3aeadf977aba admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:05.926668 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205f94e-bc85-416b-b715-3aeadf977aba admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:05.927079 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205f94e-bc85-416b-b715-3aeadf977aba admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:05.927961 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205f94e-bc85-416b-b715-3aeadf977aba admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:05.928402 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205f94e-bc85-416b-b715-3aeadf977aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:05.930151 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205f94e-bc85-416b-b715-3aeadf977aba admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:05.933047 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-d8aaf746-0de1-462d-9e69-2791e849f175 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 01:14:05.939814 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 331/669] 10.222.0.25 () {56 vars in 1151 bytes} [Fri Aug 27 01:14:05 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:05.941323 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aaf746-0de1-462d-9e69-2791e849f175 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:05.943494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 339/670] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:14:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:05.958158 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aaf746-0de1-462d-9e69-2791e849f175 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:05.960564 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205f94e-bc85-416b-b715-3aeadf977aba admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:05.968807 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe01645-720b-4f23-a07f-519114f2973b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:05.969674 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe01645-720b-4f23-a07f-519114f2973b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:05.970093 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe01645-720b-4f23-a07f-519114f2973b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:05.970500 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe01645-720b-4f23-a07f-519114f2973b admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:05.971363 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe01645-720b-4f23-a07f-519114f2973b admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:05.971807 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe01645-720b-4f23-a07f-519114f2973b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:05.973566 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe01645-720b-4f23-a07f-519114f2973b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:05.981141 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205f94e-bc85-416b-b715-3aeadf977aba admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:05.986077 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42e16a-d500-4a82-8e1b-73217ba09f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:05.987083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42e16a-d500-4a82-8e1b-73217ba09f7a admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:05.987535 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42e16a-d500-4a82-8e1b-73217ba09f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:05.987979 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42e16a-d500-4a82-8e1b-73217ba09f7a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:05.990899 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 332/671] 10.222.0.25 () {56 vars in 1146 bytes} [Fri Aug 27 01:14:05 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:06.001881 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42e16a-d500-4a82-8e1b-73217ba09f7a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.004009 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42e16a-d500-4a82-8e1b-73217ba09f7a admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.006172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe01645-720b-4f23-a07f-519114f2973b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.018359 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe01645-720b-4f23-a07f-519114f2973b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.031477 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f710e-5564-4e27-ab1d-d8ed6d69775c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.032488 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f710e-5564-4e27-ab1d-d8ed6d69775c admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.033008 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f710e-5564-4e27-ab1d-d8ed6d69775c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.033477 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f710e-5564-4e27-ab1d-d8ed6d69775c admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.034400 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f710e-5564-4e27-ab1d-d8ed6d69775c admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:06.034896 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f710e-5564-4e27-ab1d-d8ed6d69775c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.036717 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f710e-5564-4e27-ab1d-d8ed6d69775c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.048252 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-2c42e16a-d500-4a82-8e1b-73217ba09f7a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:06.052277 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 333/672] 10.222.0.25 () {56 vars in 1146 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:06.054017 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 340/673] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:06.064083 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f710e-5564-4e27-ab1d-d8ed6d69775c admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.065453 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42e16a-d500-4a82-8e1b-73217ba09f7a admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.079957 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f710e-5564-4e27-ab1d-d8ed6d69775c admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.081468 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42e16a-d500-4a82-8e1b-73217ba09f7a admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.086162 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78119254-9a39-4e08-bee5-80901058578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.086772 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78119254-9a39-4e08-bee5-80901058578b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.087058 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78119254-9a39-4e08-bee5-80901058578b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.087339 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78119254-9a39-4e08-bee5-80901058578b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.088131 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78119254-9a39-4e08-bee5-80901058578b admin admin] RBAC: Adding query filter params (interface=public, service_id=c9fe91b361824b4fb4f99cc3bf3e6bc5, region_id=RegionOne) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:06.088442 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78119254-9a39-4e08-bee5-80901058578b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.089502 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING py.warnings [None req-78119254-9a39-4e08-bee5-80901058578b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:14:06.089502 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: warnings.warn(msg) Aug 27 01:14:06.089502 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: Aug 27 01:14:06.090173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbae5cd-d2ae-4ecb-ab1d-e8484b1dbd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.090929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78119254-9a39-4e08-bee5-80901058578b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.091481 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbae5cd-d2ae-4ecb-ab1d-e8484b1dbd14 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.091761 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbae5cd-d2ae-4ecb-ab1d-e8484b1dbd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.092034 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbae5cd-d2ae-4ecb-ab1d-e8484b1dbd14 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.092798 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbae5cd-d2ae-4ecb-ab1d-e8484b1dbd14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:06.093134 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbae5cd-d2ae-4ecb-ab1d-e8484b1dbd14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.095033 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbae5cd-d2ae-4ecb-ab1d-e8484b1dbd14 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.107617 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 341/674] 10.222.0.25 () {56 vars in 1273 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/endpoints?service_id=c9fe91b361824b4fb4f99cc3bf3e6bc5&interface=public®ion_id=RegionOne => generated 194 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:06.115119 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78119254-9a39-4e08-bee5-80901058578b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.121440 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 334/675] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:06.126935 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbae5cd-d2ae-4ecb-ab1d-e8484b1dbd14 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.127479 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78119254-9a39-4e08-bee5-80901058578b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.139704 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbae5cd-d2ae-4ecb-ab1d-e8484b1dbd14 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.142103 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee9452-1f28-4c69-a2ae-bd6bc0a123e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.143043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee9452-1f28-4c69-a2ae-bd6bc0a123e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.143561 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee9452-1f28-4c69-a2ae-bd6bc0a123e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.144100 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee9452-1f28-4c69-a2ae-bd6bc0a123e8 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.144864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b3442-bcd3-482e-90ae-9f39e4336f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.145271 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee9452-1f28-4c69-a2ae-bd6bc0a123e8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.145758 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b3442-bcd3-482e-90ae-9f39e4336f9f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.146045 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b3442-bcd3-482e-90ae-9f39e4336f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.146323 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b3442-bcd3-482e-90ae-9f39e4336f9f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.147662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee9452-1f28-4c69-a2ae-bd6bc0a123e8 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.155381 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 342/676] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/services => generated 772 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:06.157083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e35ac6-06da-4c26-98be-8407b9a7d094 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.157585 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e35ac6-06da-4c26-98be-8407b9a7d094 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.158050 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e35ac6-06da-4c26-98be-8407b9a7d094 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.159981 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 343/677] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:06.160104 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b3442-bcd3-482e-90ae-9f39e4336f9f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.164812 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b3442-bcd3-482e-90ae-9f39e4336f9f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.167052 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46162f21-03c8-4689-ab8a-a17c3c5bcf97 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.167566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46162f21-03c8-4689-ab8a-a17c3c5bcf97 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.168032 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46162f21-03c8-4689-ab8a-a17c3c5bcf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.189067 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-374b3442-bcd3-482e-90ae-9f39e4336f9f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 01:14:06.189067 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 335/678] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/users/nova => generated 82 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:06.195106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-46162f21-03c8-4689-ab8a-a17c3c5bcf97 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:06.195235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b3442-bcd3-482e-90ae-9f39e4336f9f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.196919 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-46162f21-03c8-4689-ab8a-a17c3c5bcf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:06.214254 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b3442-bcd3-482e-90ae-9f39e4336f9f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.218018 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 344/679] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:06 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:14:06.228357 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8ea32-9ff3-4d2a-9dca-c87d430f8459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.229130 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8ea32-9ff3-4d2a-9dca-c87d430f8459 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.229414 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8ea32-9ff3-4d2a-9dca-c87d430f8459 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.229750 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8ea32-9ff3-4d2a-9dca-c87d430f8459 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.230600 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8ea32-9ff3-4d2a-9dca-c87d430f8459 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:06.231223 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8ea32-9ff3-4d2a-9dca-c87d430f8459 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.233613 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8ea32-9ff3-4d2a-9dca-c87d430f8459 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.245206 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46162f21-03c8-4689-ab8a-a17c3c5bcf97 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.259457 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46162f21-03c8-4689-ab8a-a17c3c5bcf97 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.269054 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8ffc3-6d44-4872-8a4c-1c0f2b3639d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.269927 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8ffc3-6d44-4872-8a4c-1c0f2b3639d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.270212 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8ffc3-6d44-4872-8a4c-1c0f2b3639d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.271909 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8ffc3-6d44-4872-8a4c-1c0f2b3639d3 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.273216 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8ffc3-6d44-4872-8a4c-1c0f2b3639d3 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.276209 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8ffc3-6d44-4872-8a4c-1c0f2b3639d3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.284097 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 336/680] 10.222.0.25 () {56 vars in 1155 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:06.297929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-b3c8ffc3-6d44-4872-8a4c-1c0f2b3639d3 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 01:14:06.299550 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 345/681] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/services/network => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:06.301823 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8ea32-9ff3-4d2a-9dca-c87d430f8459 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.308799 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8ffc3-6d44-4872-8a4c-1c0f2b3639d3 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.316771 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8ea32-9ff3-4d2a-9dca-c87d430f8459 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.326208 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eac53-0ce6-423c-8138-c4843a53e4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.326934 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eac53-0ce6-423c-8138-c4843a53e4ec admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.327261 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eac53-0ce6-423c-8138-c4843a53e4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.327539 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eac53-0ce6-423c-8138-c4843a53e4ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.333481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8ffc3-6d44-4872-8a4c-1c0f2b3639d3 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.344409 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c518f-5d86-43f3-a603-b6b14b5333f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.345251 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c518f-5d86-43f3-a603-b6b14b5333f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.346365 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681eac53-0ce6-423c-8138-c4843a53e4ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.346788 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c518f-5d86-43f3-a603-b6b14b5333f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.347083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c518f-5d86-43f3-a603-b6b14b5333f9 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.349082 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681eac53-0ce6-423c-8138-c4843a53e4ec admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.349719 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c518f-5d86-43f3-a603-b6b14b5333f9 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:06.350034 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c518f-5d86-43f3-a603-b6b14b5333f9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.353653 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c518f-5d86-43f3-a603-b6b14b5333f9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.361638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 346/682] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/services?name=network => generated 124 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:06.367459 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 337/683] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:14:06.374183 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c518f-5d86-43f3-a603-b6b14b5333f9 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.374792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eac53-0ce6-423c-8138-c4843a53e4ec admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.383854 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eac53-0ce6-423c-8138-c4843a53e4ec admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.389337 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73055393-fb2a-4ee3-b688-76799eb574f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.390137 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73055393-fb2a-4ee3-b688-76799eb574f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.390417 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73055393-fb2a-4ee3-b688-76799eb574f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.390692 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73055393-fb2a-4ee3-b688-76799eb574f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.395912 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c518f-5d86-43f3-a603-b6b14b5333f9 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.407120 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73055393-fb2a-4ee3-b688-76799eb574f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.408153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c50d5-9bcf-4831-921c-4283d42192c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.408995 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73055393-fb2a-4ee3-b688-76799eb574f3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.409423 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c50d5-9bcf-4831-921c-4283d42192c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.409802 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c50d5-9bcf-4831-921c-4283d42192c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.410166 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c50d5-9bcf-4831-921c-4283d42192c8 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.410944 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c50d5-9bcf-4831-921c-4283d42192c8 admin admin] RBAC: Adding query filter params (type=network) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:06.411364 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c50d5-9bcf-4831-921c-4283d42192c8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.413615 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c50d5-9bcf-4831-921c-4283d42192c8 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.430557 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-73055393-fb2a-4ee3-b688-76799eb574f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:06.432322 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 347/685] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/services?type=network => generated 350 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:06.432767 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 338/685] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:06.436858 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c50d5-9bcf-4831-921c-4283d42192c8 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.440237 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73055393-fb2a-4ee3-b688-76799eb574f3 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.445795 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c50d5-9bcf-4831-921c-4283d42192c8 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.452547 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82975184-a59c-42a5-bd9c-9867b6c15ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.453352 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73055393-fb2a-4ee3-b688-76799eb574f3 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.453503 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82975184-a59c-42a5-bd9c-9867b6c15ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.453879 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82975184-a59c-42a5-bd9c-9867b6c15ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.454246 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82975184-a59c-42a5-bd9c-9867b6c15ca9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.455513 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82975184-a59c-42a5-bd9c-9867b6c15ca9 admin admin] RBAC: Adding query filter params (interface=public, service_id=c9c19d1a7ce3442fb40ba6313d2ffac0, region_id=RegionOne) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:06.455936 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82975184-a59c-42a5-bd9c-9867b6c15ca9 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.457767 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82975184-a59c-42a5-bd9c-9867b6c15ca9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.459818 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735933c-ea13-424d-86b3-f30f5e3f6467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.460983 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735933c-ea13-424d-86b3-f30f5e3f6467 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.461457 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735933c-ea13-424d-86b3-f30f5e3f6467 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.461865 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735933c-ea13-424d-86b3-f30f5e3f6467 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.462894 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735933c-ea13-424d-86b3-f30f5e3f6467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:06.463209 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735933c-ea13-424d-86b3-f30f5e3f6467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.465096 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 348/686] 10.222.0.25 () {56 vars in 1273 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/endpoints?service_id=c9c19d1a7ce3442fb40ba6313d2ffac0&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:06.469240 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735933c-ea13-424d-86b3-f30f5e3f6467 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.472670 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82975184-a59c-42a5-bd9c-9867b6c15ca9 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.485352 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82975184-a59c-42a5-bd9c-9867b6c15ca9 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.487885 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 339/687] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:06.488693 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735933c-ea13-424d-86b3-f30f5e3f6467 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.491391 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449a590-bffe-4820-bdbe-b70767d13b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.492279 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449a590-bffe-4820-bdbe-b70767d13b33 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.492778 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449a590-bffe-4820-bdbe-b70767d13b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.493270 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449a590-bffe-4820-bdbe-b70767d13b33 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.494382 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449a590-bffe-4820-bdbe-b70767d13b33 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.497160 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449a590-bffe-4820-bdbe-b70767d13b33 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.499636 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735933c-ea13-424d-86b3-f30f5e3f6467 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.503359 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 349/688] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/services => generated 772 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:06.511644 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23919a-41dc-4438-a9a7-8a90d2de53f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.513776 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23919a-41dc-4438-a9a7-8a90d2de53f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.514066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23919a-41dc-4438-a9a7-8a90d2de53f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.514344 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23919a-41dc-4438-a9a7-8a90d2de53f1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.522658 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23919a-41dc-4438-a9a7-8a90d2de53f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.524812 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23919a-41dc-4438-a9a7-8a90d2de53f1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.532759 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7ae17-4812-4dd0-b432-ba87198ce839 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.533074 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7ae17-4812-4dd0-b432-ba87198ce839 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.533342 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7ae17-4812-4dd0-b432-ba87198ce839 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.535470 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 350/689] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:14:06.541737 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f878d5-3fa5-4c9e-8557-6675c1c96df8 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.542106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f878d5-3fa5-4c9e-8557-6675c1c96df8 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.542450 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f878d5-3fa5-4c9e-8557-6675c1c96df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.548522 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-bb23919a-41dc-4438-a9a7-8a90d2de53f1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:14:06.550011 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 340/690] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:06.556514 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23919a-41dc-4438-a9a7-8a90d2de53f1 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.569089 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f7f878d5-3fa5-4c9e-8557-6675c1c96df8 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:06.570640 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f7f878d5-3fa5-4c9e-8557-6675c1c96df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:06.576132 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23919a-41dc-4438-a9a7-8a90d2de53f1 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.587480 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff04117-4125-41cf-9098-ddca6f078d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.588158 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff04117-4125-41cf-9098-ddca6f078d75 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.588444 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff04117-4125-41cf-9098-ddca6f078d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.588723 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff04117-4125-41cf-9098-ddca6f078d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.588978 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 351/691] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:06 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:06.589781 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff04117-4125-41cf-9098-ddca6f078d75 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:06.590095 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff04117-4125-41cf-9098-ddca6f078d75 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.592696 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff04117-4125-41cf-9098-ddca6f078d75 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.605609 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 341/692] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:06.613951 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff04117-4125-41cf-9098-ddca6f078d75 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.614155 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f878d5-3fa5-4c9e-8557-6675c1c96df8 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.623810 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f878d5-3fa5-4c9e-8557-6675c1c96df8 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.624979 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff04117-4125-41cf-9098-ddca6f078d75 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.629978 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9ef37-1c94-4621-968f-32603c204d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.630757 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9ef37-1c94-4621-968f-32603c204d31 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.631097 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9ef37-1c94-4621-968f-32603c204d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.631376 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9ef37-1c94-4621-968f-32603c204d31 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.632273 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9ef37-1c94-4621-968f-32603c204d31 admin admin] RBAC: Adding query filter params (role.id=faadc5010ffb447ba5280e491c2ea2f5, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=249a7642a0284dde91a7719f732b2d70) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:06.632593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9ef37-1c94-4621-968f-32603c204d31 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.634630 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9ef37-1c94-4621-968f-32603c204d31 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.641520 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a9244-d1ba-455a-9a51-821fac35fb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.643844 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a9244-d1ba-455a-9a51-821fac35fb88 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.644132 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a9244-d1ba-455a-9a51-821fac35fb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.644408 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a9244-d1ba-455a-9a51-821fac35fb88 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.646096 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 342/693] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/role_assignments?user.id=249a7642a0284dde91a7719f732b2d70&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=faadc5010ffb447ba5280e491c2ea2f5 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:06.667622 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a9244-d1ba-455a-9a51-821fac35fb88 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:14:06.675887 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-835a9244-d1ba-455a-9a51-821fac35fb88 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:14:06.677178 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 352/694] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:06.684450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9ef37-1c94-4621-968f-32603c204d31 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.697125 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9ef37-1c94-4621-968f-32603c204d31 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.707066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c29f22-128a-451b-977c-f21b2e82d133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.707066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c29f22-128a-451b-977c-f21b2e82d133 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.707066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c29f22-128a-451b-977c-f21b2e82d133 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.707066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c29f22-128a-451b-977c-f21b2e82d133 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.707834 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c29f22-128a-451b-977c-f21b2e82d133 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:06.707834 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c29f22-128a-451b-977c-f21b2e82d133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.709470 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c29f22-128a-451b-977c-f21b2e82d133 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.725926 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 343/695] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:06.733000 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a9244-d1ba-455a-9a51-821fac35fb88 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.744031 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a9244-d1ba-455a-9a51-821fac35fb88 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.748954 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6c158-661e-4038-8ca7-411eaa2f90ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.749766 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6c158-661e-4038-8ca7-411eaa2f90ef admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.750055 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6c158-661e-4038-8ca7-411eaa2f90ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.750336 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6c158-661e-4038-8ca7-411eaa2f90ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.763803 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6c158-661e-4038-8ca7-411eaa2f90ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.765910 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6c158-661e-4038-8ca7-411eaa2f90ef admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.786887 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-4af6c158-661e-4038-8ca7-411eaa2f90ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:06.788517 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 353/696] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:06.795844 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c29f22-128a-451b-977c-f21b2e82d133 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.807017 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c29f22-128a-451b-977c-f21b2e82d133 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.812478 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031a020-d41f-4688-a2d2-116ee6f5bb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.813302 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a020-d41f-4688-a2d2-116ee6f5bb50 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.813652 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a020-d41f-4688-a2d2-116ee6f5bb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.813933 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a020-d41f-4688-a2d2-116ee6f5bb50 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.814672 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031a020-d41f-4688-a2d2-116ee6f5bb50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:06.814982 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031a020-d41f-4688-a2d2-116ee6f5bb50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.816756 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031a020-d41f-4688-a2d2-116ee6f5bb50 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.830039 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 344/697] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:06.836344 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6c158-661e-4038-8ca7-411eaa2f90ef admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.847402 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6c158-661e-4038-8ca7-411eaa2f90ef admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.852118 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907c23c-cfec-4a0f-ae83-167544515740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.852968 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907c23c-cfec-4a0f-ae83-167544515740 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.853252 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907c23c-cfec-4a0f-ae83-167544515740 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.853529 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907c23c-cfec-4a0f-ae83-167544515740 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.862664 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907c23c-cfec-4a0f-ae83-167544515740 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.864699 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907c23c-cfec-4a0f-ae83-167544515740 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.882189 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-6907c23c-cfec-4a0f-ae83-167544515740 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 01:14:06.883494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 354/698] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:06.890557 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031a020-d41f-4688-a2d2-116ee6f5bb50 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.901074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031a020-d41f-4688-a2d2-116ee6f5bb50 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.906544 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57135ca1-b676-4460-938f-2ffa46bc2838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.907425 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57135ca1-b676-4460-938f-2ffa46bc2838 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.907887 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57135ca1-b676-4460-938f-2ffa46bc2838 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.908362 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57135ca1-b676-4460-938f-2ffa46bc2838 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.909496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57135ca1-b676-4460-938f-2ffa46bc2838 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:06.909988 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57135ca1-b676-4460-938f-2ffa46bc2838 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.911991 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57135ca1-b676-4460-938f-2ffa46bc2838 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.932867 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 345/699] 10.222.0.25 () {56 vars in 1171 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:06.939870 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907c23c-cfec-4a0f-ae83-167544515740 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:06.950842 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907c23c-cfec-4a0f-ae83-167544515740 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:06.955895 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a9dfa-2633-4508-bf8c-34f835f9d94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:06.956906 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a9dfa-2633-4508-bf8c-34f835f9d94d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:06.957387 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a9dfa-2633-4508-bf8c-34f835f9d94d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:06.957841 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a9dfa-2633-4508-bf8c-34f835f9d94d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:06.974396 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a9dfa-2633-4508-bf8c-34f835f9d94d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:06.976520 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a9dfa-2633-4508-bf8c-34f835f9d94d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:06.993590 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-223a9dfa-2633-4508-bf8c-34f835f9d94d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:06.995064 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 355/700] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:07.002199 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57135ca1-b676-4460-938f-2ffa46bc2838 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:07.013247 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57135ca1-b676-4460-938f-2ffa46bc2838 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:07.018123 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a55440-7132-45de-8a5e-96199d8eb792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:07.019019 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a55440-7132-45de-8a5e-96199d8eb792 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:07.019485 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a55440-7132-45de-8a5e-96199d8eb792 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:07.019937 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a55440-7132-45de-8a5e-96199d8eb792 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:07.020872 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a55440-7132-45de-8a5e-96199d8eb792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:07.021357 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a55440-7132-45de-8a5e-96199d8eb792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:07.023120 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a55440-7132-45de-8a5e-96199d8eb792 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:07.035910 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 346/701] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:07.042207 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a9dfa-2633-4508-bf8c-34f835f9d94d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:07.052395 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a9dfa-2633-4508-bf8c-34f835f9d94d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:07.057161 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b2aee-8a56-404d-8ef2-929f4ca08eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:07.058144 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b2aee-8a56-404d-8ef2-929f4ca08eec admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:07.058607 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b2aee-8a56-404d-8ef2-929f4ca08eec admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:07.059593 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b2aee-8a56-404d-8ef2-929f4ca08eec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:07.066855 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b2aee-8a56-404d-8ef2-929f4ca08eec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:07.069046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b2aee-8a56-404d-8ef2-929f4ca08eec admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:07.083345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-d61b2aee-8a56-404d-8ef2-929f4ca08eec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:14:07.089240 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 356/702] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:07.092512 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a55440-7132-45de-8a5e-96199d8eb792 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:07.103057 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a55440-7132-45de-8a5e-96199d8eb792 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:07.109320 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e705c-4bdb-4f1f-9589-2dac615a94f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:07.110273 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e705c-4bdb-4f1f-9589-2dac615a94f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:07.110738 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e705c-4bdb-4f1f-9589-2dac615a94f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:07.111195 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e705c-4bdb-4f1f-9589-2dac615a94f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:07.112260 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e705c-4bdb-4f1f-9589-2dac615a94f5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:07.112805 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e705c-4bdb-4f1f-9589-2dac615a94f5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:07.114934 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e705c-4bdb-4f1f-9589-2dac615a94f5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:07.128535 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 347/703] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:14:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:07.135211 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b2aee-8a56-404d-8ef2-929f4ca08eec admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:07.145562 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b2aee-8a56-404d-8ef2-929f4ca08eec admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:07.150394 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907bf01-05dd-4fdd-bac1-c78020b4022c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:07.151496 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907bf01-05dd-4fdd-bac1-c78020b4022c admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:07.151957 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907bf01-05dd-4fdd-bac1-c78020b4022c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:07.152409 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907bf01-05dd-4fdd-bac1-c78020b4022c admin admin] PATH_INFO: `/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/3f65fb7e73db469f8b171c3126005427/roles/c72f13c7e83e471b8cc350d318503763` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:07.169559 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907bf01-05dd-4fdd-bac1-c78020b4022c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0094d4fd0a114a2cbf5919f2a0e88e82, user_id=3f65fb7e73db469f8b171c3126005427, role_id=c72f13c7e83e471b8cc350d318503763)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:07.172481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907bf01-05dd-4fdd-bac1-c78020b4022c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:07.257748 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 357/704] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:14:07 2021] PUT /identity/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/3f65fb7e73db469f8b171c3126005427/roles/c72f13c7e83e471b8cc350d318503763 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:14:08.163584 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9250c8e-1136-4f8d-83ac-02dc6064f105 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:08.164619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9250c8e-1136-4f8d-83ac-02dc6064f105 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:08.165132 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9250c8e-1136-4f8d-83ac-02dc6064f105 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:08.167387 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 348/705] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:08.174069 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5c4d-ccad-49ae-a3ab-44d2c6ef9672 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:08.174903 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5c4d-ccad-49ae-a3ab-44d2c6ef9672 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:08.175417 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5c4d-ccad-49ae-a3ab-44d2c6ef9672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:08.205907 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-04ba5c4d-ccad-49ae-a3ab-44d2c6ef9672 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:08.207450 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-04ba5c4d-ccad-49ae-a3ab-44d2c6ef9672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:08.282522 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 358/706] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:08 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:08.319767 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9250c8e-1136-4f8d-83ac-02dc6064f105 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:08.342880 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9250c8e-1136-4f8d-83ac-02dc6064f105 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:08.347505 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501923ff-f5ed-4a94-b1ce-e7538dd5784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:08.348351 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501923ff-f5ed-4a94-b1ce-e7538dd5784a admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:08.348645 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501923ff-f5ed-4a94-b1ce-e7538dd5784a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:08.348939 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501923ff-f5ed-4a94-b1ce-e7538dd5784a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:08.365496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501923ff-f5ed-4a94-b1ce-e7538dd5784a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:14:08.373908 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-501923ff-f5ed-4a94-b1ce-e7538dd5784a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:14:08.375448 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 349/707] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:14:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:08.381659 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba5c4d-ccad-49ae-a3ab-44d2c6ef9672 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:08.399260 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba5c4d-ccad-49ae-a3ab-44d2c6ef9672 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:08.413499 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6cc31-0831-49fb-8b53-2a884a65daf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:08.414540 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6cc31-0831-49fb-8b53-2a884a65daf7 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:08.415031 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6cc31-0831-49fb-8b53-2a884a65daf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:08.415508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6cc31-0831-49fb-8b53-2a884a65daf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:08.416469 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6cc31-0831-49fb-8b53-2a884a65daf7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:08.417137 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6cc31-0831-49fb-8b53-2a884a65daf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:08.419005 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6cc31-0831-49fb-8b53-2a884a65daf7 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:08.428090 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 359/708] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:14:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:08.435590 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501923ff-f5ed-4a94-b1ce-e7538dd5784a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:08.449542 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501923ff-f5ed-4a94-b1ce-e7538dd5784a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:08.457069 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c3c56-28e5-4ca4-9fab-dec76407cff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:08.457862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c3c56-28e5-4ca4-9fab-dec76407cff8 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:08.458147 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c3c56-28e5-4ca4-9fab-dec76407cff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:08.458426 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c3c56-28e5-4ca4-9fab-dec76407cff8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:08.476493 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c3c56-28e5-4ca4-9fab-dec76407cff8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:08.478389 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c3c56-28e5-4ca4-9fab-dec76407cff8 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:08.502003 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-fb5c3c56-28e5-4ca4-9fab-dec76407cff8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:08.503241 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 350/709] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:08.509609 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6cc31-0831-49fb-8b53-2a884a65daf7 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:08.525870 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6cc31-0831-49fb-8b53-2a884a65daf7 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:08.536664 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb6ead-fbed-4637-8912-9fded3966fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:08.537629 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb6ead-fbed-4637-8912-9fded3966fdf admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:08.538136 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb6ead-fbed-4637-8912-9fded3966fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:08.538615 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb6ead-fbed-4637-8912-9fded3966fdf admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:08.539564 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb6ead-fbed-4637-8912-9fded3966fdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:08.540073 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb6ead-fbed-4637-8912-9fded3966fdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:08.541887 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb6ead-fbed-4637-8912-9fded3966fdf admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:08.564223 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 360/710] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:08.570183 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c3c56-28e5-4ca4-9fab-dec76407cff8 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:08.584223 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c3c56-28e5-4ca4-9fab-dec76407cff8 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:08.598057 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db508cf6-c3b8-40b9-8652-c8a2e5d95610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:08.598903 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db508cf6-c3b8-40b9-8652-c8a2e5d95610 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:08.599190 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db508cf6-c3b8-40b9-8652-c8a2e5d95610 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:08.599521 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db508cf6-c3b8-40b9-8652-c8a2e5d95610 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:08.613634 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db508cf6-c3b8-40b9-8652-c8a2e5d95610 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:08.615670 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db508cf6-c3b8-40b9-8652-c8a2e5d95610 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:08.633455 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-db508cf6-c3b8-40b9-8652-c8a2e5d95610 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 01:14:08.634971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 351/711] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:14:08 2021] GET /identity/v3/users/swift => generated 83 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:08.641227 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb6ead-fbed-4637-8912-9fded3966fdf admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:08.658361 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb6ead-fbed-4637-8912-9fded3966fdf admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:08.668963 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56826cc1-a291-4e8a-a14e-4c9bb76811f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:08.669904 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56826cc1-a291-4e8a-a14e-4c9bb76811f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:08.670406 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56826cc1-a291-4e8a-a14e-4c9bb76811f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:08.670902 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56826cc1-a291-4e8a-a14e-4c9bb76811f4 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:08.671940 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56826cc1-a291-4e8a-a14e-4c9bb76811f4 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:08.672451 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56826cc1-a291-4e8a-a14e-4c9bb76811f4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:08.674522 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56826cc1-a291-4e8a-a14e-4c9bb76811f4 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:08.707357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 361/712] 10.222.0.25 () {56 vars in 1157 bytes} [Fri Aug 27 01:14:08 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:08.713236 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db508cf6-c3b8-40b9-8652-c8a2e5d95610 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:08.728865 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db508cf6-c3b8-40b9-8652-c8a2e5d95610 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:08.737897 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3cf26-a439-4feb-a950-100f24ac2915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:08.738758 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3cf26-a439-4feb-a950-100f24ac2915 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:08.739039 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3cf26-a439-4feb-a950-100f24ac2915 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:08.742191 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3cf26-a439-4feb-a950-100f24ac2915 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:08.757389 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3cf26-a439-4feb-a950-100f24ac2915 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:08.759241 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3cf26-a439-4feb-a950-100f24ac2915 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:08.780905 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-c1e3cf26-a439-4feb-a950-100f24ac2915 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:08.782591 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 352/713] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:08.788605 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56826cc1-a291-4e8a-a14e-4c9bb76811f4 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:08.803197 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56826cc1-a291-4e8a-a14e-4c9bb76811f4 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:08.817535 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f442c-3c03-43a8-b82b-4ece49cb67f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:08.818557 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f442c-3c03-43a8-b82b-4ece49cb67f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:08.819075 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f442c-3c03-43a8-b82b-4ece49cb67f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:08.819565 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f442c-3c03-43a8-b82b-4ece49cb67f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:08.820494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f442c-3c03-43a8-b82b-4ece49cb67f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:08.821024 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f442c-3c03-43a8-b82b-4ece49cb67f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:08.822845 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f442c-3c03-43a8-b82b-4ece49cb67f6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:08.839014 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 362/714] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:08.845439 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3cf26-a439-4feb-a950-100f24ac2915 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:08.858605 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3cf26-a439-4feb-a950-100f24ac2915 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:08.868988 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c70d3-b29b-47bb-bf78-574824a09b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:08.869788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c70d3-b29b-47bb-bf78-574824a09b3c admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:08.870068 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c70d3-b29b-47bb-bf78-574824a09b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:08.870343 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c70d3-b29b-47bb-bf78-574824a09b3c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:08.882676 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c70d3-b29b-47bb-bf78-574824a09b3c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:08.884632 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c70d3-b29b-47bb-bf78-574824a09b3c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:08.904422 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-217c70d3-b29b-47bb-bf78-574824a09b3c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:14:08.905959 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 353/715] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:08.912070 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f442c-3c03-43a8-b82b-4ece49cb67f6 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:08.926927 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f442c-3c03-43a8-b82b-4ece49cb67f6 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:08.941693 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14768397-2c08-4d99-acfa-b963c0b39808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:08.942751 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14768397-2c08-4d99-acfa-b963c0b39808 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:08.943263 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14768397-2c08-4d99-acfa-b963c0b39808 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:08.943780 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14768397-2c08-4d99-acfa-b963c0b39808 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:08.944814 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14768397-2c08-4d99-acfa-b963c0b39808 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:08.945367 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14768397-2c08-4d99-acfa-b963c0b39808 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:08.947481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14768397-2c08-4d99-acfa-b963c0b39808 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:08.966019 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 363/716] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:14:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:08.972643 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c70d3-b29b-47bb-bf78-574824a09b3c admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:08.986687 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c70d3-b29b-47bb-bf78-574824a09b3c admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:08.996316 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa146b-bc89-4eff-9a08-d86829dd08d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:08.997964 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa146b-bc89-4eff-9a08-d86829dd08d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:08.998462 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa146b-bc89-4eff-9a08-d86829dd08d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:08.998959 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa146b-bc89-4eff-9a08-d86829dd08d3 admin admin] PATH_INFO: `/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/d48536f4437240b79cf10961de9cc108/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:09.001938 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa146b-bc89-4eff-9a08-d86829dd08d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0094d4fd0a114a2cbf5919f2a0e88e82, user_id=d48536f4437240b79cf10961de9cc108, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:09.006130 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa146b-bc89-4eff-9a08-d86829dd08d3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:09.088240 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 354/717] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:14:08 2021] PUT /identity/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/d48536f4437240b79cf10961de9cc108/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:14:09.248955 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70054cd7-64fb-4e63-b6a3-22c74c84ff15 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:09.249919 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70054cd7-64fb-4e63-b6a3-22c74c84ff15 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:09.250391 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70054cd7-64fb-4e63-b6a3-22c74c84ff15 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:09.252407 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 364/718] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:14:09.259026 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fec64-10ce-4b68-835a-86d99c182592 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:09.259988 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fec64-10ce-4b68-835a-86d99c182592 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:09.260485 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fec64-10ce-4b68-835a-86d99c182592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:09.286405 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-e97fec64-10ce-4b68-835a-86d99c182592 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:09.287996 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e97fec64-10ce-4b68-835a-86d99c182592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:09.330679 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50a726-f757-42df-be58-cf2dbd428dc3 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:09.331307 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50a726-f757-42df-be58-cf2dbd428dc3 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:09.331802 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50a726-f757-42df-be58-cf2dbd428dc3 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:09.333822 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 365/719] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:14:09.347656 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15957914-4568-423f-bdd0-70b9e91950b4 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:09.347972 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15957914-4568-423f-bdd0-70b9e91950b4 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:09.348205 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15957914-4568-423f-bdd0-70b9e91950b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:09.382643 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-15957914-4568-423f-bdd0-70b9e91950b4 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:09.383842 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-15957914-4568-423f-bdd0-70b9e91950b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:09.396081 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 355/720] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:09 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:09.424273 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fec64-10ce-4b68-835a-86d99c182592 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:09.438956 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fec64-10ce-4b68-835a-86d99c182592 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:09.453780 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf42b08-8be7-4faf-8406-359dc777f6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:09.454872 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf42b08-8be7-4faf-8406-359dc777f6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:09.455148 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf42b08-8be7-4faf-8406-359dc777f6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:09.455417 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf42b08-8be7-4faf-8406-359dc777f6a0 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:09.456266 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf42b08-8be7-4faf-8406-359dc777f6a0 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:09.460414 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf42b08-8be7-4faf-8406-359dc777f6a0 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:09.481075 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-5bf42b08-8be7-4faf-8406-359dc777f6a0 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 01:14:09.482232 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 356/721] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:09 2021] GET /identity/v3/services/network => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:09.486296 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 366/722] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:09 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:14:09.494030 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf42b08-8be7-4faf-8406-359dc777f6a0 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:09.504730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf42b08-8be7-4faf-8406-359dc777f6a0 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:09.509462 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296bf72-61e4-4ae4-bb6c-3a3dbbbe9eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:09.510141 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296bf72-61e4-4ae4-bb6c-3a3dbbbe9eed admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:09.510417 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296bf72-61e4-4ae4-bb6c-3a3dbbbe9eed admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:09.510689 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296bf72-61e4-4ae4-bb6c-3a3dbbbe9eed admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:09.511396 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296bf72-61e4-4ae4-bb6c-3a3dbbbe9eed admin admin] RBAC: Adding query filter params (name=network) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:09.511698 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296bf72-61e4-4ae4-bb6c-3a3dbbbe9eed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:09.514033 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296bf72-61e4-4ae4-bb6c-3a3dbbbe9eed admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:09.519739 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 357/723] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 01:14:09 2021] GET /identity/v3/services?name=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:09.525640 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15957914-4568-423f-bdd0-70b9e91950b4 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:09.538450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296bf72-61e4-4ae4-bb6c-3a3dbbbe9eed admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:09.539519 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15957914-4568-423f-bdd0-70b9e91950b4 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:09.548782 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296bf72-61e4-4ae4-bb6c-3a3dbbbe9eed admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:09.551276 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146a366-1d5c-4173-9a1b-e376658af5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:09.552109 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146a366-1d5c-4173-9a1b-e376658af5af admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:09.552328 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146a366-1d5c-4173-9a1b-e376658af5af admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:09.552604 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146a366-1d5c-4173-9a1b-e376658af5af admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:09.553474 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146a366-1d5c-4173-9a1b-e376658af5af admin admin] RBAC: Adding query filter params (type=network) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:09.553669 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c530c31-b69a-44a6-ab6e-64e22756fde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:09.553852 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146a366-1d5c-4173-9a1b-e376658af5af admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:09.554435 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c530c31-b69a-44a6-ab6e-64e22756fde4 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:09.554715 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c530c31-b69a-44a6-ab6e-64e22756fde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:09.554988 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c530c31-b69a-44a6-ab6e-64e22756fde4 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:09.555382 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146a366-1d5c-4173-9a1b-e376658af5af admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:09.555732 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c530c31-b69a-44a6-ab6e-64e22756fde4 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:09.557375 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c530c31-b69a-44a6-ab6e-64e22756fde4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:09.566798 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 367/724] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 01:14:09 2021] GET /identity/v3/services?type=network => generated 350 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:09.573036 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146a366-1d5c-4173-9a1b-e376658af5af admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:09.578675 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-0c530c31-b69a-44a6-ab6e-64e22756fde4 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 01:14:09.583235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 358/725] 10.222.0.25 () {56 vars in 1151 bytes} [Fri Aug 27 01:14:09 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:09.583235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de9a11-8d12-4620-929b-249f1d6df0ff None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:09.583235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de9a11-8d12-4620-929b-249f1d6df0ff None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:09.583235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de9a11-8d12-4620-929b-249f1d6df0ff None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:09.583857 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 359/726] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:09.589697 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb8310-2148-426b-a03d-a6979694bcc3 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:09.589982 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb8310-2148-426b-a03d-a6979694bcc3 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:09.590409 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb8310-2148-426b-a03d-a6979694bcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:09.590772 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146a366-1d5c-4173-9a1b-e376658af5af admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:09.595685 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b98e80-51b7-4001-8722-a1f6854bdae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:09.596617 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b98e80-51b7-4001-8722-a1f6854bdae5 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:09.597327 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b98e80-51b7-4001-8722-a1f6854bdae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:09.598743 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b98e80-51b7-4001-8722-a1f6854bdae5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:09.599678 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b98e80-51b7-4001-8722-a1f6854bdae5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:09.600893 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING py.warnings [None req-b5b98e80-51b7-4001-8722-a1f6854bdae5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:14:09.600893 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: warnings.warn(msg) Aug 27 01:14:09.600893 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: Aug 27 01:14:09.602254 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b98e80-51b7-4001-8722-a1f6854bdae5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:09.609752 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-e6cb8310-2148-426b-a03d-a6979694bcc3 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:09.611033 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e6cb8310-2148-426b-a03d-a6979694bcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:09.619003 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 360/727] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:09 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:09.619581 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb8310-2148-426b-a03d-a6979694bcc3 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:09.634634 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb8310-2148-426b-a03d-a6979694bcc3 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:09.640351 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69545ba4-c2b9-4f64-a3d5-89aca8147c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:09.641303 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69545ba4-c2b9-4f64-a3d5-89aca8147c86 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:09.641825 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69545ba4-c2b9-4f64-a3d5-89aca8147c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:09.642499 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69545ba4-c2b9-4f64-a3d5-89aca8147c86 admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:09.643391 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69545ba4-c2b9-4f64-a3d5-89aca8147c86 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:09.643828 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69545ba4-c2b9-4f64-a3d5-89aca8147c86 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:09.645565 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69545ba4-c2b9-4f64-a3d5-89aca8147c86 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:09.651021 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 361/728] 10.222.0.25 () {56 vars in 1146 bytes} [Fri Aug 27 01:14:09 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:09.651977 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69545ba4-c2b9-4f64-a3d5-89aca8147c86 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:09.663837 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69545ba4-c2b9-4f64-a3d5-89aca8147c86 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:09.668474 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c3925-7a70-4cd4-b76a-02f370f762e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:09.669415 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c3925-7a70-4cd4-b76a-02f370f762e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:09.669697 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c3925-7a70-4cd4-b76a-02f370f762e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:09.674155 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c3925-7a70-4cd4-b76a-02f370f762e5 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:09.674155 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c3925-7a70-4cd4-b76a-02f370f762e5 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:09.674155 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c3925-7a70-4cd4-b76a-02f370f762e5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:09.683402 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-eb1c3925-7a70-4cd4-b76a-02f370f762e5 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 01:14:09.685244 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 362/729] 10.222.0.25 () {56 vars in 1154 bytes} [Fri Aug 27 01:14:09 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:09.687976 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c3925-7a70-4cd4-b76a-02f370f762e5 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:09.701971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c3925-7a70-4cd4-b76a-02f370f762e5 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:09.702406 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 368/730] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Aug 27 01:14:09 2021] POST /identity/v3/endpoints => generated 327 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:14:09.703977 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b98e80-51b7-4001-8722-a1f6854bdae5 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:09.733124 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce793d4-e562-4db1-88a2-77f600790f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:09.735108 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce793d4-e562-4db1-88a2-77f600790f39 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:09.736353 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce793d4-e562-4db1-88a2-77f600790f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:09.736577 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce793d4-e562-4db1-88a2-77f600790f39 admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:09.737689 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce793d4-e562-4db1-88a2-77f600790f39 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:09.739328 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b98e80-51b7-4001-8722-a1f6854bdae5 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:09.743103 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce793d4-e562-4db1-88a2-77f600790f39 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:09.743103 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce793d4-e562-4db1-88a2-77f600790f39 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:09.748439 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 363/731] 10.222.0.25 () {56 vars in 1146 bytes} [Fri Aug 27 01:14:09 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:09.754816 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce793d4-e562-4db1-88a2-77f600790f39 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:09.758182 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb140f-9e0b-4e3f-a154-52a006f1a459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:09.758867 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb140f-9e0b-4e3f-a154-52a006f1a459 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:09.759151 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb140f-9e0b-4e3f-a154-52a006f1a459 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:09.759426 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb140f-9e0b-4e3f-a154-52a006f1a459 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:09.760147 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb140f-9e0b-4e3f-a154-52a006f1a459 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:09.760452 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb140f-9e0b-4e3f-a154-52a006f1a459 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:09.762777 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb140f-9e0b-4e3f-a154-52a006f1a459 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:09.767109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce793d4-e562-4db1-88a2-77f600790f39 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:09.772774 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add8933-73f9-490a-a23d-8648f004220b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:09.773730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add8933-73f9-490a-a23d-8648f004220b admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:09.774179 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add8933-73f9-490a-a23d-8648f004220b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:09.774734 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add8933-73f9-490a-a23d-8648f004220b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:09.775632 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add8933-73f9-490a-a23d-8648f004220b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:09.776910 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING py.warnings [None req-5add8933-73f9-490a-a23d-8648f004220b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:14:09.776910 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: warnings.warn(msg) Aug 27 01:14:09.776910 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: Aug 27 01:14:09.778803 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add8933-73f9-490a-a23d-8648f004220b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:09.782989 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 369/732] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 01:14:09 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:09.790403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb140f-9e0b-4e3f-a154-52a006f1a459 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:09.803953 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb140f-9e0b-4e3f-a154-52a006f1a459 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:09.809857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225b49e-8462-449e-a41a-170c2fc56cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:09.810972 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225b49e-8462-449e-a41a-170c2fc56cfc admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:09.811458 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225b49e-8462-449e-a41a-170c2fc56cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:09.811917 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225b49e-8462-449e-a41a-170c2fc56cfc admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:09.812960 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225b49e-8462-449e-a41a-170c2fc56cfc admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:09.813437 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225b49e-8462-449e-a41a-170c2fc56cfc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:09.815409 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225b49e-8462-449e-a41a-170c2fc56cfc admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:09.821367 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 370/733] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 01:14:09 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:09.891105 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 364/734] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Aug 27 01:14:09 2021] POST /identity/v3/endpoints => generated 346 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:14:10.039189 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5db94-f057-4224-ac1c-1045113f5970 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:10.039690 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5db94-f057-4224-ac1c-1045113f5970 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:10.040151 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5db94-f057-4224-ac1c-1045113f5970 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:10.042570 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 371/735] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:10.050096 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1119a46-6cc2-4950-b705-a84e96150645 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:10.050387 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1119a46-6cc2-4950-b705-a84e96150645 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:10.050651 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1119a46-6cc2-4950-b705-a84e96150645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:10.072464 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-a1119a46-6cc2-4950-b705-a84e96150645 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:10.073738 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a1119a46-6cc2-4950-b705-a84e96150645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:10.092084 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 365/736] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:10 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:14:10.116562 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5db94-f057-4224-ac1c-1045113f5970 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:10.129617 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5db94-f057-4224-ac1c-1045113f5970 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:10.134065 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a524354-4c53-4608-910f-c95664dc527c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:10.134855 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a524354-4c53-4608-910f-c95664dc527c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:10.135132 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a524354-4c53-4608-910f-c95664dc527c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:10.135409 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a524354-4c53-4608-910f-c95664dc527c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:10.146716 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a524354-4c53-4608-910f-c95664dc527c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:14:10.154445 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-4a524354-4c53-4608-910f-c95664dc527c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:14:10.155959 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 372/737] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:14:10 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:10.164624 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1119a46-6cc2-4950-b705-a84e96150645 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:10.174736 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1119a46-6cc2-4950-b705-a84e96150645 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:10.179426 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b6765-7cbf-47ac-9a3e-c2a9f3de1e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:10.180150 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b6765-7cbf-47ac-9a3e-c2a9f3de1e12 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:10.180434 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b6765-7cbf-47ac-9a3e-c2a9f3de1e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:10.180709 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b6765-7cbf-47ac-9a3e-c2a9f3de1e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:10.181563 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b6765-7cbf-47ac-9a3e-c2a9f3de1e12 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:10.181920 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b6765-7cbf-47ac-9a3e-c2a9f3de1e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:10.183559 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b6765-7cbf-47ac-9a3e-c2a9f3de1e12 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:10.192782 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 366/738] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:14:10 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:10.198588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a524354-4c53-4608-910f-c95664dc527c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:10.210183 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a524354-4c53-4608-910f-c95664dc527c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:10.215723 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894eb29-7303-4daa-92b1-a54a0f94eed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:10.216506 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894eb29-7303-4daa-92b1-a54a0f94eed9 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:10.216783 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894eb29-7303-4daa-92b1-a54a0f94eed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:10.217085 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894eb29-7303-4daa-92b1-a54a0f94eed9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:10.228006 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894eb29-7303-4daa-92b1-a54a0f94eed9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:10.229921 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894eb29-7303-4daa-92b1-a54a0f94eed9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:10.248597 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-d894eb29-7303-4daa-92b1-a54a0f94eed9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:10.250047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 373/739] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:10.256100 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b6765-7cbf-47ac-9a3e-c2a9f3de1e12 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:10.266617 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b6765-7cbf-47ac-9a3e-c2a9f3de1e12 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:10.271217 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb0add-7d31-445d-812d-9ab3794f466e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:10.271908 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb0add-7d31-445d-812d-9ab3794f466e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:10.272190 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb0add-7d31-445d-812d-9ab3794f466e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:10.272464 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb0add-7d31-445d-812d-9ab3794f466e admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:10.273212 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb0add-7d31-445d-812d-9ab3794f466e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:10.273514 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb0add-7d31-445d-812d-9ab3794f466e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:10.275135 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb0add-7d31-445d-812d-9ab3794f466e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:10.287851 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 367/740] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:10.294552 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894eb29-7303-4daa-92b1-a54a0f94eed9 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:10.304199 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894eb29-7303-4daa-92b1-a54a0f94eed9 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:10.308751 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de454a-bf4c-48cc-9c3e-e60f2db16e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:10.309645 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de454a-bf4c-48cc-9c3e-e60f2db16e71 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:10.309924 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de454a-bf4c-48cc-9c3e-e60f2db16e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:10.310198 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de454a-bf4c-48cc-9c3e-e60f2db16e71 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:10.317620 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de454a-bf4c-48cc-9c3e-e60f2db16e71 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:10.319658 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de454a-bf4c-48cc-9c3e-e60f2db16e71 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:10.334649 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-a3de454a-bf4c-48cc-9c3e-e60f2db16e71 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 01:14:10.336164 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 374/741] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Aug 27 01:14:10 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:10.342727 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb0add-7d31-445d-812d-9ab3794f466e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:10.352787 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb0add-7d31-445d-812d-9ab3794f466e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:10.357976 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedb4c0-da83-4335-b4bd-924e1132fd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:10.358641 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedb4c0-da83-4335-b4bd-924e1132fd63 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:10.358921 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedb4c0-da83-4335-b4bd-924e1132fd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:10.359198 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedb4c0-da83-4335-b4bd-924e1132fd63 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:10.360029 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedb4c0-da83-4335-b4bd-924e1132fd63 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:10.360335 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedb4c0-da83-4335-b4bd-924e1132fd63 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:10.362211 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedb4c0-da83-4335-b4bd-924e1132fd63 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:10.380474 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 368/742] 10.222.0.25 () {56 vars in 1171 bytes} [Fri Aug 27 01:14:10 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:10.386606 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de454a-bf4c-48cc-9c3e-e60f2db16e71 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:10.397374 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de454a-bf4c-48cc-9c3e-e60f2db16e71 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:10.401920 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75efcd1-c028-4678-8dfd-99a65403584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:10.402661 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75efcd1-c028-4678-8dfd-99a65403584c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:10.402993 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75efcd1-c028-4678-8dfd-99a65403584c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:10.403267 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75efcd1-c028-4678-8dfd-99a65403584c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:10.411469 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75efcd1-c028-4678-8dfd-99a65403584c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:10.413368 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75efcd1-c028-4678-8dfd-99a65403584c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:10.423600 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 375/743] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:14:10 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:14:10.429744 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedb4c0-da83-4335-b4bd-924e1132fd63 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:10.442001 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedb4c0-da83-4335-b4bd-924e1132fd63 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:10.446506 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0349afb-63e7-4ca1-88f7-ce90394e2fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:10.447284 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0349afb-63e7-4ca1-88f7-ce90394e2fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:10.447565 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0349afb-63e7-4ca1-88f7-ce90394e2fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:10.447836 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0349afb-63e7-4ca1-88f7-ce90394e2fe2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:10.459016 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0349afb-63e7-4ca1-88f7-ce90394e2fe2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:10.460851 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0349afb-63e7-4ca1-88f7-ce90394e2fe2 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:10.477496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-e0349afb-63e7-4ca1-88f7-ce90394e2fe2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:10.478965 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 369/744] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:10.485517 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75efcd1-c028-4678-8dfd-99a65403584c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:10.495181 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75efcd1-c028-4678-8dfd-99a65403584c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:10.500868 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf826b9-2944-4ad5-86ae-d076a1eab2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:10.501926 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf826b9-2944-4ad5-86ae-d076a1eab2fa admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:10.502413 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf826b9-2944-4ad5-86ae-d076a1eab2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:10.502903 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf826b9-2944-4ad5-86ae-d076a1eab2fa admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:10.503828 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf826b9-2944-4ad5-86ae-d076a1eab2fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:10.504330 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf826b9-2944-4ad5-86ae-d076a1eab2fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:10.506158 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf826b9-2944-4ad5-86ae-d076a1eab2fa admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:10.518877 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 376/745] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:10.525162 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0349afb-63e7-4ca1-88f7-ce90394e2fe2 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:10.535220 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0349afb-63e7-4ca1-88f7-ce90394e2fe2 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:10.540014 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c2be5-9427-4e8d-b1d9-517a2d64ac1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:10.541133 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c2be5-9427-4e8d-b1d9-517a2d64ac1e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:10.541622 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c2be5-9427-4e8d-b1d9-517a2d64ac1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:10.542083 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c2be5-9427-4e8d-b1d9-517a2d64ac1e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:10.549888 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c2be5-9427-4e8d-b1d9-517a2d64ac1e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:10.552074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c2be5-9427-4e8d-b1d9-517a2d64ac1e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:10.565474 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-b85c2be5-9427-4e8d-b1d9-517a2d64ac1e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:14:10.566889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 370/746] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:10.573238 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf826b9-2944-4ad5-86ae-d076a1eab2fa admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:10.583785 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf826b9-2944-4ad5-86ae-d076a1eab2fa admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:10.588557 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd8d18-0964-4e3f-8dd6-0b9b6dc24ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:10.589514 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd8d18-0964-4e3f-8dd6-0b9b6dc24ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:10.590551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd8d18-0964-4e3f-8dd6-0b9b6dc24ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:10.591127 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd8d18-0964-4e3f-8dd6-0b9b6dc24ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:10.592181 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd8d18-0964-4e3f-8dd6-0b9b6dc24ee3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:10.592682 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd8d18-0964-4e3f-8dd6-0b9b6dc24ee3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:10.594844 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd8d18-0964-4e3f-8dd6-0b9b6dc24ee3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:10.607952 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 377/747] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:14:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:10.614617 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c2be5-9427-4e8d-b1d9-517a2d64ac1e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:10.626262 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c2be5-9427-4e8d-b1d9-517a2d64ac1e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:10.631134 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656f946-7e40-4e6e-8370-dc328b50a10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:10.632009 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656f946-7e40-4e6e-8370-dc328b50a10b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:10.632481 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656f946-7e40-4e6e-8370-dc328b50a10b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:10.632988 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656f946-7e40-4e6e-8370-dc328b50a10b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:10.633994 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656f946-7e40-4e6e-8370-dc328b50a10b admin admin] RBAC: Adding query filter params (role.id=c72f13c7e83e471b8cc350d318503763, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=3f65fb7e73db469f8b171c3126005427) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:10.634549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656f946-7e40-4e6e-8370-dc328b50a10b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:10.636636 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656f946-7e40-4e6e-8370-dc328b50a10b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:10.643179 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 371/748] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:14:10 2021] GET /identity/v3/role_assignments?user.id=3f65fb7e73db469f8b171c3126005427&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=c72f13c7e83e471b8cc350d318503763 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:11.505641 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9c763-f2e2-4723-b76e-c40bfc50f6a4 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:11.506142 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9c763-f2e2-4723-b76e-c40bfc50f6a4 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:11.506248 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9c763-f2e2-4723-b76e-c40bfc50f6a4 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:11.508177 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 378/749] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:11.514591 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bbcf0-fb5b-4183-8988-5879c501aebd None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:11.515025 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bbcf0-fb5b-4183-8988-5879c501aebd None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:11.515218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bbcf0-fb5b-4183-8988-5879c501aebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:11.533399 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-875bbcf0-fb5b-4183-8988-5879c501aebd None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:11.534589 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-875bbcf0-fb5b-4183-8988-5879c501aebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:11.542619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 372/750] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:11 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:11.567923 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9c763-f2e2-4723-b76e-c40bfc50f6a4 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:11.581131 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9c763-f2e2-4723-b76e-c40bfc50f6a4 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:11.586320 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6dff9-bea4-4d59-8e3a-e0a436fa66c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:11.587104 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6dff9-bea4-4d59-8e3a-e0a436fa66c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:11.587386 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6dff9-bea4-4d59-8e3a-e0a436fa66c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:11.587660 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6dff9-bea4-4d59-8e3a-e0a436fa66c2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:11.599378 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6dff9-bea4-4d59-8e3a-e0a436fa66c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:14:11.606112 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-ecc6dff9-bea4-4d59-8e3a-e0a436fa66c2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:14:11.607604 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 379/751] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:14:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:11.614161 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bbcf0-fb5b-4183-8988-5879c501aebd None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:11.623736 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bbcf0-fb5b-4183-8988-5879c501aebd None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:11.628298 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a21fe-08d0-4080-b372-f733c7b3de4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:11.629003 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a21fe-08d0-4080-b372-f733c7b3de4b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:11.629288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a21fe-08d0-4080-b372-f733c7b3de4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:11.629563 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a21fe-08d0-4080-b372-f733c7b3de4b admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:11.630306 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a21fe-08d0-4080-b372-f733c7b3de4b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:11.630610 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a21fe-08d0-4080-b372-f733c7b3de4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:11.632199 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a21fe-08d0-4080-b372-f733c7b3de4b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:11.641188 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 373/752] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:14:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:11.647402 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6dff9-bea4-4d59-8e3a-e0a436fa66c2 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:11.658069 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6dff9-bea4-4d59-8e3a-e0a436fa66c2 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:11.662772 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a9b9e-a0e1-4d5e-ba3a-e324aac1783b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:11.663559 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a9b9e-a0e1-4d5e-ba3a-e324aac1783b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:11.663840 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a9b9e-a0e1-4d5e-ba3a-e324aac1783b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:11.664115 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a9b9e-a0e1-4d5e-ba3a-e324aac1783b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:11.675365 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a9b9e-a0e1-4d5e-ba3a-e324aac1783b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:11.677185 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a9b9e-a0e1-4d5e-ba3a-e324aac1783b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:11.693779 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-eb5a9b9e-a0e1-4d5e-ba3a-e324aac1783b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:11.695270 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 380/753] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:11.702435 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a21fe-08d0-4080-b372-f733c7b3de4b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:11.712421 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a21fe-08d0-4080-b372-f733c7b3de4b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:11.717167 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78184237-84cb-4f11-ab74-c895c5900d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:11.717826 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78184237-84cb-4f11-ab74-c895c5900d83 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:11.718109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78184237-84cb-4f11-ab74-c895c5900d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:11.718383 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78184237-84cb-4f11-ab74-c895c5900d83 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:11.719114 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78184237-84cb-4f11-ab74-c895c5900d83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:11.719422 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78184237-84cb-4f11-ab74-c895c5900d83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:11.721169 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78184237-84cb-4f11-ab74-c895c5900d83 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:11.734501 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 374/754] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:11.740725 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a9b9e-a0e1-4d5e-ba3a-e324aac1783b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:11.750834 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a9b9e-a0e1-4d5e-ba3a-e324aac1783b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:11.755471 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815cf67-9842-45b7-bf43-9e5235c8d115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:11.756267 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815cf67-9842-45b7-bf43-9e5235c8d115 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:11.756548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815cf67-9842-45b7-bf43-9e5235c8d115 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:11.756823 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815cf67-9842-45b7-bf43-9e5235c8d115 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:11.765872 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815cf67-9842-45b7-bf43-9e5235c8d115 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:11.767929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815cf67-9842-45b7-bf43-9e5235c8d115 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:11.781783 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-7815cf67-9842-45b7-bf43-9e5235c8d115 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 01:14:11.783313 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 381/755] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:14:11 2021] GET /identity/v3/users/swift => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:11.789619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78184237-84cb-4f11-ab74-c895c5900d83 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:11.799975 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78184237-84cb-4f11-ab74-c895c5900d83 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:11.804600 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2432d-2806-48d3-8545-69c971f1d16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:11.805307 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2432d-2806-48d3-8545-69c971f1d16e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:11.805639 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2432d-2806-48d3-8545-69c971f1d16e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:11.805915 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2432d-2806-48d3-8545-69c971f1d16e admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:11.806750 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2432d-2806-48d3-8545-69c971f1d16e admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:11.807062 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2432d-2806-48d3-8545-69c971f1d16e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:11.809032 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2432d-2806-48d3-8545-69c971f1d16e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:11.828763 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 375/756] 10.222.0.25 () {56 vars in 1157 bytes} [Fri Aug 27 01:14:11 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:11.835405 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815cf67-9842-45b7-bf43-9e5235c8d115 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:11.845789 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815cf67-9842-45b7-bf43-9e5235c8d115 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:11.850435 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbad131-be7f-4f08-b638-98a007ff568f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:11.851079 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbad131-be7f-4f08-b638-98a007ff568f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:11.851410 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbad131-be7f-4f08-b638-98a007ff568f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:11.851692 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbad131-be7f-4f08-b638-98a007ff568f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:11.860538 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbad131-be7f-4f08-b638-98a007ff568f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:11.862379 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbad131-be7f-4f08-b638-98a007ff568f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:11.871649 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 382/757] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:14:11 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:14:11.878164 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2432d-2806-48d3-8545-69c971f1d16e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:11.888931 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2432d-2806-48d3-8545-69c971f1d16e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:11.893622 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f680e-923e-417b-a043-f813c73dc8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:11.894460 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f680e-923e-417b-a043-f813c73dc8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:11.894743 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f680e-923e-417b-a043-f813c73dc8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:11.895012 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f680e-923e-417b-a043-f813c73dc8a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:11.905850 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f680e-923e-417b-a043-f813c73dc8a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:11.907675 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f680e-923e-417b-a043-f813c73dc8a0 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:11.925307 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-d02f680e-923e-417b-a043-f813c73dc8a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:11.927707 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 376/758] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:11.933259 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbad131-be7f-4f08-b638-98a007ff568f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:11.942820 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbad131-be7f-4f08-b638-98a007ff568f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:11.947622 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7226be-34fa-46ee-8157-96a32697ee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:11.948346 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7226be-34fa-46ee-8157-96a32697ee0d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:11.948633 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7226be-34fa-46ee-8157-96a32697ee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:11.948947 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7226be-34fa-46ee-8157-96a32697ee0d admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:11.950264 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7226be-34fa-46ee-8157-96a32697ee0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:11.950687 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7226be-34fa-46ee-8157-96a32697ee0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:11.952442 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7226be-34fa-46ee-8157-96a32697ee0d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:11.966096 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 383/759] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:11.972290 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f680e-923e-417b-a043-f813c73dc8a0 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:11.982788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f680e-923e-417b-a043-f813c73dc8a0 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:11.987519 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9512f-22a2-4d19-b7dd-9dde8e7a2fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:11.988426 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9512f-22a2-4d19-b7dd-9dde8e7a2fcc admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:11.988700 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9512f-22a2-4d19-b7dd-9dde8e7a2fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:11.989005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9512f-22a2-4d19-b7dd-9dde8e7a2fcc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:11.996327 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9512f-22a2-4d19-b7dd-9dde8e7a2fcc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:11.998452 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9512f-22a2-4d19-b7dd-9dde8e7a2fcc admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:12.015756 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-d5d9512f-22a2-4d19-b7dd-9dde8e7a2fcc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:14:12.017412 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 377/760] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:12.023554 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7226be-34fa-46ee-8157-96a32697ee0d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:12.033862 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7226be-34fa-46ee-8157-96a32697ee0d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:12.038823 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3ed01-65fd-4729-a857-1086c14e2d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:12.039552 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3ed01-65fd-4729-a857-1086c14e2d9a admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:12.039832 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3ed01-65fd-4729-a857-1086c14e2d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:12.040161 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3ed01-65fd-4729-a857-1086c14e2d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:12.041003 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3ed01-65fd-4729-a857-1086c14e2d9a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:12.041316 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3ed01-65fd-4729-a857-1086c14e2d9a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:12.043978 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3ed01-65fd-4729-a857-1086c14e2d9a admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:12.057876 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 384/761] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:14:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:12.067508 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9512f-22a2-4d19-b7dd-9dde8e7a2fcc admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:12.080729 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9512f-22a2-4d19-b7dd-9dde8e7a2fcc admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:12.085547 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272deaa-6c2f-4e80-bf12-0e1fb4b99e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:12.086195 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272deaa-6c2f-4e80-bf12-0e1fb4b99e28 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:12.086474 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272deaa-6c2f-4e80-bf12-0e1fb4b99e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:12.086750 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272deaa-6c2f-4e80-bf12-0e1fb4b99e28 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:12.087631 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272deaa-6c2f-4e80-bf12-0e1fb4b99e28 admin admin] RBAC: Adding query filter params (role.id=faadc5010ffb447ba5280e491c2ea2f5, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=d48536f4437240b79cf10961de9cc108) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:12.087938 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272deaa-6c2f-4e80-bf12-0e1fb4b99e28 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:12.089924 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272deaa-6c2f-4e80-bf12-0e1fb4b99e28 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:12.096958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 378/762] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:14:12 2021] GET /identity/v3/role_assignments?user.id=d48536f4437240b79cf10961de9cc108&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=faadc5010ffb447ba5280e491c2ea2f5 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:12.123831 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fbb31-859c-4b4c-89c4-812c75cfe2f3 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:12.124191 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fbb31-859c-4b4c-89c4-812c75cfe2f3 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:12.124480 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fbb31-859c-4b4c-89c4-812c75cfe2f3 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:12.126742 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 385/763] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:12.132694 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68d022-27ac-49c5-bc8a-6c12d5f5b711 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:12.133025 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68d022-27ac-49c5-bc8a-6c12d5f5b711 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:12.133306 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68d022-27ac-49c5-bc8a-6c12d5f5b711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:12.152344 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-cb68d022-27ac-49c5-bc8a-6c12d5f5b711 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:12.154298 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-cb68d022-27ac-49c5-bc8a-6c12d5f5b711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:12.163004 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 379/764] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:12 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:12.187519 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fbb31-859c-4b4c-89c4-812c75cfe2f3 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:12.200761 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fbb31-859c-4b4c-89c4-812c75cfe2f3 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:12.205965 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926086a-c343-41b4-b869-daa22aa1d5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:12.206779 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926086a-c343-41b4-b869-daa22aa1d5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:12.207124 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926086a-c343-41b4-b869-daa22aa1d5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:12.207501 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926086a-c343-41b4-b869-daa22aa1d5b7 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:12.208303 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926086a-c343-41b4-b869-daa22aa1d5b7 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:12.210178 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926086a-c343-41b4-b869-daa22aa1d5b7 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:12.284632 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 386/765] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 01:14:12 2021] POST /identity/v3/services => generated 269 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:14:12.389190 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c39f15-9f3a-4597-b40b-d10ce945241b None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:12.389476 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c39f15-9f3a-4597-b40b-d10ce945241b None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:12.389753 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c39f15-9f3a-4597-b40b-d10ce945241b None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:12.397371 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 380/766] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:12 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:12.404053 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd1f23-39f8-4e60-b9e3-52c608964f59 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:12.404348 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd1f23-39f8-4e60-b9e3-52c608964f59 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:12.404655 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd1f23-39f8-4e60-b9e3-52c608964f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:12.429258 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-33fd1f23-39f8-4e60-b9e3-52c608964f59 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:12.430477 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-33fd1f23-39f8-4e60-b9e3-52c608964f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:12.451119 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 387/767] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:12 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:12.476107 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c39f15-9f3a-4597-b40b-d10ce945241b None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:12.490663 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c39f15-9f3a-4597-b40b-d10ce945241b None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:12.496001 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7be0c4-7f44-41d9-8bcd-ebd64b9886f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:12.497531 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7be0c4-7f44-41d9-8bcd-ebd64b9886f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:12.497818 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7be0c4-7f44-41d9-8bcd-ebd64b9886f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:12.498092 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7be0c4-7f44-41d9-8bcd-ebd64b9886f0 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:12.498758 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7be0c4-7f44-41d9-8bcd-ebd64b9886f0 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:12.500346 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7be0c4-7f44-41d9-8bcd-ebd64b9886f0 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:12.511605 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-8b7be0c4-7f44-41d9-8bcd-ebd64b9886f0 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 01:14:12.514272 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 381/768] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:14:12 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:12.520802 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd1f23-39f8-4e60-b9e3-52c608964f59 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:12.530539 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd1f23-39f8-4e60-b9e3-52c608964f59 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:12.535385 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c4c01-0ac1-41d3-85f4-01b1b6b2836d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:12.536051 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c4c01-0ac1-41d3-85f4-01b1b6b2836d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:12.536386 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c4c01-0ac1-41d3-85f4-01b1b6b2836d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:12.536665 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c4c01-0ac1-41d3-85f4-01b1b6b2836d admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:12.537423 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c4c01-0ac1-41d3-85f4-01b1b6b2836d admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:12.537784 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c4c01-0ac1-41d3-85f4-01b1b6b2836d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:12.539432 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c4c01-0ac1-41d3-85f4-01b1b6b2836d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:12.545330 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 388/769] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:14:12 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:12.551506 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7be0c4-7f44-41d9-8bcd-ebd64b9886f0 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:12.562643 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7be0c4-7f44-41d9-8bcd-ebd64b9886f0 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:12.567444 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172fa42-7e1d-430a-b726-1dad766388ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:12.568339 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172fa42-7e1d-430a-b726-1dad766388ed admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:12.568812 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172fa42-7e1d-430a-b726-1dad766388ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:12.569327 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172fa42-7e1d-430a-b726-1dad766388ed admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:12.570225 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172fa42-7e1d-430a-b726-1dad766388ed admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:12.570724 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172fa42-7e1d-430a-b726-1dad766388ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:12.572512 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172fa42-7e1d-430a-b726-1dad766388ed admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:12.584974 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 382/770] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:14:12 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:12.971283 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325583ef-7a69-4f34-b6c0-ddfb2ce127b9 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:12.971283 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325583ef-7a69-4f34-b6c0-ddfb2ce127b9 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:12.971283 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325583ef-7a69-4f34-b6c0-ddfb2ce127b9 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:12.971283 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 389/771] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:12.978525 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09457f5b-2c71-494a-9465-8edf8464ade1 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:12.978525 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09457f5b-2c71-494a-9465-8edf8464ade1 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:12.978525 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09457f5b-2c71-494a-9465-8edf8464ade1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:12.997531 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-09457f5b-2c71-494a-9465-8edf8464ade1 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:12.998958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-09457f5b-2c71-494a-9465-8edf8464ade1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:13.007164 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 383/772] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:12 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:14:13.031827 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325583ef-7a69-4f34-b6c0-ddfb2ce127b9 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:13.045114 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325583ef-7a69-4f34-b6c0-ddfb2ce127b9 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:13.049872 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e1b71-5291-4307-a054-80cd4b403216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:13.050834 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e1b71-5291-4307-a054-80cd4b403216 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:13.051292 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e1b71-5291-4307-a054-80cd4b403216 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:13.051708 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e1b71-5291-4307-a054-80cd4b403216 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:13.062671 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e1b71-5291-4307-a054-80cd4b403216 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:14:13.070213 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-281e1b71-5291-4307-a054-80cd4b403216 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 01:14:13.071850 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 390/773] 10.222.0.25 () {56 vars in 1142 bytes} [Fri Aug 27 01:14:13 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:13.078813 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09457f5b-2c71-494a-9465-8edf8464ade1 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:13.088558 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09457f5b-2c71-494a-9465-8edf8464ade1 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:13.094060 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3f465-485f-4d53-96cc-cd5d8c4b55d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:13.094824 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3f465-485f-4d53-96cc-cd5d8c4b55d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:13.095201 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3f465-485f-4d53-96cc-cd5d8c4b55d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:13.095572 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3f465-485f-4d53-96cc-cd5d8c4b55d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:13.096415 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3f465-485f-4d53-96cc-cd5d8c4b55d0 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:13.096860 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3f465-485f-4d53-96cc-cd5d8c4b55d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:13.098535 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3f465-485f-4d53-96cc-cd5d8c4b55d0 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:13.107908 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 384/774] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Aug 27 01:14:13 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:13.114088 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e1b71-5291-4307-a054-80cd4b403216 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:13.124932 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e1b71-5291-4307-a054-80cd4b403216 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:13.130026 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405f5d0-0056-4b7f-aaa5-1caffbc6ddf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:13.131079 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405f5d0-0056-4b7f-aaa5-1caffbc6ddf9 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:13.131584 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405f5d0-0056-4b7f-aaa5-1caffbc6ddf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:13.132094 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405f5d0-0056-4b7f-aaa5-1caffbc6ddf9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:13.142886 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405f5d0-0056-4b7f-aaa5-1caffbc6ddf9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:13.145048 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405f5d0-0056-4b7f-aaa5-1caffbc6ddf9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:13.162696 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-c405f5d0-0056-4b7f-aaa5-1caffbc6ddf9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:13.164460 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 391/775] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:13.171115 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3f465-485f-4d53-96cc-cd5d8c4b55d0 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:13.181170 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3f465-485f-4d53-96cc-cd5d8c4b55d0 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:13.186465 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcebccb-80e8-4c94-a357-c0891f4d77e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:13.187373 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcebccb-80e8-4c94-a357-c0891f4d77e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:13.187967 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcebccb-80e8-4c94-a357-c0891f4d77e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:13.188458 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcebccb-80e8-4c94-a357-c0891f4d77e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:13.189480 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcebccb-80e8-4c94-a357-c0891f4d77e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:13.190007 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcebccb-80e8-4c94-a357-c0891f4d77e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:13.191948 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcebccb-80e8-4c94-a357-c0891f4d77e1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:13.206012 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 385/776] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:13.212322 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405f5d0-0056-4b7f-aaa5-1caffbc6ddf9 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:13.222778 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405f5d0-0056-4b7f-aaa5-1caffbc6ddf9 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:13.228042 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bfde7-58e0-4535-b259-206b0ecf4f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:13.229207 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bfde7-58e0-4535-b259-206b0ecf4f5b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:13.229746 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bfde7-58e0-4535-b259-206b0ecf4f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:13.230224 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bfde7-58e0-4535-b259-206b0ecf4f5b admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:13.239254 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bfde7-58e0-4535-b259-206b0ecf4f5b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:13.241571 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bfde7-58e0-4535-b259-206b0ecf4f5b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:13.256626 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-8d8bfde7-58e0-4535-b259-206b0ecf4f5b admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 01:14:13.258417 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 392/777] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Aug 27 01:14:13 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:13.265401 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcebccb-80e8-4c94-a357-c0891f4d77e1 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:13.275476 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcebccb-80e8-4c94-a357-c0891f4d77e1 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:13.281894 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095e4ad-92ec-4827-a8d5-b5e9982d9c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:13.282929 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095e4ad-92ec-4827-a8d5-b5e9982d9c3b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:13.283435 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095e4ad-92ec-4827-a8d5-b5e9982d9c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:13.283949 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095e4ad-92ec-4827-a8d5-b5e9982d9c3b admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:13.285035 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095e4ad-92ec-4827-a8d5-b5e9982d9c3b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:13.285549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095e4ad-92ec-4827-a8d5-b5e9982d9c3b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:13.287737 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095e4ad-92ec-4827-a8d5-b5e9982d9c3b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:13.306541 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 386/778] 10.222.0.25 () {56 vars in 1171 bytes} [Fri Aug 27 01:14:13 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:13.313040 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bfde7-58e0-4535-b259-206b0ecf4f5b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:13.323214 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bfde7-58e0-4535-b259-206b0ecf4f5b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:13.328784 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b7d5e-e671-45b3-becb-56a11b3c39a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:13.330004 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b7d5e-e671-45b3-becb-56a11b3c39a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:13.330546 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b7d5e-e671-45b3-becb-56a11b3c39a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:13.331032 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b7d5e-e671-45b3-becb-56a11b3c39a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:13.339841 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b7d5e-e671-45b3-becb-56a11b3c39a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:13.343363 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b7d5e-e671-45b3-becb-56a11b3c39a7 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:13.354066 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 393/779] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:14:13 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:14:13.361380 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095e4ad-92ec-4827-a8d5-b5e9982d9c3b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:13.371890 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095e4ad-92ec-4827-a8d5-b5e9982d9c3b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:13.377161 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a78a4-15d9-4cb1-b880-d49441fec626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:13.378262 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a78a4-15d9-4cb1-b880-d49441fec626 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:13.378802 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a78a4-15d9-4cb1-b880-d49441fec626 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:13.379309 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a78a4-15d9-4cb1-b880-d49441fec626 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:13.394273 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a78a4-15d9-4cb1-b880-d49441fec626 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:13.396469 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a78a4-15d9-4cb1-b880-d49441fec626 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:13.414111 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-ed4a78a4-15d9-4cb1-b880-d49441fec626 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:13.415980 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 387/780] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:13.423670 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b7d5e-e671-45b3-becb-56a11b3c39a7 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:13.432996 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b7d5e-e671-45b3-becb-56a11b3c39a7 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:13.438128 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7faa1f-80be-446f-8889-f39e50f444fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:13.439028 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7faa1f-80be-446f-8889-f39e50f444fa admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:13.439535 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7faa1f-80be-446f-8889-f39e50f444fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:13.440010 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7faa1f-80be-446f-8889-f39e50f444fa admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:13.440964 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7faa1f-80be-446f-8889-f39e50f444fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:13.441475 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7faa1f-80be-446f-8889-f39e50f444fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:13.443282 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7faa1f-80be-446f-8889-f39e50f444fa admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:13.456745 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 394/781] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:13.463264 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a78a4-15d9-4cb1-b880-d49441fec626 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:13.473791 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a78a4-15d9-4cb1-b880-d49441fec626 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:13.478908 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f1cf2-02b8-451e-8873-4aaaa3e55c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:13.479978 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f1cf2-02b8-451e-8873-4aaaa3e55c12 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:13.480479 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f1cf2-02b8-451e-8873-4aaaa3e55c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:13.481611 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f1cf2-02b8-451e-8873-4aaaa3e55c12 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:13.489163 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f1cf2-02b8-451e-8873-4aaaa3e55c12 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:13.491398 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f1cf2-02b8-451e-8873-4aaaa3e55c12 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:13.504605 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-712f1cf2-02b8-451e-8873-4aaaa3e55c12 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:14:13.506365 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 388/782] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:13.513443 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7faa1f-80be-446f-8889-f39e50f444fa admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:13.523620 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7faa1f-80be-446f-8889-f39e50f444fa admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:13.529204 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db459b-d2f8-493e-89b9-64fc43f5c658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:13.530088 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db459b-d2f8-493e-89b9-64fc43f5c658 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:13.530629 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db459b-d2f8-493e-89b9-64fc43f5c658 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:13.531127 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db459b-d2f8-493e-89b9-64fc43f5c658 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:13.532163 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db459b-d2f8-493e-89b9-64fc43f5c658 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:13.532683 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db459b-d2f8-493e-89b9-64fc43f5c658 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:13.534834 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db459b-d2f8-493e-89b9-64fc43f5c658 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:13.549762 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 395/783] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:14:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:13.556895 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f1cf2-02b8-451e-8873-4aaaa3e55c12 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:13.568501 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f1cf2-02b8-451e-8873-4aaaa3e55c12 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:13.573664 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931decd8-ad28-44c1-8e46-bba51a1752c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:13.574662 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931decd8-ad28-44c1-8e46-bba51a1752c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:13.575168 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931decd8-ad28-44c1-8e46-bba51a1752c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:13.575690 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931decd8-ad28-44c1-8e46-bba51a1752c4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:13.576710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931decd8-ad28-44c1-8e46-bba51a1752c4 admin admin] RBAC: Adding query filter params (role.id=68b568bdff8d44a8b4837e976adb483a, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=3f65fb7e73db469f8b171c3126005427) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:13.577264 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931decd8-ad28-44c1-8e46-bba51a1752c4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:13.579643 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931decd8-ad28-44c1-8e46-bba51a1752c4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:13.585928 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 389/784] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:14:13 2021] GET /identity/v3/role_assignments?user.id=3f65fb7e73db469f8b171c3126005427&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=68b568bdff8d44a8b4837e976adb483a => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:14.361449 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f84388-a00c-4e73-8a64-7cebba79dd9c None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:14.361823 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f84388-a00c-4e73-8a64-7cebba79dd9c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:14.362005 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f84388-a00c-4e73-8a64-7cebba79dd9c None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:14.364046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 396/785] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:14.370127 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4b860-17fb-4788-8aa3-0d5179f7b5cb None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:14.370660 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4b860-17fb-4788-8aa3-0d5179f7b5cb None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:14.371687 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4b860-17fb-4788-8aa3-0d5179f7b5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:14.389806 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b3b4b860-17fb-4788-8aa3-0d5179f7b5cb None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:14.391388 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b3b4b860-17fb-4788-8aa3-0d5179f7b5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:14.401959 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 390/786] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:14 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:14.426326 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f84388-a00c-4e73-8a64-7cebba79dd9c None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:14.439506 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f84388-a00c-4e73-8a64-7cebba79dd9c None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:14.443917 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351805d4-316b-4d6e-9ed5-71d942b9bd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:14.444706 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351805d4-316b-4d6e-9ed5-71d942b9bd2e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:14.445027 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351805d4-316b-4d6e-9ed5-71d942b9bd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:14.445301 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351805d4-316b-4d6e-9ed5-71d942b9bd2e admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:14.445954 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351805d4-316b-4d6e-9ed5-71d942b9bd2e admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:14.447522 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351805d4-316b-4d6e-9ed5-71d942b9bd2e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:14.459279 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-351805d4-316b-4d6e-9ed5-71d942b9bd2e admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 01:14:14.460763 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 397/787] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 01:14:14 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:14.468118 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4b860-17fb-4788-8aa3-0d5179f7b5cb None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:14.477701 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4b860-17fb-4788-8aa3-0d5179f7b5cb None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:14.483173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87186a35-84af-4e40-9e06-4a21f7d53bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:14.484028 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87186a35-84af-4e40-9e06-4a21f7d53bfa admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:14.484390 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87186a35-84af-4e40-9e06-4a21f7d53bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:14.484740 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87186a35-84af-4e40-9e06-4a21f7d53bfa admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:14.485621 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87186a35-84af-4e40-9e06-4a21f7d53bfa admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:14.486007 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87186a35-84af-4e40-9e06-4a21f7d53bfa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:14.487753 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87186a35-84af-4e40-9e06-4a21f7d53bfa admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:14.493610 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 391/788] 10.222.0.25 () {56 vars in 1144 bytes} [Fri Aug 27 01:14:14 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:14.500681 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351805d4-316b-4d6e-9ed5-71d942b9bd2e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:14.511396 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351805d4-316b-4d6e-9ed5-71d942b9bd2e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:14.516806 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d969dd-cd26-49b9-b22d-ba8dbf85e366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:14.517788 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d969dd-cd26-49b9-b22d-ba8dbf85e366 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:14.518269 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d969dd-cd26-49b9-b22d-ba8dbf85e366 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:14.518742 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d969dd-cd26-49b9-b22d-ba8dbf85e366 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:14.519638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d969dd-cd26-49b9-b22d-ba8dbf85e366 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:14.520139 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d969dd-cd26-49b9-b22d-ba8dbf85e366 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:14.522133 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d969dd-cd26-49b9-b22d-ba8dbf85e366 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:14.528261 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 398/789] 10.222.0.25 () {56 vars in 1144 bytes} [Fri Aug 27 01:14:14 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:14.565061 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9c512-68e5-410d-9836-98f1231bc08f None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:14.565571 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9c512-68e5-410d-9836-98f1231bc08f None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:14.565674 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9c512-68e5-410d-9836-98f1231bc08f None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:14.567735 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 392/790] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:14.574129 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26efa8-b638-41e2-9f67-7ba97eeaa396 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:14.574569 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26efa8-b638-41e2-9f67-7ba97eeaa396 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:14.575047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26efa8-b638-41e2-9f67-7ba97eeaa396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:14.595102 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-7b26efa8-b638-41e2-9f67-7ba97eeaa396 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:14.596313 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-7b26efa8-b638-41e2-9f67-7ba97eeaa396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:14.604618 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 399/791] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:14 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:14.629177 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9c512-68e5-410d-9836-98f1231bc08f None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:14.642100 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9c512-68e5-410d-9836-98f1231bc08f None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:14.646714 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfee073-8170-4fd2-b1c7-8d57824cea8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:14.647533 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfee073-8170-4fd2-b1c7-8d57824cea8e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:14.647813 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfee073-8170-4fd2-b1c7-8d57824cea8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:14.648083 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfee073-8170-4fd2-b1c7-8d57824cea8e admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:14.648743 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfee073-8170-4fd2-b1c7-8d57824cea8e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:14.650401 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfee073-8170-4fd2-b1c7-8d57824cea8e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:14.667076 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-6dfee073-8170-4fd2-b1c7-8d57824cea8e admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 01:14:14.668907 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 393/792] 10.222.0.25 () {56 vars in 1154 bytes} [Fri Aug 27 01:14:14 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:14.675255 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26efa8-b638-41e2-9f67-7ba97eeaa396 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:14.684983 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26efa8-b638-41e2-9f67-7ba97eeaa396 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:14.689966 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5ea96-20c4-4968-a57b-2c0463e11dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:14.690650 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5ea96-20c4-4968-a57b-2c0463e11dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:14.690928 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5ea96-20c4-4968-a57b-2c0463e11dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:14.691197 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5ea96-20c4-4968-a57b-2c0463e11dd5 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:14.691918 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5ea96-20c4-4968-a57b-2c0463e11dd5 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:14.692221 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5ea96-20c4-4968-a57b-2c0463e11dd5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:14.693853 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5ea96-20c4-4968-a57b-2c0463e11dd5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:14.700023 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 400/793] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 01:14:14 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:14.707397 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfee073-8170-4fd2-b1c7-8d57824cea8e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:14.717665 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfee073-8170-4fd2-b1c7-8d57824cea8e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:14.722333 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d22209-e768-4397-a421-28d5e9338a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:14.723004 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d22209-e768-4397-a421-28d5e9338a5b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:14.723289 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d22209-e768-4397-a421-28d5e9338a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:14.723563 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d22209-e768-4397-a421-28d5e9338a5b admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:14.724278 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d22209-e768-4397-a421-28d5e9338a5b admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:14.724577 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d22209-e768-4397-a421-28d5e9338a5b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:14.726243 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d22209-e768-4397-a421-28d5e9338a5b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:14.732202 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 394/794] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 01:14:14 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:14.738445 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5ea96-20c4-4968-a57b-2c0463e11dd5 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:14.748300 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5ea96-20c4-4968-a57b-2c0463e11dd5 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:14.752996 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561dd78-1d47-4a09-b57e-88cdcb091e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:14.753653 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561dd78-1d47-4a09-b57e-88cdcb091e5a admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:14.753930 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561dd78-1d47-4a09-b57e-88cdcb091e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:14.754207 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561dd78-1d47-4a09-b57e-88cdcb091e5a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:14.754990 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561dd78-1d47-4a09-b57e-88cdcb091e5a admin admin] RBAC: Adding query filter params (interface=public, service_id=d1fffb9590a54d39ae748d6f3ff6e42f, region_id=RegionOne) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:14.755298 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561dd78-1d47-4a09-b57e-88cdcb091e5a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:14.756954 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561dd78-1d47-4a09-b57e-88cdcb091e5a admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:14.763527 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 401/795] 10.222.0.25 () {56 vars in 1273 bytes} [Fri Aug 27 01:14:14 2021] GET /identity/v3/endpoints?service_id=d1fffb9590a54d39ae748d6f3ff6e42f&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:14.769633 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d22209-e768-4397-a421-28d5e9338a5b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:14.780598 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d22209-e768-4397-a421-28d5e9338a5b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:14.785634 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0889504-8ca0-497a-bbb8-a13e803f892b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:14.786339 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0889504-8ca0-497a-bbb8-a13e803f892b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:14.786622 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0889504-8ca0-497a-bbb8-a13e803f892b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:14.786899 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0889504-8ca0-497a-bbb8-a13e803f892b admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:14.787619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0889504-8ca0-497a-bbb8-a13e803f892b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:14.789352 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0889504-8ca0-497a-bbb8-a13e803f892b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:14.796549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 395/796] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 01:14:14 2021] GET /identity/v3/services => generated 1029 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:14:14.863476 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917a50a-028c-4bed-b644-05788ef1c8a7 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:14.863804 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917a50a-028c-4bed-b644-05788ef1c8a7 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:14.864023 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917a50a-028c-4bed-b644-05788ef1c8a7 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:14.866185 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 402/797] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:14.872868 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf7cf3-0e0c-4543-8166-49f3ca5ce5d6 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:14.873181 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf7cf3-0e0c-4543-8166-49f3ca5ce5d6 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:14.873421 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf7cf3-0e0c-4543-8166-49f3ca5ce5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:14.893529 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-2edf7cf3-0e0c-4543-8166-49f3ca5ce5d6 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:14.894754 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-2edf7cf3-0e0c-4543-8166-49f3ca5ce5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:14.904750 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 396/798] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:14 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:14.928299 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917a50a-028c-4bed-b644-05788ef1c8a7 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:14.941251 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917a50a-028c-4bed-b644-05788ef1c8a7 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:14.945782 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754bf1e-f886-4b97-9a0e-543c2fdccc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:14.946448 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754bf1e-f886-4b97-9a0e-543c2fdccc13 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:14.946730 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754bf1e-f886-4b97-9a0e-543c2fdccc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:14.947001 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754bf1e-f886-4b97-9a0e-543c2fdccc13 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:14.947735 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754bf1e-f886-4b97-9a0e-543c2fdccc13 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:14.949955 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754bf1e-f886-4b97-9a0e-543c2fdccc13 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:15.045486 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 403/799] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 01:14:14 2021] POST /identity/v3/services => generated 251 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:14:15.810470 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11726e25-52ed-43e9-a1d2-4b35e4aed0a1 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:15.810976 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11726e25-52ed-43e9-a1d2-4b35e4aed0a1 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:15.810976 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11726e25-52ed-43e9-a1d2-4b35e4aed0a1 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:15.813007 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 397/800] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:15.818897 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9bce-7081-4678-9286-51ac06f17507 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:15.819316 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9bce-7081-4678-9286-51ac06f17507 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:15.819489 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9bce-7081-4678-9286-51ac06f17507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:15.838453 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-8c9a9bce-7081-4678-9286-51ac06f17507 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:15.839657 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-8c9a9bce-7081-4678-9286-51ac06f17507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:15.856528 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 404/801] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:15 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:15.880745 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11726e25-52ed-43e9-a1d2-4b35e4aed0a1 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:15.894040 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11726e25-52ed-43e9-a1d2-4b35e4aed0a1 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:15.898647 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5ceee-e987-40c5-a58e-839a020947ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:15.899455 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5ceee-e987-40c5-a58e-839a020947ca admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:15.899738 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5ceee-e987-40c5-a58e-839a020947ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:15.900016 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5ceee-e987-40c5-a58e-839a020947ca admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:15.910852 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5ceee-e987-40c5-a58e-839a020947ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:14:15.918047 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-06d5ceee-e987-40c5-a58e-839a020947ca admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 01:14:15.919544 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 398/802] 10.222.0.25 () {56 vars in 1142 bytes} [Fri Aug 27 01:14:15 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:15.926092 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a9bce-7081-4678-9286-51ac06f17507 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:15.936723 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a9bce-7081-4678-9286-51ac06f17507 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:15.944934 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b80d7-7f64-4b19-9554-b805ffa43c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:15.945877 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b80d7-7f64-4b19-9554-b805ffa43c51 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:15.946350 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b80d7-7f64-4b19-9554-b805ffa43c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:15.946821 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b80d7-7f64-4b19-9554-b805ffa43c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:15.947756 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b80d7-7f64-4b19-9554-b805ffa43c51 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:15.948249 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b80d7-7f64-4b19-9554-b805ffa43c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:15.950297 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b80d7-7f64-4b19-9554-b805ffa43c51 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:15.959458 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 405/803] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Aug 27 01:14:15 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:15.966247 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5ceee-e987-40c5-a58e-839a020947ca admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:15.976703 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5ceee-e987-40c5-a58e-839a020947ca admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:15.981985 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006d402-087f-4647-842e-bb4a0dcf3850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:15.983001 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006d402-087f-4647-842e-bb4a0dcf3850 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:15.983475 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006d402-087f-4647-842e-bb4a0dcf3850 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:15.983953 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006d402-087f-4647-842e-bb4a0dcf3850 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:15.994551 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006d402-087f-4647-842e-bb4a0dcf3850 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:15.997282 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006d402-087f-4647-842e-bb4a0dcf3850 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:16.017307 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-1006d402-087f-4647-842e-bb4a0dcf3850 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:16.019179 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 399/804] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:16.025675 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b80d7-7f64-4b19-9554-b805ffa43c51 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:16.036034 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b80d7-7f64-4b19-9554-b805ffa43c51 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:16.040922 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e6fac-8249-45f3-8ec4-612a782a138d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:16.041825 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e6fac-8249-45f3-8ec4-612a782a138d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:16.042299 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e6fac-8249-45f3-8ec4-612a782a138d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:16.042772 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e6fac-8249-45f3-8ec4-612a782a138d admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:16.043825 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e6fac-8249-45f3-8ec4-612a782a138d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:16.044328 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e6fac-8249-45f3-8ec4-612a782a138d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:16.046222 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e6fac-8249-45f3-8ec4-612a782a138d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:16.059588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 406/805] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:16.065575 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006d402-087f-4647-842e-bb4a0dcf3850 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:16.076132 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006d402-087f-4647-842e-bb4a0dcf3850 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:16.081101 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8d8a0-0c95-425f-8248-32553aa78c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:16.081971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8d8a0-0c95-425f-8248-32553aa78c86 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:16.082323 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8d8a0-0c95-425f-8248-32553aa78c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:16.082687 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8d8a0-0c95-425f-8248-32553aa78c86 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:16.090616 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8d8a0-0c95-425f-8248-32553aa78c86 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:16.092710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8d8a0-0c95-425f-8248-32553aa78c86 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:16.107290 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-53b8d8a0-0c95-425f-8248-32553aa78c86 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 01:14:16.108768 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 400/806] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Aug 27 01:14:16 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:16.115244 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e6fac-8249-45f3-8ec4-612a782a138d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:16.125833 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e6fac-8249-45f3-8ec4-612a782a138d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:16.130652 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235b8d4-9170-429f-a70e-cb13b5efec8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:16.131305 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235b8d4-9170-429f-a70e-cb13b5efec8f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:16.131639 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235b8d4-9170-429f-a70e-cb13b5efec8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:16.131915 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235b8d4-9170-429f-a70e-cb13b5efec8f admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:16.132802 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235b8d4-9170-429f-a70e-cb13b5efec8f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:16.133138 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235b8d4-9170-429f-a70e-cb13b5efec8f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:16.135028 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235b8d4-9170-429f-a70e-cb13b5efec8f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:16.153694 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 407/807] 10.222.0.25 () {56 vars in 1171 bytes} [Fri Aug 27 01:14:16 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:16.159801 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8d8a0-0c95-425f-8248-32553aa78c86 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:16.170556 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8d8a0-0c95-425f-8248-32553aa78c86 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:16.175305 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683f0ef-4aa1-49be-a5c8-9b667496a72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:16.176087 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f0ef-4aa1-49be-a5c8-9b667496a72e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:16.176413 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f0ef-4aa1-49be-a5c8-9b667496a72e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:16.176731 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f0ef-4aa1-49be-a5c8-9b667496a72e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:16.187786 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683f0ef-4aa1-49be-a5c8-9b667496a72e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:16.189714 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683f0ef-4aa1-49be-a5c8-9b667496a72e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:16.208395 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-7683f0ef-4aa1-49be-a5c8-9b667496a72e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:16.209928 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 401/808] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:16.216169 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235b8d4-9170-429f-a70e-cb13b5efec8f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:16.226242 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235b8d4-9170-429f-a70e-cb13b5efec8f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:16.231908 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1619cd8-7c04-4d31-8aa1-bf2b3601b000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:16.233048 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1619cd8-7c04-4d31-8aa1-bf2b3601b000 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:16.233511 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1619cd8-7c04-4d31-8aa1-bf2b3601b000 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:16.233942 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1619cd8-7c04-4d31-8aa1-bf2b3601b000 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:16.235257 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1619cd8-7c04-4d31-8aa1-bf2b3601b000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:16.235792 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1619cd8-7c04-4d31-8aa1-bf2b3601b000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:16.238496 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1619cd8-7c04-4d31-8aa1-bf2b3601b000 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:16.251519 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 408/809] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:16.257401 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683f0ef-4aa1-49be-a5c8-9b667496a72e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:16.267359 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683f0ef-4aa1-49be-a5c8-9b667496a72e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:16.272022 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed261e-6341-4dcf-a3b9-c993c82013c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:16.272864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed261e-6341-4dcf-a3b9-c993c82013c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:16.273171 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed261e-6341-4dcf-a3b9-c993c82013c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:16.273443 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed261e-6341-4dcf-a3b9-c993c82013c5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:16.280642 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed261e-6341-4dcf-a3b9-c993c82013c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:16.282797 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed261e-6341-4dcf-a3b9-c993c82013c5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:16.296782 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-d0ed261e-6341-4dcf-a3b9-c993c82013c5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:14:16.298377 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 402/810] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:16.304985 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1619cd8-7c04-4d31-8aa1-bf2b3601b000 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:16.316495 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1619cd8-7c04-4d31-8aa1-bf2b3601b000 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:16.321335 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e32efc-cd7e-4e6d-974b-5293cbff286b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:16.322091 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32efc-cd7e-4e6d-974b-5293cbff286b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:16.322392 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32efc-cd7e-4e6d-974b-5293cbff286b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:16.322651 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32efc-cd7e-4e6d-974b-5293cbff286b admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:16.323453 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e32efc-cd7e-4e6d-974b-5293cbff286b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:16.323822 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e32efc-cd7e-4e6d-974b-5293cbff286b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:16.326506 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e32efc-cd7e-4e6d-974b-5293cbff286b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:16.339971 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 409/811] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:14:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:16.346907 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed261e-6341-4dcf-a3b9-c993c82013c5 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:16.359783 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed261e-6341-4dcf-a3b9-c993c82013c5 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:16.364626 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa15f6f-7606-4a09-84a5-88312fcb7a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:16.365786 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa15f6f-7606-4a09-84a5-88312fcb7a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:16.366350 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa15f6f-7606-4a09-84a5-88312fcb7a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:16.366846 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa15f6f-7606-4a09-84a5-88312fcb7a3b admin admin] PATH_INFO: `/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/3f65fb7e73db469f8b171c3126005427/roles/68b568bdff8d44a8b4837e976adb483a` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:16.369342 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa15f6f-7606-4a09-84a5-88312fcb7a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0094d4fd0a114a2cbf5919f2a0e88e82, user_id=3f65fb7e73db469f8b171c3126005427, role_id=68b568bdff8d44a8b4837e976adb483a)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:16.372811 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa15f6f-7606-4a09-84a5-88312fcb7a3b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:16.467890 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 403/812] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:14:16 2021] PUT /identity/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/3f65fb7e73db469f8b171c3126005427/roles/68b568bdff8d44a8b4837e976adb483a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:14:16.805581 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c38d6-7e4a-4c72-b051-035460a70459 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:16.805983 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c38d6-7e4a-4c72-b051-035460a70459 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:16.806161 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c38d6-7e4a-4c72-b051-035460a70459 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:16.808147 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 410/813] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:16.814772 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f5c0a-cccb-4488-961e-2228aeacded5 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:16.815326 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f5c0a-cccb-4488-961e-2228aeacded5 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:16.815326 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f5c0a-cccb-4488-961e-2228aeacded5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:16.833386 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-9b6f5c0a-cccb-4488-961e-2228aeacded5 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:16.834604 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-9b6f5c0a-cccb-4488-961e-2228aeacded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:16.892527 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 404/814] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:16 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:16.916730 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c38d6-7e4a-4c72-b051-035460a70459 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:16.929819 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c38d6-7e4a-4c72-b051-035460a70459 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:16.934573 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4b568-2203-4d51-82dc-4f1dfb61a2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:16.935225 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4b568-2203-4d51-82dc-4f1dfb61a2fa admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:16.935504 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4b568-2203-4d51-82dc-4f1dfb61a2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:16.935779 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4b568-2203-4d51-82dc-4f1dfb61a2fa admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:16.937526 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4b568-2203-4d51-82dc-4f1dfb61a2fa admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:16.938176 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4b568-2203-4d51-82dc-4f1dfb61a2fa admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:17.017403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 411/815] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 01:14:16 2021] POST /identity/v3/services => generated 241 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:14:17.075639 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf46c9-2eb8-4030-a4c1-4218bcd732a7 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:17.075940 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf46c9-2eb8-4030-a4c1-4218bcd732a7 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:17.076154 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf46c9-2eb8-4030-a4c1-4218bcd732a7 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:17.078604 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 405/816] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:17.085361 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa76ff-7caf-4c09-a21b-32b723b5d875 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:17.085647 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa76ff-7caf-4c09-a21b-32b723b5d875 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:17.085926 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa76ff-7caf-4c09-a21b-32b723b5d875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:17.105001 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-d7aa76ff-7caf-4c09-a21b-32b723b5d875 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:17.107023 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-d7aa76ff-7caf-4c09-a21b-32b723b5d875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:17.125112 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 412/817] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:17 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:14:17.150297 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf46c9-2eb8-4030-a4c1-4218bcd732a7 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:17.167033 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf46c9-2eb8-4030-a4c1-4218bcd732a7 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:17.172374 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2366a26-ccb7-4cbf-a259-c6688afbde50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:17.173353 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2366a26-ccb7-4cbf-a259-c6688afbde50 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:17.173752 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2366a26-ccb7-4cbf-a259-c6688afbde50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:17.174122 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2366a26-ccb7-4cbf-a259-c6688afbde50 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:17.174889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2366a26-ccb7-4cbf-a259-c6688afbde50 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:17.176632 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2366a26-ccb7-4cbf-a259-c6688afbde50 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:17.189057 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-d2366a26-ccb7-4cbf-a259-c6688afbde50 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 01:14:17.190810 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 406/818] 10.222.0.25 () {56 vars in 1154 bytes} [Fri Aug 27 01:14:17 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:17.197329 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa76ff-7caf-4c09-a21b-32b723b5d875 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:17.207699 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa76ff-7caf-4c09-a21b-32b723b5d875 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:17.213950 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fc478-0b02-4b8f-8a57-6319461bb676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:17.214613 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fc478-0b02-4b8f-8a57-6319461bb676 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:17.215016 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fc478-0b02-4b8f-8a57-6319461bb676 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:17.215292 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fc478-0b02-4b8f-8a57-6319461bb676 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:17.216188 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fc478-0b02-4b8f-8a57-6319461bb676 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:17.216496 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fc478-0b02-4b8f-8a57-6319461bb676 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:17.218184 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fc478-0b02-4b8f-8a57-6319461bb676 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:17.224225 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 413/819] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 01:14:17 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:17.230931 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2366a26-ccb7-4cbf-a259-c6688afbde50 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:17.241408 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2366a26-ccb7-4cbf-a259-c6688afbde50 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:17.246479 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5111320-0e8e-4e34-bab5-dd1767ebf014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:17.247171 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5111320-0e8e-4e34-bab5-dd1767ebf014 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:17.247449 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5111320-0e8e-4e34-bab5-dd1767ebf014 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:17.247722 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5111320-0e8e-4e34-bab5-dd1767ebf014 admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:17.248448 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5111320-0e8e-4e34-bab5-dd1767ebf014 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:17.248757 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5111320-0e8e-4e34-bab5-dd1767ebf014 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:17.250456 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5111320-0e8e-4e34-bab5-dd1767ebf014 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:17.256625 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 407/820] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 01:14:17 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:17.264165 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fc478-0b02-4b8f-8a57-6319461bb676 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:17.276288 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fc478-0b02-4b8f-8a57-6319461bb676 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:17.281383 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2c621-c68c-4623-9bd1-c87548eeb65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:17.282318 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2c621-c68c-4623-9bd1-c87548eeb65f admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:17.282677 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2c621-c68c-4623-9bd1-c87548eeb65f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:17.283055 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2c621-c68c-4623-9bd1-c87548eeb65f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:17.283972 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2c621-c68c-4623-9bd1-c87548eeb65f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:17.285967 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2c621-c68c-4623-9bd1-c87548eeb65f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:17.328164 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20b9da-8083-46fc-a049-49bd7087b898 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:17.328366 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20b9da-8083-46fc-a049-49bd7087b898 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:17.328654 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20b9da-8083-46fc-a049-49bd7087b898 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:17.330863 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 408/821] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:14:17.336868 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d22c7c-d6a8-46b6-aaf5-9d712a65434d None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:17.337179 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d22c7c-d6a8-46b6-aaf5-9d712a65434d None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:17.337454 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d22c7c-d6a8-46b6-aaf5-9d712a65434d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:17.356759 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-d7d22c7c-d6a8-46b6-aaf5-9d712a65434d None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:17.357982 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d7d22c7c-d6a8-46b6-aaf5-9d712a65434d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:17.370345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 414/822] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Aug 27 01:14:17 2021] POST /identity/v3/endpoints => generated 347 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:14:17.386458 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 409/823] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:17 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:14:17.411559 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2c621-c68c-4623-9bd1-c87548eeb65f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:17.427983 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2c621-c68c-4623-9bd1-c87548eeb65f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:17.432931 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f172e8f-5672-4f48-ba7a-5a589e3ac9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:17.433882 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f172e8f-5672-4f48-ba7a-5a589e3ac9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:17.434602 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f172e8f-5672-4f48-ba7a-5a589e3ac9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:17.434602 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f172e8f-5672-4f48-ba7a-5a589e3ac9d0 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:17.435379 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f172e8f-5672-4f48-ba7a-5a589e3ac9d0 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:17.437136 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f172e8f-5672-4f48-ba7a-5a589e3ac9d0 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:17.450060 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-5f172e8f-5672-4f48-ba7a-5a589e3ac9d0 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 01:14:17.457039 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 415/824] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:14:17 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:17.458715 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d22c7c-d6a8-46b6-aaf5-9d712a65434d None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:17.469334 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d22c7c-d6a8-46b6-aaf5-9d712a65434d None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:17.474287 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294837fb-30f6-4e8e-a5bb-9278ff8d67f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:17.474970 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294837fb-30f6-4e8e-a5bb-9278ff8d67f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:17.475301 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294837fb-30f6-4e8e-a5bb-9278ff8d67f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:17.475574 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294837fb-30f6-4e8e-a5bb-9278ff8d67f3 admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:17.476337 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294837fb-30f6-4e8e-a5bb-9278ff8d67f3 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:17.476694 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294837fb-30f6-4e8e-a5bb-9278ff8d67f3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:17.478447 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294837fb-30f6-4e8e-a5bb-9278ff8d67f3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:17.488904 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 410/825] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:14:17 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:17.494873 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f172e8f-5672-4f48-ba7a-5a589e3ac9d0 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:17.505662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f172e8f-5672-4f48-ba7a-5a589e3ac9d0 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:17.510814 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa5700-173a-4c3d-a515-bc92884a3aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:17.511630 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa5700-173a-4c3d-a515-bc92884a3aea admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:17.512563 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa5700-173a-4c3d-a515-bc92884a3aea admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:17.512563 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa5700-173a-4c3d-a515-bc92884a3aea admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:17.513702 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa5700-173a-4c3d-a515-bc92884a3aea admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:17.514007 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa5700-173a-4c3d-a515-bc92884a3aea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:17.515657 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa5700-173a-4c3d-a515-bc92884a3aea admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:17.525168 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 416/826] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:14:17 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:17.532891 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294837fb-30f6-4e8e-a5bb-9278ff8d67f3 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:17.539527 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294837fb-30f6-4e8e-a5bb-9278ff8d67f3 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:17.544676 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e4751-4b8d-4015-8e42-2492fb9f03da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:17.545582 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e4751-4b8d-4015-8e42-2492fb9f03da admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:17.546049 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e4751-4b8d-4015-8e42-2492fb9f03da admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:17.546527 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e4751-4b8d-4015-8e42-2492fb9f03da admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:17.547497 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e4751-4b8d-4015-8e42-2492fb9f03da admin admin] RBAC: Adding query filter params (interface=public, service_id=bbcafa2165a048909f1abda8387cefc0, region_id=RegionOne) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:17.547996 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e4751-4b8d-4015-8e42-2492fb9f03da admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:17.549219 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING py.warnings [None req-fe4e4751-4b8d-4015-8e42-2492fb9f03da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:14:17.549219 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: warnings.warn(msg) Aug 27 01:14:17.549219 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: Aug 27 01:14:17.550440 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e4751-4b8d-4015-8e42-2492fb9f03da admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:17.559688 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 411/827] 10.222.0.25 () {56 vars in 1273 bytes} [Fri Aug 27 01:14:17 2021] GET /identity/v3/endpoints?service_id=bbcafa2165a048909f1abda8387cefc0&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:17.565740 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa5700-173a-4c3d-a515-bc92884a3aea admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:17.577924 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa5700-173a-4c3d-a515-bc92884a3aea admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:17.583304 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cbcf6-f26c-4d97-bb29-99479612e314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:17.583898 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cbcf6-f26c-4d97-bb29-99479612e314 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:17.584174 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cbcf6-f26c-4d97-bb29-99479612e314 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:17.584442 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cbcf6-f26c-4d97-bb29-99479612e314 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:17.585148 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cbcf6-f26c-4d97-bb29-99479612e314 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:17.586705 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cbcf6-f26c-4d97-bb29-99479612e314 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:17.594991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 417/828] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 01:14:17 2021] GET /identity/v3/services => generated 1497 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:14:18.741176 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6440d3-37a6-4429-b592-2ab94196cb50 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:18.741671 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6440d3-37a6-4429-b592-2ab94196cb50 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:18.741671 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6440d3-37a6-4429-b592-2ab94196cb50 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:18.743519 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 412/829] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:18.749935 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da72da-4245-4d0b-b2cc-7abb17c25e5c None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:18.750874 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da72da-4245-4d0b-b2cc-7abb17c25e5c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:18.751418 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da72da-4245-4d0b-b2cc-7abb17c25e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:18.769998 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-83da72da-4245-4d0b-b2cc-7abb17c25e5c None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:18.771484 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-83da72da-4245-4d0b-b2cc-7abb17c25e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:18.780047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 418/830] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:18 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:18.805755 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6440d3-37a6-4429-b592-2ab94196cb50 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:18.818881 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6440d3-37a6-4429-b592-2ab94196cb50 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:18.823738 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358ab67-e419-40c1-bdd3-a0e569a3d583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:18.824856 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358ab67-e419-40c1-bdd3-a0e569a3d583 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:18.825351 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358ab67-e419-40c1-bdd3-a0e569a3d583 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:18.825887 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358ab67-e419-40c1-bdd3-a0e569a3d583 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:18.838890 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358ab67-e419-40c1-bdd3-a0e569a3d583 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:14:18.846898 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-1358ab67-e419-40c1-bdd3-a0e569a3d583 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 01:14:18.848409 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 413/831] 10.222.0.25 () {56 vars in 1142 bytes} [Fri Aug 27 01:14:18 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:18.855083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da72da-4245-4d0b-b2cc-7abb17c25e5c None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:18.864454 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da72da-4245-4d0b-b2cc-7abb17c25e5c None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:18.869424 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b46545-32f6-4cc0-97e2-169025fd8c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:18.870322 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b46545-32f6-4cc0-97e2-169025fd8c8b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:18.871457 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b46545-32f6-4cc0-97e2-169025fd8c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:18.871972 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b46545-32f6-4cc0-97e2-169025fd8c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:18.872950 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b46545-32f6-4cc0-97e2-169025fd8c8b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:18.873471 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b46545-32f6-4cc0-97e2-169025fd8c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:18.875247 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b46545-32f6-4cc0-97e2-169025fd8c8b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:18.888807 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 419/832] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Aug 27 01:14:18 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:18.894998 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358ab67-e419-40c1-bdd3-a0e569a3d583 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:18.906974 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358ab67-e419-40c1-bdd3-a0e569a3d583 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:18.911044 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f84db-dd6c-4031-879e-e8d17f88f075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:18.911840 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f84db-dd6c-4031-879e-e8d17f88f075 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:18.912126 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f84db-dd6c-4031-879e-e8d17f88f075 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:18.912413 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f84db-dd6c-4031-879e-e8d17f88f075 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:18.924389 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f84db-dd6c-4031-879e-e8d17f88f075 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:18.926287 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f84db-dd6c-4031-879e-e8d17f88f075 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:18.944875 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-2d9f84db-dd6c-4031-879e-e8d17f88f075 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:18.946384 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 414/833] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:18.952922 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b46545-32f6-4cc0-97e2-169025fd8c8b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:18.963108 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b46545-32f6-4cc0-97e2-169025fd8c8b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:18.968667 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2d5e1-0dd0-40ea-b98d-61325c925ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:18.969587 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2d5e1-0dd0-40ea-b98d-61325c925ada admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:18.970090 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2d5e1-0dd0-40ea-b98d-61325c925ada admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:18.970574 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2d5e1-0dd0-40ea-b98d-61325c925ada admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:18.971483 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2d5e1-0dd0-40ea-b98d-61325c925ada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:18.972005 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2d5e1-0dd0-40ea-b98d-61325c925ada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:18.973883 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2d5e1-0dd0-40ea-b98d-61325c925ada admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:18.987219 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 420/834] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:18.993749 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f84db-dd6c-4031-879e-e8d17f88f075 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:19.004546 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f84db-dd6c-4031-879e-e8d17f88f075 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:19.009758 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b427e6-402e-49ec-8588-d8b91f9a336d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:19.010798 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b427e6-402e-49ec-8588-d8b91f9a336d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.011295 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b427e6-402e-49ec-8588-d8b91f9a336d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.011917 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b427e6-402e-49ec-8588-d8b91f9a336d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.019762 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b427e6-402e-49ec-8588-d8b91f9a336d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:19.022128 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b427e6-402e-49ec-8588-d8b91f9a336d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:19.040594 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-d7b427e6-402e-49ec-8588-d8b91f9a336d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 01:14:19.042115 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 415/835] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Aug 27 01:14:18 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:19.048391 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2d5e1-0dd0-40ea-b98d-61325c925ada admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:19.059106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2d5e1-0dd0-40ea-b98d-61325c925ada admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:19.063957 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242a7bf-5e4f-48f3-b3eb-4ce153a707c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:19.064877 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242a7bf-5e4f-48f3-b3eb-4ce153a707c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.065400 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242a7bf-5e4f-48f3-b3eb-4ce153a707c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.065870 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242a7bf-5e4f-48f3-b3eb-4ce153a707c0 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.066889 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242a7bf-5e4f-48f3-b3eb-4ce153a707c0 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:19.067391 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242a7bf-5e4f-48f3-b3eb-4ce153a707c0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:19.069525 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242a7bf-5e4f-48f3-b3eb-4ce153a707c0 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:19.088359 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 421/836] 10.222.0.25 () {56 vars in 1171 bytes} [Fri Aug 27 01:14:19 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:19.095127 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b427e6-402e-49ec-8588-d8b91f9a336d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:19.105018 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b427e6-402e-49ec-8588-d8b91f9a336d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:19.109968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e5377-0514-4208-8933-bb5ac8597cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:19.110617 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e5377-0514-4208-8933-bb5ac8597cda admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.110901 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e5377-0514-4208-8933-bb5ac8597cda admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.111180 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e5377-0514-4208-8933-bb5ac8597cda admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.119448 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e5377-0514-4208-8933-bb5ac8597cda admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:19.121916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e5377-0514-4208-8933-bb5ac8597cda admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:19.131496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 416/837] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:14:19 2021] GET /identity/v3/auth/tokens => generated 2105 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:14:19.138112 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242a7bf-5e4f-48f3-b3eb-4ce153a707c0 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:19.147904 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242a7bf-5e4f-48f3-b3eb-4ce153a707c0 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:19.153472 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b4fe6-2c2f-4b53-90b4-2fa4c85c0c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:19.154260 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b4fe6-2c2f-4b53-90b4-2fa4c85c0c55 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.154541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b4fe6-2c2f-4b53-90b4-2fa4c85c0c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.154816 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b4fe6-2c2f-4b53-90b4-2fa4c85c0c55 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.165380 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b4fe6-2c2f-4b53-90b4-2fa4c85c0c55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:19.167232 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b4fe6-2c2f-4b53-90b4-2fa4c85c0c55 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:19.184439 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-d97b4fe6-2c2f-4b53-90b4-2fa4c85c0c55 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:19.185968 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 422/838] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:19.192103 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e5377-0514-4208-8933-bb5ac8597cda admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:19.202059 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e5377-0514-4208-8933-bb5ac8597cda admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:19.207185 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4e94a-582f-457c-9a47-77ef88653933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:19.208074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4e94a-582f-457c-9a47-77ef88653933 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.208633 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4e94a-582f-457c-9a47-77ef88653933 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.209135 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4e94a-582f-457c-9a47-77ef88653933 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.210061 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4e94a-582f-457c-9a47-77ef88653933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:19.210562 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4e94a-582f-457c-9a47-77ef88653933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:19.212348 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4e94a-582f-457c-9a47-77ef88653933 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:19.225137 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 417/839] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:19.232350 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b4fe6-2c2f-4b53-90b4-2fa4c85c0c55 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:19.242574 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b4fe6-2c2f-4b53-90b4-2fa4c85c0c55 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:19.247933 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15622da6-37bf-4d7b-946a-a77ea0d03363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:19.249047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15622da6-37bf-4d7b-946a-a77ea0d03363 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.249580 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15622da6-37bf-4d7b-946a-a77ea0d03363 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.250064 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15622da6-37bf-4d7b-946a-a77ea0d03363 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.257630 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15622da6-37bf-4d7b-946a-a77ea0d03363 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:19.259905 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15622da6-37bf-4d7b-946a-a77ea0d03363 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:19.274749 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-15622da6-37bf-4d7b-946a-a77ea0d03363 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:14:19.276764 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 423/840] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:19.284476 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4e94a-582f-457c-9a47-77ef88653933 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:19.296012 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4e94a-582f-457c-9a47-77ef88653933 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:19.301195 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0eb5ff-8740-4422-92c7-4beeb6076ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:19.302195 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eb5ff-8740-4422-92c7-4beeb6076ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.302706 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eb5ff-8740-4422-92c7-4beeb6076ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.303176 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eb5ff-8740-4422-92c7-4beeb6076ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.304239 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0eb5ff-8740-4422-92c7-4beeb6076ae6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:19.304755 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0eb5ff-8740-4422-92c7-4beeb6076ae6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:19.306889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0eb5ff-8740-4422-92c7-4beeb6076ae6 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:19.320496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 418/841] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:14:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:19.328076 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15622da6-37bf-4d7b-946a-a77ea0d03363 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:19.339061 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15622da6-37bf-4d7b-946a-a77ea0d03363 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:19.344144 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49fd6c-8436-4bea-b7ff-910176aa2dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:19.345087 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49fd6c-8436-4bea-b7ff-910176aa2dcf admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.345587 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49fd6c-8436-4bea-b7ff-910176aa2dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.346055 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49fd6c-8436-4bea-b7ff-910176aa2dcf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.347098 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49fd6c-8436-4bea-b7ff-910176aa2dcf admin admin] RBAC: Adding query filter params (role.id=68b568bdff8d44a8b4837e976adb483a, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=3f65fb7e73db469f8b171c3126005427) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:19.347609 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49fd6c-8436-4bea-b7ff-910176aa2dcf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:19.349798 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49fd6c-8436-4bea-b7ff-910176aa2dcf admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:19.357240 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 424/842] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:14:19 2021] GET /identity/v3/role_assignments?user.id=3f65fb7e73db469f8b171c3126005427&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=68b568bdff8d44a8b4837e976adb483a => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:19.361029 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb2c15-a352-4fca-ba36-7c27510ad230 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.361029 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb2c15-a352-4fca-ba36-7c27510ad230 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.361029 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb2c15-a352-4fca-ba36-7c27510ad230 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.361029 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 419/843] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:14:19.366440 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb94c-c1a5-4643-a77c-03257e3880f2 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.366717 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb94c-c1a5-4643-a77c-03257e3880f2 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.367000 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb94c-c1a5-4643-a77c-03257e3880f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.393476 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-9a9bb94c-c1a5-4643-a77c-03257e3880f2 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:19.394754 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-9a9bb94c-c1a5-4643-a77c-03257e3880f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:19.403893 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 425/844] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:19 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:19.429178 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb2c15-a352-4fca-ba36-7c27510ad230 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:19.442896 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb2c15-a352-4fca-ba36-7c27510ad230 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:19.447661 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d887b-8632-49b3-8970-0902c0daebac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:19.448531 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d887b-8632-49b3-8970-0902c0daebac admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.448822 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d887b-8632-49b3-8970-0902c0daebac admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.449928 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d887b-8632-49b3-8970-0902c0daebac admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.450705 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d887b-8632-49b3-8970-0902c0daebac admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:19.452478 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d887b-8632-49b3-8970-0902c0daebac admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:19.465939 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-a31d887b-8632-49b3-8970-0902c0daebac admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 01:14:19.467538 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 420/845] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 01:14:19 2021] GET /identity/v3/services/object-store => generated 93 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:19.474470 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bb94c-c1a5-4643-a77c-03257e3880f2 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:19.484493 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bb94c-c1a5-4643-a77c-03257e3880f2 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:19.489305 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98619cd5-3cfc-471b-9ab5-84d99184484f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:19.489986 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619cd5-3cfc-471b-9ab5-84d99184484f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.490271 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619cd5-3cfc-471b-9ab5-84d99184484f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.490550 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619cd5-3cfc-471b-9ab5-84d99184484f admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.491388 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98619cd5-3cfc-471b-9ab5-84d99184484f admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:19.491699 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98619cd5-3cfc-471b-9ab5-84d99184484f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:19.493414 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98619cd5-3cfc-471b-9ab5-84d99184484f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:19.499492 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 426/846] 10.222.0.25 () {56 vars in 1144 bytes} [Fri Aug 27 01:14:19 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:19.506002 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d887b-8632-49b3-8970-0902c0daebac admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:19.517016 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d887b-8632-49b3-8970-0902c0daebac admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:19.521985 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57200b-9b49-48dc-b432-faaa11689488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:19.522730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57200b-9b49-48dc-b432-faaa11689488 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.523013 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57200b-9b49-48dc-b432-faaa11689488 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.523292 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57200b-9b49-48dc-b432-faaa11689488 admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.524102 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57200b-9b49-48dc-b432-faaa11689488 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:19.524417 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57200b-9b49-48dc-b432-faaa11689488 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:19.526143 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57200b-9b49-48dc-b432-faaa11689488 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:19.537321 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 421/847] 10.222.0.25 () {56 vars in 1144 bytes} [Fri Aug 27 01:14:19 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:19.540028 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98619cd5-3cfc-471b-9ab5-84d99184484f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:19.552280 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98619cd5-3cfc-471b-9ab5-84d99184484f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:19.557498 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c03a76-b716-44c4-98ff-9f913e7f827f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:19.558212 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c03a76-b716-44c4-98ff-9f913e7f827f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.559039 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c03a76-b716-44c4-98ff-9f913e7f827f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.559317 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c03a76-b716-44c4-98ff-9f913e7f827f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.560132 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c03a76-b716-44c4-98ff-9f913e7f827f admin admin] RBAC: Adding query filter params (interface=public, service_id=76ff000bd02647cb8845ac2fe1cd1cd4, region_id=RegionOne) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:19.560451 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c03a76-b716-44c4-98ff-9f913e7f827f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:19.562165 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c03a76-b716-44c4-98ff-9f913e7f827f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:19.569133 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 427/848] 10.222.0.25 () {56 vars in 1273 bytes} [Fri Aug 27 01:14:19 2021] GET /identity/v3/endpoints?service_id=76ff000bd02647cb8845ac2fe1cd1cd4&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:19.575666 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57200b-9b49-48dc-b432-faaa11689488 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:19.586648 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57200b-9b49-48dc-b432-faaa11689488 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:19.592212 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07060c93-53e2-4568-9073-4e905c2ff709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:19.592965 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07060c93-53e2-4568-9073-4e905c2ff709 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.593254 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07060c93-53e2-4568-9073-4e905c2ff709 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.593537 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07060c93-53e2-4568-9073-4e905c2ff709 admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.594314 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07060c93-53e2-4568-9073-4e905c2ff709 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:19.596021 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07060c93-53e2-4568-9073-4e905c2ff709 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:19.602801 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 422/849] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 01:14:19 2021] GET /identity/v3/services => generated 1497 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:14:19.638209 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5b688-ab7f-4655-ae99-b5044354bce6 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.638531 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5b688-ab7f-4655-ae99-b5044354bce6 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.638755 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5b688-ab7f-4655-ae99-b5044354bce6 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.640975 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 428/850] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:19.648657 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56cd02-3916-4409-aed3-c7dcf0214c97 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.648993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56cd02-3916-4409-aed3-c7dcf0214c97 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.649272 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56cd02-3916-4409-aed3-c7dcf0214c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.670981 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-8a56cd02-3916-4409-aed3-c7dcf0214c97 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:19.672218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8a56cd02-3916-4409-aed3-c7dcf0214c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:19.681077 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 423/851] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:19 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:19.706103 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5b688-ab7f-4655-ae99-b5044354bce6 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:19.720206 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5b688-ab7f-4655-ae99-b5044354bce6 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:19.725686 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec161387-4a3a-48b3-968c-046c586b8200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:19.726920 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec161387-4a3a-48b3-968c-046c586b8200 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.727417 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec161387-4a3a-48b3-968c-046c586b8200 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.728000 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec161387-4a3a-48b3-968c-046c586b8200 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.728876 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec161387-4a3a-48b3-968c-046c586b8200 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:19.731203 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec161387-4a3a-48b3-968c-046c586b8200 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:19.743991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-ec161387-4a3a-48b3-968c-046c586b8200 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 01:14:19.750696 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 429/852] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:19 2021] GET /identity/v3/services/compute => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:19.754870 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56cd02-3916-4409-aed3-c7dcf0214c97 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:19.765547 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56cd02-3916-4409-aed3-c7dcf0214c97 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:19.770838 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1a552-9f74-4f6e-a4cb-e0e1a3c809e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:19.771848 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1a552-9f74-4f6e-a4cb-e0e1a3c809e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.772424 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1a552-9f74-4f6e-a4cb-e0e1a3c809e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.772932 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1a552-9f74-4f6e-a4cb-e0e1a3c809e8 admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.773958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1a552-9f74-4f6e-a4cb-e0e1a3c809e8 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:19.774474 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1a552-9f74-4f6e-a4cb-e0e1a3c809e8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:19.776337 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1a552-9f74-4f6e-a4cb-e0e1a3c809e8 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:19.783080 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 424/853] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 01:14:19 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:19.790139 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec161387-4a3a-48b3-968c-046c586b8200 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:19.801062 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec161387-4a3a-48b3-968c-046c586b8200 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:19.805771 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee12e88-77a5-4a1a-99a0-5007ee358150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:19.806452 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee12e88-77a5-4a1a-99a0-5007ee358150 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.806729 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee12e88-77a5-4a1a-99a0-5007ee358150 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.806998 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee12e88-77a5-4a1a-99a0-5007ee358150 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.807710 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee12e88-77a5-4a1a-99a0-5007ee358150 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:19.808032 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee12e88-77a5-4a1a-99a0-5007ee358150 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:19.810485 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee12e88-77a5-4a1a-99a0-5007ee358150 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:19.816704 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 430/854] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 01:14:19 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:19.873020 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206b688-3220-4454-a914-84ceb5c4e6ff None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.873355 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206b688-3220-4454-a914-84ceb5c4e6ff None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.873627 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206b688-3220-4454-a914-84ceb5c4e6ff None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.875440 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 425/855] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:19.882511 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d394f-fe79-409b-8893-45f0e95d9a4b None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.882847 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d394f-fe79-409b-8893-45f0e95d9a4b None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.883061 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d394f-fe79-409b-8893-45f0e95d9a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.903393 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f52d394f-fe79-409b-8893-45f0e95d9a4b None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:19.904732 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f52d394f-fe79-409b-8893-45f0e95d9a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:19.913244 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 431/856] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:19 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:19.943455 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206b688-3220-4454-a914-84ceb5c4e6ff None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:19.957780 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206b688-3220-4454-a914-84ceb5c4e6ff None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:19.962823 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019addb4-88a0-4b31-ba26-88e74d5e0d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:19.963832 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019addb4-88a0-4b31-ba26-88e74d5e0d26 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:19.964113 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019addb4-88a0-4b31-ba26-88e74d5e0d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:19.964431 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019addb4-88a0-4b31-ba26-88e74d5e0d26 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:19.965757 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019addb4-88a0-4b31-ba26-88e74d5e0d26 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:19.967551 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019addb4-88a0-4b31-ba26-88e74d5e0d26 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:19.979574 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-019addb4-88a0-4b31-ba26-88e74d5e0d26 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 01:14:19.986994 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 426/857] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:14:19 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:19.988334 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d394f-fe79-409b-8893-45f0e95d9a4b None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:19.998259 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d394f-fe79-409b-8893-45f0e95d9a4b None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:20.003592 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f27c50-05c5-4fc9-9b39-d421385e9b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:20.004187 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f27c50-05c5-4fc9-9b39-d421385e9b2e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:20.004463 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f27c50-05c5-4fc9-9b39-d421385e9b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:20.004734 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f27c50-05c5-4fc9-9b39-d421385e9b2e admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:20.005464 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f27c50-05c5-4fc9-9b39-d421385e9b2e admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:20.005763 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f27c50-05c5-4fc9-9b39-d421385e9b2e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:20.007331 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f27c50-05c5-4fc9-9b39-d421385e9b2e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:20.012854 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 432/858] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:14:19 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:20.019153 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019addb4-88a0-4b31-ba26-88e74d5e0d26 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:20.031503 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019addb4-88a0-4b31-ba26-88e74d5e0d26 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:20.037029 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02267c24-158b-4faf-a56d-7f4a14022555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:20.037856 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02267c24-158b-4faf-a56d-7f4a14022555 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:20.038305 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02267c24-158b-4faf-a56d-7f4a14022555 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:20.038721 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02267c24-158b-4faf-a56d-7f4a14022555 admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:20.039571 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02267c24-158b-4faf-a56d-7f4a14022555 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:20.040017 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02267c24-158b-4faf-a56d-7f4a14022555 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:20.041777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02267c24-158b-4faf-a56d-7f4a14022555 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:20.047450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 427/859] 10.222.0.25 () {56 vars in 1136 bytes} [Fri Aug 27 01:14:20 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:20.053930 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f27c50-05c5-4fc9-9b39-d421385e9b2e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:20.069957 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f27c50-05c5-4fc9-9b39-d421385e9b2e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:20.075228 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761711e-6a9b-4e4b-b047-7c739c7638fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:20.075973 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761711e-6a9b-4e4b-b047-7c739c7638fe admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:20.076350 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761711e-6a9b-4e4b-b047-7c739c7638fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:20.076717 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761711e-6a9b-4e4b-b047-7c739c7638fe admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:20.077571 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761711e-6a9b-4e4b-b047-7c739c7638fe admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:20.079500 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761711e-6a9b-4e4b-b047-7c739c7638fe admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:20.182073 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 433/860] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Aug 27 01:14:20 2021] POST /identity/v3/endpoints => generated 346 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:14:21.669463 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cc6e9-9538-493e-bbc9-68607c4641b3 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:21.670133 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cc6e9-9538-493e-bbc9-68607c4641b3 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:21.670133 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cc6e9-9538-493e-bbc9-68607c4641b3 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:21.671971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 428/861] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:21.678044 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc686295-a81f-4707-9342-047aa5012464 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:21.678545 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc686295-a81f-4707-9342-047aa5012464 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:21.678694 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc686295-a81f-4707-9342-047aa5012464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:21.696515 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-cc686295-a81f-4707-9342-047aa5012464 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:21.697738 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-cc686295-a81f-4707-9342-047aa5012464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:21.715519 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 434/862] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:21 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:14:21.739486 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cc6e9-9538-493e-bbc9-68607c4641b3 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:21.752486 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cc6e9-9538-493e-bbc9-68607c4641b3 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:21.757046 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce3c81-c5d5-4201-ab62-1f10affea43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:21.757834 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce3c81-c5d5-4201-ab62-1f10affea43d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:21.758116 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce3c81-c5d5-4201-ab62-1f10affea43d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:21.758390 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce3c81-c5d5-4201-ab62-1f10affea43d admin admin] PATH_INFO: `/v3/services/image` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:21.759038 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce3c81-c5d5-4201-ab62-1f10affea43d admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:21.760645 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce3c81-c5d5-4201-ab62-1f10affea43d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:21.773329 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-6dce3c81-c5d5-4201-ab62-1f10affea43d admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 01:14:21.774978 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 429/863] 10.222.0.25 () {56 vars in 1127 bytes} [Fri Aug 27 01:14:21 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:21.782607 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc686295-a81f-4707-9342-047aa5012464 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:21.792442 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc686295-a81f-4707-9342-047aa5012464 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:21.798576 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1d436-f097-41a3-9195-650f1a673bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:21.799261 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1d436-f097-41a3-9195-650f1a673bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:21.799544 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1d436-f097-41a3-9195-650f1a673bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:21.799951 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1d436-f097-41a3-9195-650f1a673bc2 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:21.800674 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1d436-f097-41a3-9195-650f1a673bc2 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:21.801023 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1d436-f097-41a3-9195-650f1a673bc2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:21.802665 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1d436-f097-41a3-9195-650f1a673bc2 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:21.808504 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 435/864] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:21 2021] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:21.814858 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce3c81-c5d5-4201-ab62-1f10affea43d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:21.826560 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce3c81-c5d5-4201-ab62-1f10affea43d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:21.831450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8a235-18de-488f-95e2-06c13133b37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:21.832112 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8a235-18de-488f-95e2-06c13133b37f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:21.832396 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8a235-18de-488f-95e2-06c13133b37f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:21.832669 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8a235-18de-488f-95e2-06c13133b37f admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:21.833404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8a235-18de-488f-95e2-06c13133b37f admin admin] RBAC: Adding query filter params (type=image) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:21.833707 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8a235-18de-488f-95e2-06c13133b37f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:21.835278 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8a235-18de-488f-95e2-06c13133b37f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:21.841076 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 430/865] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:21 2021] GET /identity/v3/services?type=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:21.853579 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3453fbf-2911-44c8-9343-31a1b073dfc1 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:21.853890 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3453fbf-2911-44c8-9343-31a1b073dfc1 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:21.854037 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3453fbf-2911-44c8-9343-31a1b073dfc1 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:21.856289 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 436/866] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:21.862949 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab30e2-75e6-4ca3-b209-1687630f17bd None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:21.863275 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab30e2-75e6-4ca3-b209-1687630f17bd None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:21.863509 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab30e2-75e6-4ca3-b209-1687630f17bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:21.886864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-9fab30e2-75e6-4ca3-b209-1687630f17bd None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:21.888143 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-9fab30e2-75e6-4ca3-b209-1687630f17bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:21.896715 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 431/867] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:21 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:21.921566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3453fbf-2911-44c8-9343-31a1b073dfc1 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:21.935108 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3453fbf-2911-44c8-9343-31a1b073dfc1 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:21.939904 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87788aa-589a-433e-9059-2a29deff5c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:21.940720 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87788aa-589a-433e-9059-2a29deff5c52 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:21.941032 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87788aa-589a-433e-9059-2a29deff5c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:21.941311 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87788aa-589a-433e-9059-2a29deff5c52 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:21.941970 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87788aa-589a-433e-9059-2a29deff5c52 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:21.943586 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87788aa-589a-433e-9059-2a29deff5c52 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:21.956098 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-b87788aa-589a-433e-9059-2a29deff5c52 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 01:14:21.957706 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 437/868] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 01:14:21 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:21.965245 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab30e2-75e6-4ca3-b209-1687630f17bd None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:21.974785 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab30e2-75e6-4ca3-b209-1687630f17bd None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:21.979706 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfdc8c-1439-4ba9-ad75-467a6a983ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:21.980451 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfdc8c-1439-4ba9-ad75-467a6a983ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:21.980738 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfdc8c-1439-4ba9-ad75-467a6a983ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:21.981105 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfdc8c-1439-4ba9-ad75-467a6a983ff1 admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:21.981880 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfdc8c-1439-4ba9-ad75-467a6a983ff1 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:21.982190 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfdc8c-1439-4ba9-ad75-467a6a983ff1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:21.983817 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfdc8c-1439-4ba9-ad75-467a6a983ff1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:21.989561 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 432/869] 10.222.0.25 () {56 vars in 1144 bytes} [Fri Aug 27 01:14:21 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:21.996855 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87788aa-589a-433e-9059-2a29deff5c52 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:22.011041 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87788aa-589a-433e-9059-2a29deff5c52 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:22.017003 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef7955-1ee1-4501-9cb4-0acb074f4839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:22.017827 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef7955-1ee1-4501-9cb4-0acb074f4839 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:22.018208 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef7955-1ee1-4501-9cb4-0acb074f4839 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:22.018577 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef7955-1ee1-4501-9cb4-0acb074f4839 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:22.019401 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef7955-1ee1-4501-9cb4-0acb074f4839 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:22.019804 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef7955-1ee1-4501-9cb4-0acb074f4839 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:22.021624 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef7955-1ee1-4501-9cb4-0acb074f4839 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:22.028967 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 438/870] 10.222.0.25 () {56 vars in 1144 bytes} [Fri Aug 27 01:14:21 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:22.035036 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfdc8c-1439-4ba9-ad75-467a6a983ff1 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:22.045606 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfdc8c-1439-4ba9-ad75-467a6a983ff1 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:22.051652 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2830e24-d032-4d4f-ae48-500bbdbba324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:22.052517 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2830e24-d032-4d4f-ae48-500bbdbba324 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:22.052979 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2830e24-d032-4d4f-ae48-500bbdbba324 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:22.053404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2830e24-d032-4d4f-ae48-500bbdbba324 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:22.054324 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2830e24-d032-4d4f-ae48-500bbdbba324 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:22.056050 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2830e24-d032-4d4f-ae48-500bbdbba324 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:22.094314 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e669-f4a6-40ef-8905-4c43337211f2 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:22.094600 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e669-f4a6-40ef-8905-4c43337211f2 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:22.094876 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e669-f4a6-40ef-8905-4c43337211f2 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:22.096669 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 439/871] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:14:22.102374 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a4795-dfdb-4d06-a7cf-27398e16cb79 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:22.102660 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a4795-dfdb-4d06-a7cf-27398e16cb79 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:22.102940 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a4795-dfdb-4d06-a7cf-27398e16cb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:22.122009 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-947a4795-dfdb-4d06-a7cf-27398e16cb79 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:22.123327 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-947a4795-dfdb-4d06-a7cf-27398e16cb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:22.131451 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 440/872] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:22 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:14:22.136392 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 433/873] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Aug 27 01:14:22 2021] POST /identity/v3/endpoints => generated 349 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:14:22.156388 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a4795-dfdb-4d06-a7cf-27398e16cb79 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:22.166453 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a4795-dfdb-4d06-a7cf-27398e16cb79 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:22.182788 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a03072-a40c-4eea-b0d4-0570197b9b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:22.183476 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a03072-a40c-4eea-b0d4-0570197b9b02 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:22.183808 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a03072-a40c-4eea-b0d4-0570197b9b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:22.184084 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a03072-a40c-4eea-b0d4-0570197b9b02 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:22.184897 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a03072-a40c-4eea-b0d4-0570197b9b02 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:22.186643 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a03072-a40c-4eea-b0d4-0570197b9b02 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:22.267471 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 441/874] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 01:14:22 2021] POST /identity/v3/services => generated 242 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:14:22.407157 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd10fc-dbd7-467c-97a3-eaae6a0b6cf9 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:22.407526 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd10fc-dbd7-467c-97a3-eaae6a0b6cf9 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:22.407703 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd10fc-dbd7-467c-97a3-eaae6a0b6cf9 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:22.409861 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 434/875] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:22.419966 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409414c-73ea-4029-9066-2512f4aee565 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:22.420560 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409414c-73ea-4029-9066-2512f4aee565 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:22.421192 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409414c-73ea-4029-9066-2512f4aee565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:22.440604 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f409414c-73ea-4029-9066-2512f4aee565 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:22.442178 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f409414c-73ea-4029-9066-2512f4aee565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:22.461222 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 442/876] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:22 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:22.486523 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd10fc-dbd7-467c-97a3-eaae6a0b6cf9 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:22.500142 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd10fc-dbd7-467c-97a3-eaae6a0b6cf9 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:22.504558 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640361f-d9d9-4194-86c4-52bd290d2883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:22.505236 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640361f-d9d9-4194-86c4-52bd290d2883 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:22.505515 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640361f-d9d9-4194-86c4-52bd290d2883 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:22.505788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640361f-d9d9-4194-86c4-52bd290d2883 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:22.506498 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640361f-d9d9-4194-86c4-52bd290d2883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:22.508318 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640361f-d9d9-4194-86c4-52bd290d2883 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:22.509789 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.common [None req-c640361f-d9d9-4194-86c4-52bd290d2883 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 27 01:14:22.557997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.sql.core [None req-c640361f-d9d9-4194-86c4-52bd290d2883 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 27 01:14:22.557997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 27 01:14:22.557997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [parameters: {'id': 'b01b9a946e384e1780a4fe11b2be60ff', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 27 01:14:22.557997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73679) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 01:14:22.565217 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-c640361f-d9d9-4194-86c4-52bd290d2883 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b01b9a946e384e1780a4fe11b2be60ff.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b01b9a946e384e1780a4fe11b2be60ff. Aug 27 01:14:22.566842 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 435/877] 10.222.0.25 () {60 vars in 1162 bytes} [Fri Aug 27 01:14:22 2021] POST /identity/v3/projects => generated 262 bytes in 81 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:22.573374 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409414c-73ea-4029-9066-2512f4aee565 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:22.583016 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409414c-73ea-4029-9066-2512f4aee565 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:22.587866 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dff8d5-9222-4143-b930-36e10ac4e06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:22.588935 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dff8d5-9222-4143-b930-36e10ac4e06f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:22.589425 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dff8d5-9222-4143-b930-36e10ac4e06f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:22.590408 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dff8d5-9222-4143-b930-36e10ac4e06f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:22.597703 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dff8d5-9222-4143-b930-36e10ac4e06f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:22.599857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dff8d5-9222-4143-b930-36e10ac4e06f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:22.613101 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-73dff8d5-9222-4143-b930-36e10ac4e06f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:14:22.614829 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 443/878] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:22.622299 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640361f-d9d9-4194-86c4-52bd290d2883 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:22.634773 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640361f-d9d9-4194-86c4-52bd290d2883 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:22.639813 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6488ea-4722-44a7-83f4-139681c94d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:22.640715 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6488ea-4722-44a7-83f4-139681c94d96 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:22.641260 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6488ea-4722-44a7-83f4-139681c94d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:22.641724 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6488ea-4722-44a7-83f4-139681c94d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:22.642731 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6488ea-4722-44a7-83f4-139681c94d96 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:22.643286 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6488ea-4722-44a7-83f4-139681c94d96 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:22.645623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6488ea-4722-44a7-83f4-139681c94d96 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:22.667728 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 436/879] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 01:14:22 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:24.044778 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c576606-189c-4b33-87a7-7c7efb99d62f None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:24.045318 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c576606-189c-4b33-87a7-7c7efb99d62f None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:24.045392 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c576606-189c-4b33-87a7-7c7efb99d62f None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:24.047385 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 444/880] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:24.053360 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc926b2d-4d03-45cb-aafa-ea9f06204263 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:24.054167 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc926b2d-4d03-45cb-aafa-ea9f06204263 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:24.054648 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc926b2d-4d03-45cb-aafa-ea9f06204263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:24.073163 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-cc926b2d-4d03-45cb-aafa-ea9f06204263 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:24.075028 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-cc926b2d-4d03-45cb-aafa-ea9f06204263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:24.083552 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 437/881] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:24 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:24.107467 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c576606-189c-4b33-87a7-7c7efb99d62f None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:24.120283 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c576606-189c-4b33-87a7-7c7efb99d62f None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:24.125281 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b959488-d3c9-46f9-9f95-7003ab1c7ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:24.125923 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b959488-d3c9-46f9-9f95-7003ab1c7ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:24.126200 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b959488-d3c9-46f9-9f95-7003ab1c7ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:24.126470 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b959488-d3c9-46f9-9f95-7003ab1c7ce2 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:24.127184 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b959488-d3c9-46f9-9f95-7003ab1c7ce2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:24.128756 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b959488-d3c9-46f9-9f95-7003ab1c7ce2 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:24.203602 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 445/882] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 01:14:24 2021] POST /identity/v3/services => generated 242 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:14:24.340958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b428a2-248e-412a-8fa7-2480e958d735 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:24.341603 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b428a2-248e-412a-8fa7-2480e958d735 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:24.342083 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b428a2-248e-412a-8fa7-2480e958d735 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:24.344567 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 438/883] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:24.351511 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffea7af-812c-4d53-bf6c-ee55f6817597 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:24.351787 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffea7af-812c-4d53-bf6c-ee55f6817597 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:24.352071 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffea7af-812c-4d53-bf6c-ee55f6817597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:24.372915 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-2ffea7af-812c-4d53-bf6c-ee55f6817597 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:24.374126 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-2ffea7af-812c-4d53-bf6c-ee55f6817597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:24.393024 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 446/884] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:24 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:24.418013 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b428a2-248e-412a-8fa7-2480e958d735 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:24.431445 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b428a2-248e-412a-8fa7-2480e958d735 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:24.437553 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7e886-f951-462a-91d9-46f6cea1a076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:24.438597 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7e886-f951-462a-91d9-46f6cea1a076 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:24.439077 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7e886-f951-462a-91d9-46f6cea1a076 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:24.439572 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7e886-f951-462a-91d9-46f6cea1a076 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:24.440422 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7e886-f951-462a-91d9-46f6cea1a076 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:24.442249 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7e886-f951-462a-91d9-46f6cea1a076 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:24.455200 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-8de7e886-f951-462a-91d9-46f6cea1a076 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 01:14:24.456755 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 439/885] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 01:14:24 2021] GET /identity/v3/services/object-store => generated 93 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:24.463923 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffea7af-812c-4d53-bf6c-ee55f6817597 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:24.474074 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffea7af-812c-4d53-bf6c-ee55f6817597 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:24.479367 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9aae3-cbf1-44cf-972e-eace67f8064f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:24.480999 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9aae3-cbf1-44cf-972e-eace67f8064f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:24.481487 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9aae3-cbf1-44cf-972e-eace67f8064f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:24.481978 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9aae3-cbf1-44cf-972e-eace67f8064f admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:24.482914 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9aae3-cbf1-44cf-972e-eace67f8064f admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:24.483451 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9aae3-cbf1-44cf-972e-eace67f8064f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:24.485328 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9aae3-cbf1-44cf-972e-eace67f8064f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:24.496951 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 447/886] 10.222.0.25 () {56 vars in 1144 bytes} [Fri Aug 27 01:14:24 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:24.498688 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7e886-f951-462a-91d9-46f6cea1a076 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:24.509110 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7e886-f951-462a-91d9-46f6cea1a076 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:24.514996 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7ecbe-8852-47d8-8350-cf2f3b5b305b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:24.515900 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7ecbe-8852-47d8-8350-cf2f3b5b305b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:24.516405 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7ecbe-8852-47d8-8350-cf2f3b5b305b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:24.516945 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7ecbe-8852-47d8-8350-cf2f3b5b305b admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:24.517866 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7ecbe-8852-47d8-8350-cf2f3b5b305b admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:24.518371 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7ecbe-8852-47d8-8350-cf2f3b5b305b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:24.520152 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7ecbe-8852-47d8-8350-cf2f3b5b305b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:24.531569 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 440/887] 10.222.0.25 () {56 vars in 1144 bytes} [Fri Aug 27 01:14:24 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:24.533273 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9aae3-cbf1-44cf-972e-eace67f8064f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:24.543797 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9aae3-cbf1-44cf-972e-eace67f8064f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:24.548767 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919a3ff-abcf-47a0-9876-79787c0cf404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:24.549686 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919a3ff-abcf-47a0-9876-79787c0cf404 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:24.550186 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919a3ff-abcf-47a0-9876-79787c0cf404 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:24.550673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919a3ff-abcf-47a0-9876-79787c0cf404 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:24.551652 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919a3ff-abcf-47a0-9876-79787c0cf404 admin admin] RBAC: Adding query filter params (interface=admin, service_id=76ff000bd02647cb8845ac2fe1cd1cd4, region_id=RegionOne) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:24.552158 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919a3ff-abcf-47a0-9876-79787c0cf404 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:24.553974 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919a3ff-abcf-47a0-9876-79787c0cf404 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:24.557926 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447799a-21ad-4f38-b884-b59f88a07cb9 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:24.559096 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447799a-21ad-4f38-b884-b59f88a07cb9 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:24.559570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447799a-21ad-4f38-b884-b59f88a07cb9 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:24.566104 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 448/889] 10.222.0.25 () {56 vars in 1271 bytes} [Fri Aug 27 01:14:24 2021] GET /identity/v3/endpoints?service_id=76ff000bd02647cb8845ac2fe1cd1cd4&interface=admin®ion_id=RegionOne => generated 193 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:24.566401 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 441/889] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:24.567922 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038eb6-aeff-41ca-b41a-6e15dc537a5c None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:24.568208 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038eb6-aeff-41ca-b41a-6e15dc537a5c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:24.568486 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038eb6-aeff-41ca-b41a-6e15dc537a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:24.569128 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447799a-21ad-4f38-b884-b59f88a07cb9 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:24.582813 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447799a-21ad-4f38-b884-b59f88a07cb9 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:24.587467 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-40038eb6-aeff-41ca-b41a-6e15dc537a5c None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:24.588013 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be076815-643d-445a-b0f3-fb068ba89d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:24.588735 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-40038eb6-aeff-41ca-b41a-6e15dc537a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:24.589184 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be076815-643d-445a-b0f3-fb068ba89d27 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:24.590320 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be076815-643d-445a-b0f3-fb068ba89d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:24.590807 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be076815-643d-445a-b0f3-fb068ba89d27 admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:24.591922 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be076815-643d-445a-b0f3-fb068ba89d27 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:24.594025 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be076815-643d-445a-b0f3-fb068ba89d27 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:24.597746 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 449/890] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:24 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:14:24.608998 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 442/891] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 01:14:24 2021] GET /identity/v3/services => generated 1957 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:14:24.623514 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038eb6-aeff-41ca-b41a-6e15dc537a5c None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:24.634365 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038eb6-aeff-41ca-b41a-6e15dc537a5c None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:24.639579 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec1c9c-879a-41b7-b638-2f39f9075783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:24.640488 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec1c9c-879a-41b7-b638-2f39f9075783 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:24.640771 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec1c9c-879a-41b7-b638-2f39f9075783 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:24.641074 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec1c9c-879a-41b7-b638-2f39f9075783 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:24.641788 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec1c9c-879a-41b7-b638-2f39f9075783 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:24.643468 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec1c9c-879a-41b7-b638-2f39f9075783 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:24.655462 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-cbec1c9c-879a-41b7-b638-2f39f9075783 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 01:14:24.661267 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 450/892] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:24 2021] GET /identity/v3/services/compute => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:24.664025 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be076815-643d-445a-b0f3-fb068ba89d27 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:24.675179 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be076815-643d-445a-b0f3-fb068ba89d27 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:24.680498 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf85d17-fb51-4e2f-918c-f01caa9a59bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:24.681636 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf85d17-fb51-4e2f-918c-f01caa9a59bf admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:24.682121 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf85d17-fb51-4e2f-918c-f01caa9a59bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:24.682654 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf85d17-fb51-4e2f-918c-f01caa9a59bf admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:24.684371 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf85d17-fb51-4e2f-918c-f01caa9a59bf admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:24.685009 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf85d17-fb51-4e2f-918c-f01caa9a59bf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:24.686894 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf85d17-fb51-4e2f-918c-f01caa9a59bf admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:24.693414 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 443/893] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 01:14:24 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:24.700096 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec1c9c-879a-41b7-b638-2f39f9075783 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:24.711147 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec1c9c-879a-41b7-b638-2f39f9075783 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:24.716770 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e2cdc-1468-4cf1-a01b-1aa4ae0ded1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:24.717837 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e2cdc-1468-4cf1-a01b-1aa4ae0ded1b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:24.718316 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e2cdc-1468-4cf1-a01b-1aa4ae0ded1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:24.718784 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e2cdc-1468-4cf1-a01b-1aa4ae0ded1b admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:24.719713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e2cdc-1468-4cf1-a01b-1aa4ae0ded1b admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:24.720499 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e2cdc-1468-4cf1-a01b-1aa4ae0ded1b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:24.722378 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e2cdc-1468-4cf1-a01b-1aa4ae0ded1b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:24.728810 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 451/894] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 01:14:24 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:24.737443 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf85d17-fb51-4e2f-918c-f01caa9a59bf admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:24.748869 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf85d17-fb51-4e2f-918c-f01caa9a59bf admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:24.754252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a264e4-aea1-4a43-b3e1-44f8ec56b557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:24.755342 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a264e4-aea1-4a43-b3e1-44f8ec56b557 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:24.755841 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a264e4-aea1-4a43-b3e1-44f8ec56b557 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:24.756309 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a264e4-aea1-4a43-b3e1-44f8ec56b557 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:24.757377 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a264e4-aea1-4a43-b3e1-44f8ec56b557 admin admin] RBAC: Adding query filter params (interface=public, service_id=86b92dd96f094a33814a32a74f6191a7, region_id=RegionOne) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:24.757925 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a264e4-aea1-4a43-b3e1-44f8ec56b557 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:24.759763 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a264e4-aea1-4a43-b3e1-44f8ec56b557 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:24.766988 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 444/895] 10.222.0.25 () {56 vars in 1273 bytes} [Fri Aug 27 01:14:24 2021] GET /identity/v3/endpoints?service_id=86b92dd96f094a33814a32a74f6191a7&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:24.774106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e2cdc-1468-4cf1-a01b-1aa4ae0ded1b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:24.785367 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e2cdc-1468-4cf1-a01b-1aa4ae0ded1b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:24.790181 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6cd6c-4386-4a12-8226-efe6914b469c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:24.790861 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6cd6c-4386-4a12-8226-efe6914b469c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:24.791143 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6cd6c-4386-4a12-8226-efe6914b469c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:24.791412 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6cd6c-4386-4a12-8226-efe6914b469c admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:24.792077 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6cd6c-4386-4a12-8226-efe6914b469c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:24.794475 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6cd6c-4386-4a12-8226-efe6914b469c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:24.801616 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 452/896] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 01:14:24 2021] GET /identity/v3/services => generated 1957 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:14:24.935525 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7797c8-9088-4424-aa84-c0f9b237fcc0 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:24.935868 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7797c8-9088-4424-aa84-c0f9b237fcc0 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:24.938562 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7797c8-9088-4424-aa84-c0f9b237fcc0 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:24.938771 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 445/897] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:24.944583 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666b2e8-313c-4a14-825f-65c542f8f352 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:24.944892 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666b2e8-313c-4a14-825f-65c542f8f352 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:24.945173 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666b2e8-313c-4a14-825f-65c542f8f352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:24.965624 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-8666b2e8-313c-4a14-825f-65c542f8f352 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:24.966901 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-8666b2e8-313c-4a14-825f-65c542f8f352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:24.975371 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 453/898] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:24 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:25.003178 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7797c8-9088-4424-aa84-c0f9b237fcc0 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:25.017329 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7797c8-9088-4424-aa84-c0f9b237fcc0 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:25.021785 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef643f-4d7e-4e8a-9578-2522bc982ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:25.022443 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef643f-4d7e-4e8a-9578-2522bc982ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:25.022722 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef643f-4d7e-4e8a-9578-2522bc982ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:25.023009 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef643f-4d7e-4e8a-9578-2522bc982ce0 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:25.023715 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef643f-4d7e-4e8a-9578-2522bc982ce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:25.025592 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef643f-4d7e-4e8a-9578-2522bc982ce0 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:25.066475 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.sql.core [None req-38ef643f-4d7e-4e8a-9578-2522bc982ce0 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 27 01:14:25.066475 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 27 01:14:25.066475 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [parameters: {'user_id': 'cf2ac2fcfd3e4e35a5663b7d5973b748', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 27 01:14:25.066475 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73679) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 01:14:25.072807 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-38ef643f-4d7e-4e8a-9578-2522bc982ce0 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 27 01:14:25.074848 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 446/899] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:14:25 2021] POST /identity/v3/users => generated 160 bytes in 72 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:25.081600 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666b2e8-313c-4a14-825f-65c542f8f352 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:25.092112 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666b2e8-313c-4a14-825f-65c542f8f352 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:25.097083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75abe4-220e-4912-832d-feab15a5dc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:25.098157 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75abe4-220e-4912-832d-feab15a5dc37 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:25.098650 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75abe4-220e-4912-832d-feab15a5dc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:25.099123 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75abe4-220e-4912-832d-feab15a5dc37 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:25.108818 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75abe4-220e-4912-832d-feab15a5dc37 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:25.110883 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75abe4-220e-4912-832d-feab15a5dc37 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:25.125277 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-9c75abe4-220e-4912-832d-feab15a5dc37 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 01:14:25.126778 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 454/900] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:14:25 2021] GET /identity/v3/users/cinder => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:25.133185 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef643f-4d7e-4e8a-9578-2522bc982ce0 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:25.143620 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef643f-4d7e-4e8a-9578-2522bc982ce0 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:25.148215 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a808e8-5677-4a5e-a4c8-5c1a7bc4d99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:25.149025 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a808e8-5677-4a5e-a4c8-5c1a7bc4d99a admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:25.149319 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a808e8-5677-4a5e-a4c8-5c1a7bc4d99a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:25.149592 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a808e8-5677-4a5e-a4c8-5c1a7bc4d99a admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:25.150424 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a808e8-5677-4a5e-a4c8-5c1a7bc4d99a admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:25.150731 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a808e8-5677-4a5e-a4c8-5c1a7bc4d99a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:25.153628 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a808e8-5677-4a5e-a4c8-5c1a7bc4d99a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:25.193666 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 447/901] 10.222.0.25 () {56 vars in 1123 bytes} [Fri Aug 27 01:14:25 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:26.448179 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a3f5e-0d10-4e4f-8a0d-24a86a04963e None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:26.448734 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a3f5e-0d10-4e4f-8a0d-24a86a04963e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:26.448867 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a3f5e-0d10-4e4f-8a0d-24a86a04963e None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:26.450783 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 455/902] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:26.456794 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e906e9-a180-4e6e-b861-4856f601d742 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:26.457239 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e906e9-a180-4e6e-b861-4856f601d742 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:26.457416 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e906e9-a180-4e6e-b861-4856f601d742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:26.475813 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-e6e906e9-a180-4e6e-b861-4856f601d742 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:26.477365 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e6e906e9-a180-4e6e-b861-4856f601d742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:26.486228 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 448/903] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:26 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:26.510281 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a3f5e-0d10-4e4f-8a0d-24a86a04963e None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:26.523099 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a3f5e-0d10-4e4f-8a0d-24a86a04963e None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:26.527465 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12d070-3ec0-4c75-8763-1a90c12eeff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:26.528237 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12d070-3ec0-4c75-8763-1a90c12eeff1 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:26.528514 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12d070-3ec0-4c75-8763-1a90c12eeff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:26.528785 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12d070-3ec0-4c75-8763-1a90c12eeff1 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:26.529466 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12d070-3ec0-4c75-8763-1a90c12eeff1 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:26.531034 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12d070-3ec0-4c75-8763-1a90c12eeff1 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:26.541643 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-1a12d070-3ec0-4c75-8763-1a90c12eeff1 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 01:14:26.543006 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 456/904] 10.222.0.25 () {56 vars in 1127 bytes} [Fri Aug 27 01:14:26 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:26.549401 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e906e9-a180-4e6e-b861-4856f601d742 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:26.558856 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e906e9-a180-4e6e-b861-4856f601d742 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:26.563279 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff519e-a8c6-4b14-9f14-de6320c5b0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:26.563930 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff519e-a8c6-4b14-9f14-de6320c5b0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:26.564210 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff519e-a8c6-4b14-9f14-de6320c5b0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:26.564484 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff519e-a8c6-4b14-9f14-de6320c5b0a0 admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:26.565215 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff519e-a8c6-4b14-9f14-de6320c5b0a0 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:26.565519 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff519e-a8c6-4b14-9f14-de6320c5b0a0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:26.567088 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff519e-a8c6-4b14-9f14-de6320c5b0a0 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:26.572144 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 449/905] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:26 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:26.578315 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12d070-3ec0-4c75-8763-1a90c12eeff1 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:26.588124 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12d070-3ec0-4c75-8763-1a90c12eeff1 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:26.593226 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a220b3-ee61-4b05-9dd0-493421f762cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:26.593877 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a220b3-ee61-4b05-9dd0-493421f762cb admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:26.594158 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a220b3-ee61-4b05-9dd0-493421f762cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:26.594438 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a220b3-ee61-4b05-9dd0-493421f762cb admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:26.595135 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a220b3-ee61-4b05-9dd0-493421f762cb admin admin] RBAC: Adding query filter params (type=image) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:26.595440 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a220b3-ee61-4b05-9dd0-493421f762cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:26.597030 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a220b3-ee61-4b05-9dd0-493421f762cb admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:26.601998 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 457/906] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:26 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:26.608319 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff519e-a8c6-4b14-9f14-de6320c5b0a0 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:26.617900 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff519e-a8c6-4b14-9f14-de6320c5b0a0 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:26.623322 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f747d6-dd7b-4245-96fc-4c4c4e2fedda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:26.623965 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f747d6-dd7b-4245-96fc-4c4c4e2fedda admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:26.624243 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f747d6-dd7b-4245-96fc-4c4c4e2fedda admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:26.624512 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f747d6-dd7b-4245-96fc-4c4c4e2fedda admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:26.625316 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f747d6-dd7b-4245-96fc-4c4c4e2fedda admin admin] RBAC: Adding query filter params (interface=public, service_id=ceacc2e0263c47128fd624d7e3f6501c, region_id=RegionOne) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:26.625623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f747d6-dd7b-4245-96fc-4c4c4e2fedda admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:26.627188 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f747d6-dd7b-4245-96fc-4c4c4e2fedda admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:26.632307 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 450/907] 10.222.0.25 () {56 vars in 1273 bytes} [Fri Aug 27 01:14:26 2021] GET /identity/v3/endpoints?service_id=ceacc2e0263c47128fd624d7e3f6501c&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:26.639636 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a220b3-ee61-4b05-9dd0-493421f762cb admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:26.649411 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a220b3-ee61-4b05-9dd0-493421f762cb admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:26.654468 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd20b08-2ead-4744-ac73-e23700630e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:26.655113 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd20b08-2ead-4744-ac73-e23700630e36 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:26.655391 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd20b08-2ead-4744-ac73-e23700630e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:26.655665 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd20b08-2ead-4744-ac73-e23700630e36 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:26.656335 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd20b08-2ead-4744-ac73-e23700630e36 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:26.657939 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd20b08-2ead-4744-ac73-e23700630e36 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:26.664539 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 458/908] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 01:14:26 2021] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:14:26.845182 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38115df4-8ac6-4dfb-8e84-a109ce4fa1f4 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:26.845423 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38115df4-8ac6-4dfb-8e84-a109ce4fa1f4 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:26.845655 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38115df4-8ac6-4dfb-8e84-a109ce4fa1f4 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:26.847417 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 451/909] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:26.853603 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2aa0f-e89a-4460-a231-f599928116b6 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:26.854128 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2aa0f-e89a-4460-a231-f599928116b6 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:26.854619 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2aa0f-e89a-4460-a231-f599928116b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:26.875419 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-48a2aa0f-e89a-4460-a231-f599928116b6 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:26.876612 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-48a2aa0f-e89a-4460-a231-f599928116b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:26.884610 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 459/910] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:26 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:26.908684 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38115df4-8ac6-4dfb-8e84-a109ce4fa1f4 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:26.922367 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38115df4-8ac6-4dfb-8e84-a109ce4fa1f4 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:26.927492 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a966f-cfae-4444-b57d-012c438463eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:26.928322 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a966f-cfae-4444-b57d-012c438463eb admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:26.928604 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a966f-cfae-4444-b57d-012c438463eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:26.928909 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a966f-cfae-4444-b57d-012c438463eb admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:26.929582 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a966f-cfae-4444-b57d-012c438463eb admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:26.931243 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a966f-cfae-4444-b57d-012c438463eb admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:26.943634 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-653a966f-cfae-4444-b57d-012c438463eb admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 01:14:26.945138 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 452/911] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Aug 27 01:14:26 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:26.953095 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2aa0f-e89a-4460-a231-f599928116b6 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:26.962387 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2aa0f-e89a-4460-a231-f599928116b6 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:26.968123 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea50993-29d5-4b42-86d2-12886302a120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:26.968785 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea50993-29d5-4b42-86d2-12886302a120 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:26.969114 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea50993-29d5-4b42-86d2-12886302a120 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:26.969393 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea50993-29d5-4b42-86d2-12886302a120 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:26.970097 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea50993-29d5-4b42-86d2-12886302a120 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:26.970404 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea50993-29d5-4b42-86d2-12886302a120 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:26.971990 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea50993-29d5-4b42-86d2-12886302a120 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:26.977291 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 460/912] 10.222.0.25 () {56 vars in 1144 bytes} [Fri Aug 27 01:14:26 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:26.983763 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a966f-cfae-4444-b57d-012c438463eb admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:26.993390 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a966f-cfae-4444-b57d-012c438463eb admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:26.998028 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4309f-7c31-41f5-8f91-df465cf286fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:26.998198 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806d4a0-ec51-4641-a623-483b0526924c None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:26.998420 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806d4a0-ec51-4641-a623-483b0526924c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:26.998678 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4309f-7c31-41f5-8f91-df465cf286fa admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:26.998782 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806d4a0-ec51-4641-a623-483b0526924c None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:26.998958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4309f-7c31-41f5-8f91-df465cf286fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:26.999233 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4309f-7c31-41f5-8f91-df465cf286fa admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:26.999928 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4309f-7c31-41f5-8f91-df465cf286fa admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:27.000230 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4309f-7c31-41f5-8f91-df465cf286fa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:27.000721 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 461/913] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:27.002030 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4309f-7c31-41f5-8f91-df465cf286fa admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:27.006337 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ddcb1-19b6-49fb-bd5f-6a234376affa None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:27.006622 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ddcb1-19b6-49fb-bd5f-6a234376affa None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:27.006899 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ddcb1-19b6-49fb-bd5f-6a234376affa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:27.007326 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 453/914] 10.222.0.25 () {56 vars in 1144 bytes} [Fri Aug 27 01:14:26 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:27.014810 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4309f-7c31-41f5-8f91-df465cf286fa admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:27.024319 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4309f-7c31-41f5-8f91-df465cf286fa admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:27.025081 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-079ddcb1-19b6-49fb-bd5f-6a234376affa None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:27.026260 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-079ddcb1-19b6-49fb-bd5f-6a234376affa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:27.030055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0efd9-09a4-40b4-a83c-4d95cb0a4764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:27.030802 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0efd9-09a4-40b4-a83c-4d95cb0a4764 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:27.031095 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0efd9-09a4-40b4-a83c-4d95cb0a4764 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:27.031503 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0efd9-09a4-40b4-a83c-4d95cb0a4764 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:27.032252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0efd9-09a4-40b4-a83c-4d95cb0a4764 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:27.033847 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0efd9-09a4-40b4-a83c-4d95cb0a4764 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:27.035619 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 462/915] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:27 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:14:27.059582 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ddcb1-19b6-49fb-bd5f-6a234376affa None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:27.068430 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ddcb1-19b6-49fb-bd5f-6a234376affa None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:27.072976 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da6a3a-240e-4f95-95b1-7f3b7d7fdcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:27.074903 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da6a3a-240e-4f95-95b1-7f3b7d7fdcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:27.075207 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da6a3a-240e-4f95-95b1-7f3b7d7fdcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:27.075471 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da6a3a-240e-4f95-95b1-7f3b7d7fdcd6 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:27.076123 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da6a3a-240e-4f95-95b1-7f3b7d7fdcd6 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:27.077737 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da6a3a-240e-4f95-95b1-7f3b7d7fdcd6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:27.088526 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-78da6a3a-240e-4f95-95b1-7f3b7d7fdcd6 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 01:14:27.090388 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 463/916] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:27 2021] GET /identity/v3/services/compute => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:27.096670 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da6a3a-240e-4f95-95b1-7f3b7d7fdcd6 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:27.106198 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da6a3a-240e-4f95-95b1-7f3b7d7fdcd6 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:27.116869 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 454/917] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Aug 27 01:14:27 2021] POST /identity/v3/endpoints => generated 325 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:14:27.121943 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab558c56-90d9-4b03-a2fe-6133e8701a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:27.122753 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab558c56-90d9-4b03-a2fe-6133e8701a86 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:27.125907 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab558c56-90d9-4b03-a2fe-6133e8701a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:27.125907 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab558c56-90d9-4b03-a2fe-6133e8701a86 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:27.125907 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab558c56-90d9-4b03-a2fe-6133e8701a86 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:27.125907 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab558c56-90d9-4b03-a2fe-6133e8701a86 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:27.126200 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab558c56-90d9-4b03-a2fe-6133e8701a86 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:27.137276 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 464/918] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 01:14:27 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:27.139821 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0efd9-09a4-40b4-a83c-4d95cb0a4764 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:27.151392 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0efd9-09a4-40b4-a83c-4d95cb0a4764 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:27.156357 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00f886-c9ba-4ca8-b9d4-3c1de93f3514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:27.157067 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00f886-c9ba-4ca8-b9d4-3c1de93f3514 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:27.157561 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00f886-c9ba-4ca8-b9d4-3c1de93f3514 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:27.157902 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00f886-c9ba-4ca8-b9d4-3c1de93f3514 admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:27.158710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00f886-c9ba-4ca8-b9d4-3c1de93f3514 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:27.159021 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00f886-c9ba-4ca8-b9d4-3c1de93f3514 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:27.160873 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00f886-c9ba-4ca8-b9d4-3c1de93f3514 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:27.172182 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 455/919] 10.222.0.25 () {56 vars in 1134 bytes} [Fri Aug 27 01:14:27 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:27.173482 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab558c56-90d9-4b03-a2fe-6133e8701a86 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:27.184460 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab558c56-90d9-4b03-a2fe-6133e8701a86 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:27.189340 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8ac82-8fbf-446f-b683-8db2c1d78e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:27.190064 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8ac82-8fbf-446f-b683-8db2c1d78e35 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:27.190379 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8ac82-8fbf-446f-b683-8db2c1d78e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:27.190655 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8ac82-8fbf-446f-b683-8db2c1d78e35 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:27.191468 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8ac82-8fbf-446f-b683-8db2c1d78e35 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:27.193156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8ac82-8fbf-446f-b683-8db2c1d78e35 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:27.268022 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 465/920] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Aug 27 01:14:27 2021] POST /identity/v3/endpoints => generated 334 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:14:28.865617 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f27871-86ec-44d6-a219-732a9e0075ff None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:28.866114 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f27871-86ec-44d6-a219-732a9e0075ff None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:28.866114 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f27871-86ec-44d6-a219-732a9e0075ff None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:28.867999 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 456/921] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:28.874274 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865ad1e-8dfd-4b1f-82e5-abdaf1893558 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:28.874645 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865ad1e-8dfd-4b1f-82e5-abdaf1893558 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:28.874832 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865ad1e-8dfd-4b1f-82e5-abdaf1893558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:28.892480 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-6865ad1e-8dfd-4b1f-82e5-abdaf1893558 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:28.893742 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-6865ad1e-8dfd-4b1f-82e5-abdaf1893558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:28.911862 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 466/922] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:28 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:28.935677 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f27871-86ec-44d6-a219-732a9e0075ff None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:28.948010 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f27871-86ec-44d6-a219-732a9e0075ff None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:28.953288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2b36c-11e7-4634-91d9-2fdb9aaac5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:28.954311 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2b36c-11e7-4634-91d9-2fdb9aaac5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:28.954584 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2b36c-11e7-4634-91d9-2fdb9aaac5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:28.954851 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2b36c-11e7-4634-91d9-2fdb9aaac5e1 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:28.955489 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2b36c-11e7-4634-91d9-2fdb9aaac5e1 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:28.957070 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2b36c-11e7-4634-91d9-2fdb9aaac5e1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:28.968158 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-bac2b36c-11e7-4634-91d9-2fdb9aaac5e1 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 01:14:28.970280 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 457/923] 10.222.0.25 () {56 vars in 1127 bytes} [Fri Aug 27 01:14:28 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:28.976265 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865ad1e-8dfd-4b1f-82e5-abdaf1893558 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:28.985611 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865ad1e-8dfd-4b1f-82e5-abdaf1893558 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:28.990257 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89919eda-f8dc-4f96-899e-dc6d3ae82f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:28.990991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89919eda-f8dc-4f96-899e-dc6d3ae82f9e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:28.991347 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89919eda-f8dc-4f96-899e-dc6d3ae82f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:28.991694 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89919eda-f8dc-4f96-899e-dc6d3ae82f9e admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:28.992470 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89919eda-f8dc-4f96-899e-dc6d3ae82f9e admin admin] RBAC: Adding query filter params (name=image) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:28.992869 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89919eda-f8dc-4f96-899e-dc6d3ae82f9e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:28.994542 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89919eda-f8dc-4f96-899e-dc6d3ae82f9e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:28.999724 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 467/924] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:28 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:29.005863 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2b36c-11e7-4634-91d9-2fdb9aaac5e1 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:29.016920 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2b36c-11e7-4634-91d9-2fdb9aaac5e1 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:29.021543 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee5da8-40dd-4ad0-8881-55d159ef1210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:29.022238 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee5da8-40dd-4ad0-8881-55d159ef1210 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:29.022518 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee5da8-40dd-4ad0-8881-55d159ef1210 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:29.022793 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee5da8-40dd-4ad0-8881-55d159ef1210 admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:29.023481 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee5da8-40dd-4ad0-8881-55d159ef1210 admin admin] RBAC: Adding query filter params (type=image) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:29.023783 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee5da8-40dd-4ad0-8881-55d159ef1210 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:29.025383 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee5da8-40dd-4ad0-8881-55d159ef1210 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:29.031105 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 458/925] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:29 2021] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:29.037264 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89919eda-f8dc-4f96-899e-dc6d3ae82f9e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:29.047554 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89919eda-f8dc-4f96-899e-dc6d3ae82f9e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:29.052094 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93552c84-064c-4701-b0bf-a325296dc04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:29.052817 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93552c84-064c-4701-b0bf-a325296dc04b admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:29.053209 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93552c84-064c-4701-b0bf-a325296dc04b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:29.053555 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93552c84-064c-4701-b0bf-a325296dc04b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:29.054362 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93552c84-064c-4701-b0bf-a325296dc04b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:29.056039 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93552c84-064c-4701-b0bf-a325296dc04b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:29.146904 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 468/926] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Aug 27 01:14:29 2021] POST /identity/v3/endpoints => generated 327 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:14:29.341965 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ef8d8-8073-4bd4-b767-be5ebf14c036 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:29.342254 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ef8d8-8073-4bd4-b767-be5ebf14c036 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:29.342535 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ef8d8-8073-4bd4-b767-be5ebf14c036 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:29.344298 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 459/927] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:29.350446 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f6894-934b-4626-9db0-f7d3d97efb16 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:29.350746 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f6894-934b-4626-9db0-f7d3d97efb16 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:29.351028 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f6894-934b-4626-9db0-f7d3d97efb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:29.369546 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-994f6894-934b-4626-9db0-f7d3d97efb16 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:29.370805 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-994f6894-934b-4626-9db0-f7d3d97efb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:29.387934 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 469/928] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:29 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:29.415335 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ef8d8-8073-4bd4-b767-be5ebf14c036 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:29.429167 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ef8d8-8073-4bd4-b767-be5ebf14c036 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:29.434198 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13cbef3-b53d-4a43-91c8-a72dbb58ee58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:29.435154 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cbef3-b53d-4a43-91c8-a72dbb58ee58 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:29.435606 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cbef3-b53d-4a43-91c8-a72dbb58ee58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:29.436027 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cbef3-b53d-4a43-91c8-a72dbb58ee58 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:29.437421 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13cbef3-b53d-4a43-91c8-a72dbb58ee58 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:29.439235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13cbef3-b53d-4a43-91c8-a72dbb58ee58 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:29.441086 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 460/929] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:29 2021] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:29.448545 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f6894-934b-4626-9db0-f7d3d97efb16 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:29.457829 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f6894-934b-4626-9db0-f7d3d97efb16 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:29.462323 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b90c58-6a10-4f73-89d3-9e463d2c2e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:29.462977 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b90c58-6a10-4f73-89d3-9e463d2c2e24 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:29.463260 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b90c58-6a10-4f73-89d3-9e463d2c2e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:29.463538 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b90c58-6a10-4f73-89d3-9e463d2c2e24 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:29.464805 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b90c58-6a10-4f73-89d3-9e463d2c2e24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:29.465977 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING py.warnings [None req-48b90c58-6a10-4f73-89d3-9e463d2c2e24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:14:29.465977 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: warnings.warn(msg) Aug 27 01:14:29.465977 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: Aug 27 01:14:29.467160 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b90c58-6a10-4f73-89d3-9e463d2c2e24 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:29.548858 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 470/930] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 01:14:29 2021] POST /identity/v3/projects => generated 311 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:14:29.634605 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf18d5a-c794-407c-af06-59cadc7e05ca None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:29.634922 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf18d5a-c794-407c-af06-59cadc7e05ca None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:29.635163 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf18d5a-c794-407c-af06-59cadc7e05ca None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:29.637468 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 461/931] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:29.643951 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc8fa2-f7af-40d4-9584-b49215be4cc8 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:29.644253 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc8fa2-f7af-40d4-9584-b49215be4cc8 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:29.644524 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc8fa2-f7af-40d4-9584-b49215be4cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:29.664116 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-13bc8fa2-f7af-40d4-9584-b49215be4cc8 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:29.665422 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-13bc8fa2-f7af-40d4-9584-b49215be4cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:29.727103 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 471/932] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:29 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:14:29.753605 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf18d5a-c794-407c-af06-59cadc7e05ca None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:29.766219 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf18d5a-c794-407c-af06-59cadc7e05ca None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:29.770771 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265266c-a2e8-4bc6-aa62-2c0079498e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:29.771577 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265266c-a2e8-4bc6-aa62-2c0079498e9d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:29.772738 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265266c-a2e8-4bc6-aa62-2c0079498e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:29.772738 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265266c-a2e8-4bc6-aa62-2c0079498e9d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:29.784706 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265266c-a2e8-4bc6-aa62-2c0079498e9d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:14:29.792135 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-7265266c-a2e8-4bc6-aa62-2c0079498e9d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 01:14:29.794267 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 462/933] 10.222.0.25 () {56 vars in 1142 bytes} [Fri Aug 27 01:14:29 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:29.801046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc8fa2-f7af-40d4-9584-b49215be4cc8 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:29.810124 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc8fa2-f7af-40d4-9584-b49215be4cc8 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:29.814781 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d4012-6c20-40f0-879e-79f1ed6ec2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:29.815435 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d4012-6c20-40f0-879e-79f1ed6ec2db admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:29.815712 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d4012-6c20-40f0-879e-79f1ed6ec2db admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:29.815982 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d4012-6c20-40f0-879e-79f1ed6ec2db admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:29.816718 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d4012-6c20-40f0-879e-79f1ed6ec2db admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:29.817046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d4012-6c20-40f0-879e-79f1ed6ec2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:29.818610 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d4012-6c20-40f0-879e-79f1ed6ec2db admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:29.827584 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 472/934] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Aug 27 01:14:29 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:29.833943 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265266c-a2e8-4bc6-aa62-2c0079498e9d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:29.844667 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265266c-a2e8-4bc6-aa62-2c0079498e9d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:29.849506 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4f015-9fbb-4f10-8fec-bd450a06a03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:29.850288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4f015-9fbb-4f10-8fec-bd450a06a03d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:29.850569 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4f015-9fbb-4f10-8fec-bd450a06a03d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:29.850843 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4f015-9fbb-4f10-8fec-bd450a06a03d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:29.861999 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4f015-9fbb-4f10-8fec-bd450a06a03d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:29.863859 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4f015-9fbb-4f10-8fec-bd450a06a03d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:29.881294 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-99f4f015-9fbb-4f10-8fec-bd450a06a03d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:29.882646 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 463/935] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:29.889491 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d4012-6c20-40f0-879e-79f1ed6ec2db admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:29.899410 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d4012-6c20-40f0-879e-79f1ed6ec2db admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:29.905231 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab227e-d9c8-4548-b120-580cd2a39821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:29.905963 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab227e-d9c8-4548-b120-580cd2a39821 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:29.906322 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab227e-d9c8-4548-b120-580cd2a39821 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:29.906672 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab227e-d9c8-4548-b120-580cd2a39821 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:29.907467 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab227e-d9c8-4548-b120-580cd2a39821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:29.907843 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab227e-d9c8-4548-b120-580cd2a39821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:29.909534 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab227e-d9c8-4548-b120-580cd2a39821 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:29.922216 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 473/936] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:29.928483 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4f015-9fbb-4f10-8fec-bd450a06a03d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:29.938827 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4f015-9fbb-4f10-8fec-bd450a06a03d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:29.943777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5621df-1883-4286-9b3c-73e3f3fb5f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:29.944559 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5621df-1883-4286-9b3c-73e3f3fb5f06 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:29.944864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5621df-1883-4286-9b3c-73e3f3fb5f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:29.945301 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5621df-1883-4286-9b3c-73e3f3fb5f06 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:29.954112 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5621df-1883-4286-9b3c-73e3f3fb5f06 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:29.956139 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5621df-1883-4286-9b3c-73e3f3fb5f06 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:29.970011 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-2d5621df-1883-4286-9b3c-73e3f3fb5f06 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 01:14:29.971383 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 464/937] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Aug 27 01:14:29 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:29.977597 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab227e-d9c8-4548-b120-580cd2a39821 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:29.987979 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab227e-d9c8-4548-b120-580cd2a39821 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:29.992553 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94219047-eed9-4bd2-9864-b98c6edbf189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:29.993246 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94219047-eed9-4bd2-9864-b98c6edbf189 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:29.993529 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94219047-eed9-4bd2-9864-b98c6edbf189 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:29.993800 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94219047-eed9-4bd2-9864-b98c6edbf189 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:29.994661 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94219047-eed9-4bd2-9864-b98c6edbf189 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:29.994966 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94219047-eed9-4bd2-9864-b98c6edbf189 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:29.997642 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94219047-eed9-4bd2-9864-b98c6edbf189 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:30.015784 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 474/938] 10.222.0.25 () {56 vars in 1155 bytes} [Fri Aug 27 01:14:29 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:30.021876 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5621df-1883-4286-9b3c-73e3f3fb5f06 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:30.031696 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5621df-1883-4286-9b3c-73e3f3fb5f06 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:30.036257 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8157b-c01d-4835-ad8d-ea2130fcf9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:30.036927 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8157b-c01d-4835-ad8d-ea2130fcf9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:30.037215 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8157b-c01d-4835-ad8d-ea2130fcf9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:30.037491 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8157b-c01d-4835-ad8d-ea2130fcf9d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:30.046361 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8157b-c01d-4835-ad8d-ea2130fcf9d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:30.048120 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8157b-c01d-4835-ad8d-ea2130fcf9d6 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:30.057207 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 465/939] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:14:30 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:14:30.064195 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94219047-eed9-4bd2-9864-b98c6edbf189 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:30.073931 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94219047-eed9-4bd2-9864-b98c6edbf189 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:30.078640 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19f0a5-f68a-4a05-ad00-8b5b1b433ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:30.079843 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19f0a5-f68a-4a05-ad00-8b5b1b433ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:30.080224 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19f0a5-f68a-4a05-ad00-8b5b1b433ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:30.080573 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19f0a5-f68a-4a05-ad00-8b5b1b433ef8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:30.091559 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19f0a5-f68a-4a05-ad00-8b5b1b433ef8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:30.093501 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19f0a5-f68a-4a05-ad00-8b5b1b433ef8 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:30.109928 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-da19f0a5-f68a-4a05-ad00-8b5b1b433ef8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:30.111252 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 475/940] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:30.117357 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8157b-c01d-4835-ad8d-ea2130fcf9d6 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:30.127295 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8157b-c01d-4835-ad8d-ea2130fcf9d6 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:30.131977 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5a06a-a166-4811-9867-8d87778ad325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:30.132693 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5a06a-a166-4811-9867-8d87778ad325 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:30.133096 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5a06a-a166-4811-9867-8d87778ad325 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:30.133449 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5a06a-a166-4811-9867-8d87778ad325 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:30.134233 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5a06a-a166-4811-9867-8d87778ad325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:30.134609 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5a06a-a166-4811-9867-8d87778ad325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:30.136402 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5a06a-a166-4811-9867-8d87778ad325 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:30.147705 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 466/941] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:30.154494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19f0a5-f68a-4a05-ad00-8b5b1b433ef8 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:30.164061 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19f0a5-f68a-4a05-ad00-8b5b1b433ef8 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:30.168596 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b90f86-382a-4322-a605-60e7d0e320cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:30.169458 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b90f86-382a-4322-a605-60e7d0e320cb admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:30.169742 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b90f86-382a-4322-a605-60e7d0e320cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:30.170020 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b90f86-382a-4322-a605-60e7d0e320cb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:30.176871 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b90f86-382a-4322-a605-60e7d0e320cb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:30.178768 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b90f86-382a-4322-a605-60e7d0e320cb admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:30.191932 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-d2b90f86-382a-4322-a605-60e7d0e320cb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:14:30.193265 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 476/942] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:30.200529 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5a06a-a166-4811-9867-8d87778ad325 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:30.210370 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5a06a-a166-4811-9867-8d87778ad325 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:30.215551 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c0fc3-c22d-47c6-a2eb-b332972e6b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:30.216301 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c0fc3-c22d-47c6-a2eb-b332972e6b31 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:30.216580 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c0fc3-c22d-47c6-a2eb-b332972e6b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:30.216874 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c0fc3-c22d-47c6-a2eb-b332972e6b31 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:30.217649 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c0fc3-c22d-47c6-a2eb-b332972e6b31 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:30.217961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c0fc3-c22d-47c6-a2eb-b332972e6b31 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:30.219783 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c0fc3-c22d-47c6-a2eb-b332972e6b31 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:30.239770 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 467/943] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:14:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:30.241077 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b90f86-382a-4322-a605-60e7d0e320cb admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:30.252153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b90f86-382a-4322-a605-60e7d0e320cb admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:30.256625 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099c5b3-b18d-47d8-948a-521ff2c00098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:30.257302 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099c5b3-b18d-47d8-948a-521ff2c00098 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:30.257586 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099c5b3-b18d-47d8-948a-521ff2c00098 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:30.257861 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099c5b3-b18d-47d8-948a-521ff2c00098 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:30.258680 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099c5b3-b18d-47d8-948a-521ff2c00098 admin admin] RBAC: Adding query filter params (role.id=68b568bdff8d44a8b4837e976adb483a, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=249a7642a0284dde91a7719f732b2d70) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:30.258989 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099c5b3-b18d-47d8-948a-521ff2c00098 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:30.260812 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099c5b3-b18d-47d8-948a-521ff2c00098 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:30.266712 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 477/944] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:14:30 2021] GET /identity/v3/role_assignments?user.id=249a7642a0284dde91a7719f732b2d70&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=68b568bdff8d44a8b4837e976adb483a => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:31.339355 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5820de-6a0c-4fbe-9271-8edbd7ce2264 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:31.339876 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5820de-6a0c-4fbe-9271-8edbd7ce2264 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:31.339876 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5820de-6a0c-4fbe-9271-8edbd7ce2264 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:31.341811 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 468/945] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:31.347519 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796b8ae-9776-4a73-8268-5a1f3542012c None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:31.347912 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796b8ae-9776-4a73-8268-5a1f3542012c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:31.348071 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796b8ae-9776-4a73-8268-5a1f3542012c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:31.365900 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-6796b8ae-9776-4a73-8268-5a1f3542012c None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:31.367084 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-6796b8ae-9776-4a73-8268-5a1f3542012c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:31.375072 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 478/946] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:31 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:31.398542 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5820de-6a0c-4fbe-9271-8edbd7ce2264 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:31.411538 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5820de-6a0c-4fbe-9271-8edbd7ce2264 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:31.419580 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790178e-9d56-4534-9482-ee93c23b19e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:31.420240 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790178e-9d56-4534-9482-ee93c23b19e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:31.420518 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790178e-9d56-4534-9482-ee93c23b19e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:31.420792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790178e-9d56-4534-9482-ee93c23b19e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:31.429170 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790178e-9d56-4534-9482-ee93c23b19e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:31.430954 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790178e-9d56-4534-9482-ee93c23b19e4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:31.439968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 469/947] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:14:31 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:14:31.446095 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796b8ae-9776-4a73-8268-5a1f3542012c None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:31.461985 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796b8ae-9776-4a73-8268-5a1f3542012c None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:31.467049 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bda1d6-c593-4791-a6e7-0771e661a997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:31.467840 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bda1d6-c593-4791-a6e7-0771e661a997 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:31.468119 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bda1d6-c593-4791-a6e7-0771e661a997 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:31.468391 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bda1d6-c593-4791-a6e7-0771e661a997 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:31.469563 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bda1d6-c593-4791-a6e7-0771e661a997 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:31.471233 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bda1d6-c593-4791-a6e7-0771e661a997 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:31.473054 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 479/948] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:31 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:31.800900 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e30d7e-e0c5-46b1-850e-2b74217db8c1 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:31.801186 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e30d7e-e0c5-46b1-850e-2b74217db8c1 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:31.801460 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e30d7e-e0c5-46b1-850e-2b74217db8c1 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:31.803210 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 470/949] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:31.809426 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233a3ba-ff4a-4d1c-91c1-7f21fea63f69 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:31.809717 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233a3ba-ff4a-4d1c-91c1-7f21fea63f69 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:31.809999 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233a3ba-ff4a-4d1c-91c1-7f21fea63f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:31.827296 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-0233a3ba-ff4a-4d1c-91c1-7f21fea63f69 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:31.828514 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-0233a3ba-ff4a-4d1c-91c1-7f21fea63f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:31.836370 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 480/950] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:31 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:31.863289 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e30d7e-e0c5-46b1-850e-2b74217db8c1 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:31.875218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e30d7e-e0c5-46b1-850e-2b74217db8c1 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:31.879455 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541121e-cb4c-4ecf-ae07-0bcf380253ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:31.880219 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541121e-cb4c-4ecf-ae07-0bcf380253ee admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:31.880494 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541121e-cb4c-4ecf-ae07-0bcf380253ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:31.880763 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541121e-cb4c-4ecf-ae07-0bcf380253ee admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:31.881938 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541121e-cb4c-4ecf-ae07-0bcf380253ee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:31.883580 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541121e-cb4c-4ecf-ae07-0bcf380253ee admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:31.885329 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 471/951] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:31 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:31.893673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233a3ba-ff4a-4d1c-91c1-7f21fea63f69 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:31.903186 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233a3ba-ff4a-4d1c-91c1-7f21fea63f69 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:31.907659 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d784b-e6dd-4722-9994-a7efcf9ddb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:31.908320 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d784b-e6dd-4722-9994-a7efcf9ddb70 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:31.908604 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d784b-e6dd-4722-9994-a7efcf9ddb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:31.908913 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d784b-e6dd-4722-9994-a7efcf9ddb70 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:31.909624 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d784b-e6dd-4722-9994-a7efcf9ddb70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:31.911553 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d784b-e6dd-4722-9994-a7efcf9ddb70 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:32.016324 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 481/952] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 01:14:31 2021] POST /identity/v3/users => generated 285 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:14:32.406396 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d351f63-0517-48ec-a47c-65dac8841b6e None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:32.406907 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d351f63-0517-48ec-a47c-65dac8841b6e None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:32.407020 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d351f63-0517-48ec-a47c-65dac8841b6e None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:32.408678 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 472/953] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:32.414495 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cfd4e-5fc1-46b1-b0eb-6b7f6d97f322 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:32.414902 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cfd4e-5fc1-46b1-b0eb-6b7f6d97f322 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:32.415049 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cfd4e-5fc1-46b1-b0eb-6b7f6d97f322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:32.434091 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-b94cfd4e-5fc1-46b1-b0eb-6b7f6d97f322 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:32.435250 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-b94cfd4e-5fc1-46b1-b0eb-6b7f6d97f322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:32.442682 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 482/954] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:32 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:32.467100 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d351f63-0517-48ec-a47c-65dac8841b6e None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:32.478995 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d351f63-0517-48ec-a47c-65dac8841b6e None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:32.483370 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5e21e-df0f-4429-8d6e-4fe0adb6f867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:32.484155 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5e21e-df0f-4429-8d6e-4fe0adb6f867 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:32.484435 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5e21e-df0f-4429-8d6e-4fe0adb6f867 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:32.484707 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5e21e-df0f-4429-8d6e-4fe0adb6f867 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:32.494540 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5e21e-df0f-4429-8d6e-4fe0adb6f867 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:14:32.502252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-ddc5e21e-df0f-4429-8d6e-4fe0adb6f867 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 01:14:32.503399 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 473/955] 10.222.0.25 () {56 vars in 1142 bytes} [Fri Aug 27 01:14:32 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:32.509659 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cfd4e-5fc1-46b1-b0eb-6b7f6d97f322 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:32.519184 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cfd4e-5fc1-46b1-b0eb-6b7f6d97f322 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:32.523694 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093bfee-c8c5-4408-9e89-9fde8cfe6a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:32.524339 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093bfee-c8c5-4408-9e89-9fde8cfe6a7f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:32.524916 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093bfee-c8c5-4408-9e89-9fde8cfe6a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:32.524916 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093bfee-c8c5-4408-9e89-9fde8cfe6a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:32.525640 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093bfee-c8c5-4408-9e89-9fde8cfe6a7f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:32.525946 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093bfee-c8c5-4408-9e89-9fde8cfe6a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:32.527687 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093bfee-c8c5-4408-9e89-9fde8cfe6a7f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:32.535571 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 483/956] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Aug 27 01:14:32 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:32.541594 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5e21e-df0f-4429-8d6e-4fe0adb6f867 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:32.551772 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5e21e-df0f-4429-8d6e-4fe0adb6f867 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:32.556288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357478e-da71-4823-b028-8c0af3278a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:32.557068 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357478e-da71-4823-b028-8c0af3278a27 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:32.557352 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357478e-da71-4823-b028-8c0af3278a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:32.557624 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357478e-da71-4823-b028-8c0af3278a27 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:32.568009 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357478e-da71-4823-b028-8c0af3278a27 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:32.569903 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357478e-da71-4823-b028-8c0af3278a27 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:32.587064 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-6357478e-da71-4823-b028-8c0af3278a27 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:32.588249 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 474/957] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:32.595084 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093bfee-c8c5-4408-9e89-9fde8cfe6a7f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:32.604646 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093bfee-c8c5-4408-9e89-9fde8cfe6a7f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:32.609156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429452d-5d3b-4738-8021-89ca23c687a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:32.609798 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429452d-5d3b-4738-8021-89ca23c687a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:32.610081 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429452d-5d3b-4738-8021-89ca23c687a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:32.610353 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429452d-5d3b-4738-8021-89ca23c687a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:32.611060 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429452d-5d3b-4738-8021-89ca23c687a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:32.611364 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429452d-5d3b-4738-8021-89ca23c687a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:32.612963 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429452d-5d3b-4738-8021-89ca23c687a7 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:32.624800 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 484/958] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:32.630817 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357478e-da71-4823-b028-8c0af3278a27 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:32.640861 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357478e-da71-4823-b028-8c0af3278a27 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:32.645289 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b382b7-61aa-41e3-bbc0-326b1ab1189e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:32.646049 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b382b7-61aa-41e3-bbc0-326b1ab1189e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:32.646328 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b382b7-61aa-41e3-bbc0-326b1ab1189e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:32.646598 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b382b7-61aa-41e3-bbc0-326b1ab1189e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:32.653631 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b382b7-61aa-41e3-bbc0-326b1ab1189e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:32.655612 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b382b7-61aa-41e3-bbc0-326b1ab1189e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:32.669214 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-31b382b7-61aa-41e3-bbc0-326b1ab1189e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 01:14:32.670324 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 475/959] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Aug 27 01:14:32 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:32.676534 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429452d-5d3b-4738-8021-89ca23c687a7 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:32.686503 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429452d-5d3b-4738-8021-89ca23c687a7 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:32.691036 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac5092-56b4-4c2c-a035-584485fdc14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:32.691679 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac5092-56b4-4c2c-a035-584485fdc14c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:32.691962 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac5092-56b4-4c2c-a035-584485fdc14c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:32.692237 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac5092-56b4-4c2c-a035-584485fdc14c admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:32.693094 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac5092-56b4-4c2c-a035-584485fdc14c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:32.693404 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac5092-56b4-4c2c-a035-584485fdc14c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:32.695208 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac5092-56b4-4c2c-a035-584485fdc14c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:32.712085 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 485/960] 10.222.0.25 () {56 vars in 1155 bytes} [Fri Aug 27 01:14:32 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:32.718101 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b382b7-61aa-41e3-bbc0-326b1ab1189e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:32.727633 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b382b7-61aa-41e3-bbc0-326b1ab1189e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:32.732752 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a0608-070e-47f1-b8cb-88919c6bd84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:32.733623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a0608-070e-47f1-b8cb-88919c6bd84a admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:32.733900 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a0608-070e-47f1-b8cb-88919c6bd84a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:32.734169 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a0608-070e-47f1-b8cb-88919c6bd84a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:32.744039 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a0608-070e-47f1-b8cb-88919c6bd84a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:32.746487 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a0608-070e-47f1-b8cb-88919c6bd84a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:32.762937 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-4b2a0608-070e-47f1-b8cb-88919c6bd84a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:32.764103 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 476/961] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:32.770354 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac5092-56b4-4c2c-a035-584485fdc14c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:32.780310 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac5092-56b4-4c2c-a035-584485fdc14c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:32.784876 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc98dd-ccaf-4561-9c57-6fc6005d5252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:32.785596 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc98dd-ccaf-4561-9c57-6fc6005d5252 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:32.785946 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc98dd-ccaf-4561-9c57-6fc6005d5252 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:32.786292 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc98dd-ccaf-4561-9c57-6fc6005d5252 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:32.787090 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc98dd-ccaf-4561-9c57-6fc6005d5252 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:32.787466 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc98dd-ccaf-4561-9c57-6fc6005d5252 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:32.789141 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc98dd-ccaf-4561-9c57-6fc6005d5252 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:32.800892 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 486/962] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:32.806681 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a0608-070e-47f1-b8cb-88919c6bd84a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:32.816648 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a0608-070e-47f1-b8cb-88919c6bd84a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:32.821101 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b9dae-a528-49bf-b37c-1e7f5cac02ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:32.821869 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b9dae-a528-49bf-b37c-1e7f5cac02ae admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:32.822144 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b9dae-a528-49bf-b37c-1e7f5cac02ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:32.822413 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b9dae-a528-49bf-b37c-1e7f5cac02ae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:32.829269 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b9dae-a528-49bf-b37c-1e7f5cac02ae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:32.831191 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b9dae-a528-49bf-b37c-1e7f5cac02ae admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:32.843645 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-c84b9dae-a528-49bf-b37c-1e7f5cac02ae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:14:32.844805 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 477/963] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:32.851411 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc98dd-ccaf-4561-9c57-6fc6005d5252 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:32.861585 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc98dd-ccaf-4561-9c57-6fc6005d5252 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:32.866009 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c00079-b930-4f14-b197-5ab2e9211709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:32.866653 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c00079-b930-4f14-b197-5ab2e9211709 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:32.866935 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c00079-b930-4f14-b197-5ab2e9211709 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:32.867210 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c00079-b930-4f14-b197-5ab2e9211709 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:32.867982 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c00079-b930-4f14-b197-5ab2e9211709 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:32.868291 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c00079-b930-4f14-b197-5ab2e9211709 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:32.870144 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c00079-b930-4f14-b197-5ab2e9211709 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:32.882220 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 487/964] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:14:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:32.889611 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b9dae-a528-49bf-b37c-1e7f5cac02ae admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:32.899720 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b9dae-a528-49bf-b37c-1e7f5cac02ae admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:32.904235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be2ad3-4a65-40f2-ba98-4a21fafce474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:32.905123 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be2ad3-4a65-40f2-ba98-4a21fafce474 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:32.905399 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be2ad3-4a65-40f2-ba98-4a21fafce474 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:32.905668 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be2ad3-4a65-40f2-ba98-4a21fafce474 admin admin] PATH_INFO: `/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/249a7642a0284dde91a7719f732b2d70/roles/68b568bdff8d44a8b4837e976adb483a` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:32.907806 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be2ad3-4a65-40f2-ba98-4a21fafce474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0094d4fd0a114a2cbf5919f2a0e88e82, user_id=249a7642a0284dde91a7719f732b2d70, role_id=68b568bdff8d44a8b4837e976adb483a)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:32.910419 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be2ad3-4a65-40f2-ba98-4a21fafce474 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:32.987307 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 478/965] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:14:32 2021] PUT /identity/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/249a7642a0284dde91a7719f732b2d70/roles/68b568bdff8d44a8b4837e976adb483a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:14:34.246351 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeb489-5bdc-47df-afdb-38900843d6bf None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:34.246900 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeb489-5bdc-47df-afdb-38900843d6bf None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:34.246900 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeb489-5bdc-47df-afdb-38900843d6bf None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:34.248664 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 488/966] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:34.254582 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066150c-a787-484d-a2e3-d8e750d5b802 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:34.254982 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066150c-a787-484d-a2e3-d8e750d5b802 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:34.255127 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066150c-a787-484d-a2e3-d8e750d5b802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:34.272317 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-7066150c-a787-484d-a2e3-d8e750d5b802 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:34.273507 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-7066150c-a787-484d-a2e3-d8e750d5b802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:34.327740 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 479/967] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:34.352030 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caeb489-5bdc-47df-afdb-38900843d6bf None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:34.364551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caeb489-5bdc-47df-afdb-38900843d6bf None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:34.368867 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb963667-6632-4727-bb54-bca11836c2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:34.369635 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb963667-6632-4727-bb54-bca11836c2da admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:34.369910 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb963667-6632-4727-bb54-bca11836c2da admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:34.370251 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb963667-6632-4727-bb54-bca11836c2da admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:34.380107 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb963667-6632-4727-bb54-bca11836c2da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:14:34.387553 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-bb963667-6632-4727-bb54-bca11836c2da admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:14:34.388822 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 489/968] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:14:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:34.395051 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066150c-a787-484d-a2e3-d8e750d5b802 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:34.409786 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066150c-a787-484d-a2e3-d8e750d5b802 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:34.420069 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98475295-c786-4be8-9866-47a1f3c0b23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:34.420806 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98475295-c786-4be8-9866-47a1f3c0b23b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:34.421504 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98475295-c786-4be8-9866-47a1f3c0b23b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:34.421815 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98475295-c786-4be8-9866-47a1f3c0b23b admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:34.422660 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98475295-c786-4be8-9866-47a1f3c0b23b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:34.422977 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98475295-c786-4be8-9866-47a1f3c0b23b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:34.424600 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98475295-c786-4be8-9866-47a1f3c0b23b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:34.433987 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 480/969] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:14:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:34.440393 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb963667-6632-4727-bb54-bca11836c2da admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:34.450497 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb963667-6632-4727-bb54-bca11836c2da admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:34.455210 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dd1da-0039-452f-a949-3ae42e23752c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:34.456044 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dd1da-0039-452f-a949-3ae42e23752c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:34.456326 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dd1da-0039-452f-a949-3ae42e23752c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:34.456592 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dd1da-0039-452f-a949-3ae42e23752c admin admin] PATH_INFO: `/v3/users/8f68d76e853847848951f562e14f4d97` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:34.469114 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dd1da-0039-452f-a949-3ae42e23752c admin admin] RBAC: Authorizing `identity:get_user(user_id=8f68d76e853847848951f562e14f4d97)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:34.471222 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dd1da-0039-452f-a949-3ae42e23752c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:34.472809 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 490/970] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:14:34 2021] GET /identity/v3/users/8f68d76e853847848951f562e14f4d97 => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:34.478922 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98475295-c786-4be8-9866-47a1f3c0b23b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:34.489320 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98475295-c786-4be8-9866-47a1f3c0b23b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:34.493866 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1959be9-be57-4393-9e03-944b9034cdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:34.494504 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1959be9-be57-4393-9e03-944b9034cdce admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:34.494788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1959be9-be57-4393-9e03-944b9034cdce admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:34.495063 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1959be9-be57-4393-9e03-944b9034cdce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:34.503806 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1959be9-be57-4393-9e03-944b9034cdce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:34.505531 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1959be9-be57-4393-9e03-944b9034cdce admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:34.514701 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 481/971] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:14:34 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:14:34.521175 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dd1da-0039-452f-a949-3ae42e23752c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:34.530571 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dd1da-0039-452f-a949-3ae42e23752c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:34.534973 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12869de-b22e-49cb-ba00-f26dbc96939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:34.535801 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12869de-b22e-49cb-ba00-f26dbc96939b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:34.536078 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12869de-b22e-49cb-ba00-f26dbc96939b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:34.536348 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12869de-b22e-49cb-ba00-f26dbc96939b admin admin] PATH_INFO: `/v3/projects/feae8c164c6644db9ef9f226680b6513` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:34.537498 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12869de-b22e-49cb-ba00-f26dbc96939b admin admin] RBAC: Authorizing `identity:get_project(project_id=feae8c164c6644db9ef9f226680b6513)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:34.539519 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12869de-b22e-49cb-ba00-f26dbc96939b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:34.541170 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 491/972] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:14:34 2021] GET /identity/v3/projects/feae8c164c6644db9ef9f226680b6513 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:34.548256 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1959be9-be57-4393-9e03-944b9034cdce admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:34.557039 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1959be9-be57-4393-9e03-944b9034cdce admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:34.562064 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaecb3-9a59-41f6-b831-c5f51e752b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:34.562694 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaecb3-9a59-41f6-b831-c5f51e752b1c admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:34.562972 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaecb3-9a59-41f6-b831-c5f51e752b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:34.563244 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaecb3-9a59-41f6-b831-c5f51e752b1c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:34.564052 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eaecb3-9a59-41f6-b831-c5f51e752b1c admin admin] RBAC: Adding query filter params (role.id=faadc5010ffb447ba5280e491c2ea2f5, scope.project.id=feae8c164c6644db9ef9f226680b6513, user.id=8f68d76e853847848951f562e14f4d97) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:34.564360 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eaecb3-9a59-41f6-b831-c5f51e752b1c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:34.566194 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eaecb3-9a59-41f6-b831-c5f51e752b1c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:34.571418 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 482/973] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:14:34 2021] GET /identity/v3/role_assignments?user.id=8f68d76e853847848951f562e14f4d97&scope.project.id=feae8c164c6644db9ef9f226680b6513&role.id=faadc5010ffb447ba5280e491c2ea2f5 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:35.128425 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce16f23-804d-4603-8e18-4be56d8c3a7f None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:35.128795 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce16f23-804d-4603-8e18-4be56d8c3a7f None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:35.129123 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce16f23-804d-4603-8e18-4be56d8c3a7f None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:35.130885 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 492/974] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:35.137335 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a7eff-b4b0-41e3-9a88-a7e4c4aa8475 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:35.137623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a7eff-b4b0-41e3-9a88-a7e4c4aa8475 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:35.137897 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a7eff-b4b0-41e3-9a88-a7e4c4aa8475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:35.155962 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-6d7a7eff-b4b0-41e3-9a88-a7e4c4aa8475 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:35.157169 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-6d7a7eff-b4b0-41e3-9a88-a7e4c4aa8475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:35.164604 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 483/975] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:35 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:14:35.188586 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce16f23-804d-4603-8e18-4be56d8c3a7f None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:35.204768 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce16f23-804d-4603-8e18-4be56d8c3a7f None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:35.210880 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79918e-3566-4c20-ba22-8069113a6a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:35.211715 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79918e-3566-4c20-ba22-8069113a6a69 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:35.211996 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79918e-3566-4c20-ba22-8069113a6a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:35.212271 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79918e-3566-4c20-ba22-8069113a6a69 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:35.223385 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79918e-3566-4c20-ba22-8069113a6a69 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:14:35.230574 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-5f79918e-3566-4c20-ba22-8069113a6a69 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 01:14:35.231755 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 493/976] 10.222.0.25 () {56 vars in 1142 bytes} [Fri Aug 27 01:14:35 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:35.238407 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a7eff-b4b0-41e3-9a88-a7e4c4aa8475 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:35.247935 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a7eff-b4b0-41e3-9a88-a7e4c4aa8475 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:35.252608 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dda8b-7c0f-459c-bdd9-503088cd5218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:35.253305 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dda8b-7c0f-459c-bdd9-503088cd5218 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:35.253584 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dda8b-7c0f-459c-bdd9-503088cd5218 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:35.253859 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dda8b-7c0f-459c-bdd9-503088cd5218 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:35.254596 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dda8b-7c0f-459c-bdd9-503088cd5218 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:35.255107 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dda8b-7c0f-459c-bdd9-503088cd5218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:35.256470 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dda8b-7c0f-459c-bdd9-503088cd5218 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:35.265582 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 484/977] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Aug 27 01:14:35 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:35.271779 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79918e-3566-4c20-ba22-8069113a6a69 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:35.282869 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79918e-3566-4c20-ba22-8069113a6a69 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:35.287527 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c5764-bce0-415a-b064-c8d9c3d166d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:35.288305 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c5764-bce0-415a-b064-c8d9c3d166d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:35.288583 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c5764-bce0-415a-b064-c8d9c3d166d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:35.288880 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c5764-bce0-415a-b064-c8d9c3d166d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:35.299928 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c5764-bce0-415a-b064-c8d9c3d166d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:35.301798 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c5764-bce0-415a-b064-c8d9c3d166d4 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:35.318671 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-d37c5764-bce0-415a-b064-c8d9c3d166d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:35.319850 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 494/978] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:35.326750 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dda8b-7c0f-459c-bdd9-503088cd5218 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:35.336592 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dda8b-7c0f-459c-bdd9-503088cd5218 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:35.341683 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2c06f-4a82-449a-8ef9-2bbf28ada7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:35.342370 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2c06f-4a82-449a-8ef9-2bbf28ada7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:35.342654 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2c06f-4a82-449a-8ef9-2bbf28ada7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:35.342931 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2c06f-4a82-449a-8ef9-2bbf28ada7e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:35.343650 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2c06f-4a82-449a-8ef9-2bbf28ada7e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:35.343957 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2c06f-4a82-449a-8ef9-2bbf28ada7e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:35.345605 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2c06f-4a82-449a-8ef9-2bbf28ada7e3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:35.362481 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 485/979] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:35.363569 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c5764-bce0-415a-b064-c8d9c3d166d4 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:35.374471 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c5764-bce0-415a-b064-c8d9c3d166d4 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:35.379004 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c901b-e20a-4bf7-b9ea-700c99607fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:35.379736 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c901b-e20a-4bf7-b9ea-700c99607fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:35.380015 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c901b-e20a-4bf7-b9ea-700c99607fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:35.380286 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c901b-e20a-4bf7-b9ea-700c99607fe2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:35.388104 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c901b-e20a-4bf7-b9ea-700c99607fe2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:35.390214 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c901b-e20a-4bf7-b9ea-700c99607fe2 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:35.406558 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-e37c901b-e20a-4bf7-b9ea-700c99607fe2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 01:14:35.407739 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 495/980] 10.222.0.25 () {56 vars in 1115 bytes} [Fri Aug 27 01:14:35 2021] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:35.414290 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2c06f-4a82-449a-8ef9-2bbf28ada7e3 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:35.425074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2c06f-4a82-449a-8ef9-2bbf28ada7e3 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:35.429579 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f711fbc-aaf9-4a95-8c3b-c59a9e40137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:35.430237 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f711fbc-aaf9-4a95-8c3b-c59a9e40137c admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:35.430518 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f711fbc-aaf9-4a95-8c3b-c59a9e40137c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:35.430790 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f711fbc-aaf9-4a95-8c3b-c59a9e40137c admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:35.431614 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f711fbc-aaf9-4a95-8c3b-c59a9e40137c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:35.431919 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f711fbc-aaf9-4a95-8c3b-c59a9e40137c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:35.433908 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f711fbc-aaf9-4a95-8c3b-c59a9e40137c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:35.450571 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 486/981] 10.222.0.25 () {56 vars in 1155 bytes} [Fri Aug 27 01:14:35 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:35.457137 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c901b-e20a-4bf7-b9ea-700c99607fe2 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:35.470296 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c901b-e20a-4bf7-b9ea-700c99607fe2 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:35.476046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e16ecd-75a9-4ae5-9fad-2a338580c924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:35.476713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e16ecd-75a9-4ae5-9fad-2a338580c924 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:35.477010 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e16ecd-75a9-4ae5-9fad-2a338580c924 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:35.477288 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e16ecd-75a9-4ae5-9fad-2a338580c924 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:35.485892 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e16ecd-75a9-4ae5-9fad-2a338580c924 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:35.487631 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e16ecd-75a9-4ae5-9fad-2a338580c924 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:35.496549 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 496/982] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:14:35 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:14:35.502689 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f711fbc-aaf9-4a95-8c3b-c59a9e40137c admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:35.512304 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f711fbc-aaf9-4a95-8c3b-c59a9e40137c admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:35.516764 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042ce0d-6258-4dbe-b9b7-2a72ab98090a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:35.517596 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042ce0d-6258-4dbe-b9b7-2a72ab98090a admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:35.517877 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042ce0d-6258-4dbe-b9b7-2a72ab98090a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:35.518148 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042ce0d-6258-4dbe-b9b7-2a72ab98090a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:35.528671 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042ce0d-6258-4dbe-b9b7-2a72ab98090a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:35.530540 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042ce0d-6258-4dbe-b9b7-2a72ab98090a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:35.547418 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-4042ce0d-6258-4dbe-b9b7-2a72ab98090a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:14:35.548736 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 487/983] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:35.554774 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e16ecd-75a9-4ae5-9fad-2a338580c924 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:35.563669 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e16ecd-75a9-4ae5-9fad-2a338580c924 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:35.568178 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbc701-dfa1-43c0-ae9b-b46c6375ae53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:35.568822 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbc701-dfa1-43c0-ae9b-b46c6375ae53 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:35.569129 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbc701-dfa1-43c0-ae9b-b46c6375ae53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:35.569405 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbc701-dfa1-43c0-ae9b-b46c6375ae53 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:35.570114 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbc701-dfa1-43c0-ae9b-b46c6375ae53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:35.570417 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbc701-dfa1-43c0-ae9b-b46c6375ae53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:35.571989 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbc701-dfa1-43c0-ae9b-b46c6375ae53 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:35.583482 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 497/984] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:14:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:35.590312 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042ce0d-6258-4dbe-b9b7-2a72ab98090a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:35.600150 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042ce0d-6258-4dbe-b9b7-2a72ab98090a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:35.605234 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd0758-d99c-4a86-a413-636c1d5ca3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:35.606101 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd0758-d99c-4a86-a413-636c1d5ca3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:35.606385 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd0758-d99c-4a86-a413-636c1d5ca3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:35.606657 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd0758-d99c-4a86-a413-636c1d5ca3d7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:35.613468 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd0758-d99c-4a86-a413-636c1d5ca3d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:35.615424 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd0758-d99c-4a86-a413-636c1d5ca3d7 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:35.628623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-c4dd0758-d99c-4a86-a413-636c1d5ca3d7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:14:35.629883 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 488/985] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:14:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:14:35.636573 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbc701-dfa1-43c0-ae9b-b46c6375ae53 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:35.646108 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbc701-dfa1-43c0-ae9b-b46c6375ae53 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:35.650600 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04001c-bf58-4a36-93a6-38bed2a1a91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:35.651238 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04001c-bf58-4a36-93a6-38bed2a1a91a admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:35.652208 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04001c-bf58-4a36-93a6-38bed2a1a91a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:35.652518 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04001c-bf58-4a36-93a6-38bed2a1a91a admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:35.653294 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04001c-bf58-4a36-93a6-38bed2a1a91a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:35.653603 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04001c-bf58-4a36-93a6-38bed2a1a91a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:35.655455 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04001c-bf58-4a36-93a6-38bed2a1a91a admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:35.667119 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 498/986] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:14:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:35.673414 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd0758-d99c-4a86-a413-636c1d5ca3d7 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:35.683467 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd0758-d99c-4a86-a413-636c1d5ca3d7 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:35.687891 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abc8d7-978b-49d2-ad8a-5eacd74cb272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:35.688538 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abc8d7-978b-49d2-ad8a-5eacd74cb272 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:35.688813 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abc8d7-978b-49d2-ad8a-5eacd74cb272 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:35.689110 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abc8d7-978b-49d2-ad8a-5eacd74cb272 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:35.689917 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abc8d7-978b-49d2-ad8a-5eacd74cb272 admin admin] RBAC: Adding query filter params (role.id=68b568bdff8d44a8b4837e976adb483a, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=249a7642a0284dde91a7719f732b2d70) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:35.690223 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abc8d7-978b-49d2-ad8a-5eacd74cb272 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:35.692119 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abc8d7-978b-49d2-ad8a-5eacd74cb272 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:35.697862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 489/987] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:14:35 2021] GET /identity/v3/role_assignments?user.id=249a7642a0284dde91a7719f732b2d70&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=68b568bdff8d44a8b4837e976adb483a => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:36.693618 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9295fe2-c5d5-442e-9b10-fb9afcedae65 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:36.694112 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9295fe2-c5d5-442e-9b10-fb9afcedae65 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:36.694112 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9295fe2-c5d5-442e-9b10-fb9afcedae65 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:36.695848 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 499/988] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:36.702261 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77928e3-5be8-40d7-9312-773d0943c037 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:36.702663 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77928e3-5be8-40d7-9312-773d0943c037 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:36.702818 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77928e3-5be8-40d7-9312-773d0943c037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:36.721404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-a77928e3-5be8-40d7-9312-773d0943c037 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:36.722625 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a77928e3-5be8-40d7-9312-773d0943c037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:36.730569 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 490/989] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:36 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:36.753926 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9295fe2-c5d5-442e-9b10-fb9afcedae65 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:36.766449 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9295fe2-c5d5-442e-9b10-fb9afcedae65 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:36.770774 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db2b63-bc1a-43ca-933f-a767539949b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:36.771539 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db2b63-bc1a-43ca-933f-a767539949b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:36.771818 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db2b63-bc1a-43ca-933f-a767539949b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:36.772088 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db2b63-bc1a-43ca-933f-a767539949b5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:36.782696 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db2b63-bc1a-43ca-933f-a767539949b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:14:36.789262 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-63db2b63-bc1a-43ca-933f-a767539949b5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:14:36.790390 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 500/990] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:14:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:36.796642 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77928e3-5be8-40d7-9312-773d0943c037 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:36.805354 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77928e3-5be8-40d7-9312-773d0943c037 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:36.810728 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56631c-e31b-43fa-909d-12f57c6609e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:36.811373 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56631c-e31b-43fa-909d-12f57c6609e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:36.811886 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56631c-e31b-43fa-909d-12f57c6609e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:36.812131 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56631c-e31b-43fa-909d-12f57c6609e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:36.812638 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56631c-e31b-43fa-909d-12f57c6609e3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:36.812976 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56631c-e31b-43fa-909d-12f57c6609e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:36.814548 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56631c-e31b-43fa-909d-12f57c6609e3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:36.822808 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 491/991] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:14:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:36.829519 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db2b63-bc1a-43ca-933f-a767539949b5 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:36.839932 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db2b63-bc1a-43ca-933f-a767539949b5 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:36.844551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665e1ce-e242-4bdc-8c76-4d08a3516a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:36.845430 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665e1ce-e242-4bdc-8c76-4d08a3516a35 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:36.845713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665e1ce-e242-4bdc-8c76-4d08a3516a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:36.845990 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665e1ce-e242-4bdc-8c76-4d08a3516a35 admin admin] PATH_INFO: `/v3/users/8f68d76e853847848951f562e14f4d97` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:36.847169 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665e1ce-e242-4bdc-8c76-4d08a3516a35 admin admin] RBAC: Authorizing `identity:get_user(user_id=8f68d76e853847848951f562e14f4d97)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:36.849331 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665e1ce-e242-4bdc-8c76-4d08a3516a35 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:36.850878 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 501/992] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:14:36 2021] GET /identity/v3/users/8f68d76e853847848951f562e14f4d97 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:36.856612 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56631c-e31b-43fa-909d-12f57c6609e3 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:36.865778 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56631c-e31b-43fa-909d-12f57c6609e3 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:36.870863 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b847b-b28c-4b05-9fab-a34389eb7561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:36.871695 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b847b-b28c-4b05-9fab-a34389eb7561 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:36.871974 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b847b-b28c-4b05-9fab-a34389eb7561 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:36.872246 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b847b-b28c-4b05-9fab-a34389eb7561 admin admin] PATH_INFO: `/v3/projects/feae8c164c6644db9ef9f226680b6513` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:36.873786 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b847b-b28c-4b05-9fab-a34389eb7561 admin admin] RBAC: Authorizing `identity:get_project(project_id=feae8c164c6644db9ef9f226680b6513)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:36.875792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b847b-b28c-4b05-9fab-a34389eb7561 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:36.877415 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 492/993] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:14:36 2021] GET /identity/v3/projects/feae8c164c6644db9ef9f226680b6513 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:36.883367 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665e1ce-e242-4bdc-8c76-4d08a3516a35 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:36.893476 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665e1ce-e242-4bdc-8c76-4d08a3516a35 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:36.897960 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12ec41-9a5b-472a-b59b-7b41ffbcfe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:36.898801 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12ec41-9a5b-472a-b59b-7b41ffbcfe92 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:36.899085 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12ec41-9a5b-472a-b59b-7b41ffbcfe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:36.899363 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12ec41-9a5b-472a-b59b-7b41ffbcfe92 admin admin] PATH_INFO: `/v3/projects/feae8c164c6644db9ef9f226680b6513/users/8f68d76e853847848951f562e14f4d97/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:36.901373 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12ec41-9a5b-472a-b59b-7b41ffbcfe92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feae8c164c6644db9ef9f226680b6513, user_id=8f68d76e853847848951f562e14f4d97, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:36.903958 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12ec41-9a5b-472a-b59b-7b41ffbcfe92 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:36.979669 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 502/994] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:14:36 2021] PUT /identity/v3/projects/feae8c164c6644db9ef9f226680b6513/users/8f68d76e853847848951f562e14f4d97/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:14:39.093815 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e290483-a652-4f1c-aefa-c28d779d09ec None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:39.094364 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e290483-a652-4f1c-aefa-c28d779d09ec None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:39.094364 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e290483-a652-4f1c-aefa-c28d779d09ec None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:39.096128 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 493/995] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:39.101991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc173be5-8d4d-4621-bc8b-9b3289d44baf None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:39.102432 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc173be5-8d4d-4621-bc8b-9b3289d44baf None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:39.102549 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc173be5-8d4d-4621-bc8b-9b3289d44baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:39.120455 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-fc173be5-8d4d-4621-bc8b-9b3289d44baf None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:39.121548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-fc173be5-8d4d-4621-bc8b-9b3289d44baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:39.176159 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 503/996] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:39 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:14:39.200593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e290483-a652-4f1c-aefa-c28d779d09ec None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:39.213562 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e290483-a652-4f1c-aefa-c28d779d09ec None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:39.219331 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91c32f-146d-4dc6-afed-00f1c5a293f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:39.220102 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91c32f-146d-4dc6-afed-00f1c5a293f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:39.220385 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91c32f-146d-4dc6-afed-00f1c5a293f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:39.220659 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91c32f-146d-4dc6-afed-00f1c5a293f9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:39.232553 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91c32f-146d-4dc6-afed-00f1c5a293f9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:14:39.239477 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-da91c32f-146d-4dc6-afed-00f1c5a293f9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:14:39.240610 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 494/997] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:14:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:39.247508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc173be5-8d4d-4621-bc8b-9b3289d44baf None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:39.256282 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc173be5-8d4d-4621-bc8b-9b3289d44baf None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:39.261280 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9419dca-4f5d-4020-b0b9-e7f19157ea2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:39.261941 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9419dca-4f5d-4020-b0b9-e7f19157ea2e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:39.262227 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9419dca-4f5d-4020-b0b9-e7f19157ea2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:39.262504 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9419dca-4f5d-4020-b0b9-e7f19157ea2e admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:39.263244 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9419dca-4f5d-4020-b0b9-e7f19157ea2e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:39.263551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9419dca-4f5d-4020-b0b9-e7f19157ea2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:39.265174 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9419dca-4f5d-4020-b0b9-e7f19157ea2e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:39.273144 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 504/998] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:14:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:39.279938 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91c32f-146d-4dc6-afed-00f1c5a293f9 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:39.289226 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91c32f-146d-4dc6-afed-00f1c5a293f9 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:39.294642 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73417448-5fb8-4a66-86b8-757e70de3c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:39.295468 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73417448-5fb8-4a66-86b8-757e70de3c63 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:39.295775 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73417448-5fb8-4a66-86b8-757e70de3c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:39.296046 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73417448-5fb8-4a66-86b8-757e70de3c63 admin admin] PATH_INFO: `/v3/users/8f68d76e853847848951f562e14f4d97` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:39.297250 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73417448-5fb8-4a66-86b8-757e70de3c63 admin admin] RBAC: Authorizing `identity:get_user(user_id=8f68d76e853847848951f562e14f4d97)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:39.299348 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73417448-5fb8-4a66-86b8-757e70de3c63 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:39.300904 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 495/999] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:14:39 2021] GET /identity/v3/users/8f68d76e853847848951f562e14f4d97 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:39.306706 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9419dca-4f5d-4020-b0b9-e7f19157ea2e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:39.316000 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9419dca-4f5d-4020-b0b9-e7f19157ea2e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:39.320490 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528853f-949b-4c9f-87e5-d5c16dc5f7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:39.321170 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528853f-949b-4c9f-87e5-d5c16dc5f7be admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:39.321451 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528853f-949b-4c9f-87e5-d5c16dc5f7be admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:39.321728 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528853f-949b-4c9f-87e5-d5c16dc5f7be admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:39.329910 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528853f-949b-4c9f-87e5-d5c16dc5f7be admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:39.331633 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528853f-949b-4c9f-87e5-d5c16dc5f7be admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:39.341046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 505/1000] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:14:39 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:14:39.346948 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73417448-5fb8-4a66-86b8-757e70de3c63 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:39.356633 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73417448-5fb8-4a66-86b8-757e70de3c63 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:39.361093 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51446ca-a4b2-4856-9c4b-1257f15b6062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:39.361896 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51446ca-a4b2-4856-9c4b-1257f15b6062 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:39.362176 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51446ca-a4b2-4856-9c4b-1257f15b6062 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:39.362452 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51446ca-a4b2-4856-9c4b-1257f15b6062 admin admin] PATH_INFO: `/v3/projects/feae8c164c6644db9ef9f226680b6513` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:39.363590 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51446ca-a4b2-4856-9c4b-1257f15b6062 admin admin] RBAC: Authorizing `identity:get_project(project_id=feae8c164c6644db9ef9f226680b6513)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:39.365617 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51446ca-a4b2-4856-9c4b-1257f15b6062 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:39.367211 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 496/1001] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:14:39 2021] GET /identity/v3/projects/feae8c164c6644db9ef9f226680b6513 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:39.373494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528853f-949b-4c9f-87e5-d5c16dc5f7be admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:39.381813 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528853f-949b-4c9f-87e5-d5c16dc5f7be admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:39.386479 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea90812-e1b8-4bc1-9a7d-7ec7dbd9b7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:39.387084 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea90812-e1b8-4bc1-9a7d-7ec7dbd9b7fe admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:39.387365 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea90812-e1b8-4bc1-9a7d-7ec7dbd9b7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:39.387642 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea90812-e1b8-4bc1-9a7d-7ec7dbd9b7fe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:39.388448 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea90812-e1b8-4bc1-9a7d-7ec7dbd9b7fe admin admin] RBAC: Adding query filter params (role.id=faadc5010ffb447ba5280e491c2ea2f5, scope.project.id=feae8c164c6644db9ef9f226680b6513, user.id=8f68d76e853847848951f562e14f4d97) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:39.388756 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea90812-e1b8-4bc1-9a7d-7ec7dbd9b7fe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:39.390614 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea90812-e1b8-4bc1-9a7d-7ec7dbd9b7fe admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:39.396414 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 506/1002] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:14:39 2021] GET /identity/v3/role_assignments?user.id=8f68d76e853847848951f562e14f4d97&scope.project.id=feae8c164c6644db9ef9f226680b6513&role.id=faadc5010ffb447ba5280e491c2ea2f5 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:41.559132 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3209d7-d6ca-433f-8b0d-56cd6b2b765b None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:41.559652 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3209d7-d6ca-433f-8b0d-56cd6b2b765b None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:41.559652 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3209d7-d6ca-433f-8b0d-56cd6b2b765b None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:41.561468 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 497/1003] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:41.567285 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da05ed-9620-40b7-9960-97fe49715936 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:41.567676 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da05ed-9620-40b7-9960-97fe49715936 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:41.567836 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da05ed-9620-40b7-9960-97fe49715936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:41.586539 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-24da05ed-9620-40b7-9960-97fe49715936 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:41.587724 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-24da05ed-9620-40b7-9960-97fe49715936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:41.595329 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 507/1004] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:41 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:14:41.620962 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3209d7-d6ca-433f-8b0d-56cd6b2b765b None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:41.632581 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3209d7-d6ca-433f-8b0d-56cd6b2b765b None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:41.637600 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f34ff-4dea-4044-b5ea-dfd06726c437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:41.638356 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f34ff-4dea-4044-b5ea-dfd06726c437 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:41.638631 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f34ff-4dea-4044-b5ea-dfd06726c437 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:41.638902 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f34ff-4dea-4044-b5ea-dfd06726c437 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:41.640037 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f34ff-4dea-4044-b5ea-dfd06726c437 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:41.641723 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f34ff-4dea-4044-b5ea-dfd06726c437 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:41.643250 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 498/1005] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:41 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:41.649081 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da05ed-9620-40b7-9960-97fe49715936 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:41.657719 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da05ed-9620-40b7-9960-97fe49715936 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:41.662167 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424de643-b958-4e72-8d31-8d6300001f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:41.662801 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424de643-b958-4e72-8d31-8d6300001f05 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:41.663078 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424de643-b958-4e72-8d31-8d6300001f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:41.663347 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424de643-b958-4e72-8d31-8d6300001f05 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:41.664041 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424de643-b958-4e72-8d31-8d6300001f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:41.665928 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424de643-b958-4e72-8d31-8d6300001f05 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:41.743596 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 508/1006] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 01:14:41 2021] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:14:43.903222 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca2ef7-d02a-49ae-a779-56c69bbac795 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:43.903749 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca2ef7-d02a-49ae-a779-56c69bbac795 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:43.903749 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca2ef7-d02a-49ae-a779-56c69bbac795 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:43.905556 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 499/1007] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:43.911402 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843cca2-274c-4855-a675-ab6be7dba688 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:43.911782 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843cca2-274c-4855-a675-ab6be7dba688 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:43.911952 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843cca2-274c-4855-a675-ab6be7dba688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:43.929570 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-6843cca2-274c-4855-a675-ab6be7dba688 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:43.930745 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-6843cca2-274c-4855-a675-ab6be7dba688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:43.938819 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 509/1008] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:43 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:43.963568 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca2ef7-d02a-49ae-a779-56c69bbac795 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:43.975537 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca2ef7-d02a-49ae-a779-56c69bbac795 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:43.980585 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c05d30-678f-4889-b68c-6e56805b4866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:43.981434 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c05d30-678f-4889-b68c-6e56805b4866 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:43.981717 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c05d30-678f-4889-b68c-6e56805b4866 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:43.981991 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c05d30-678f-4889-b68c-6e56805b4866 admin admin] PATH_INFO: `/v3/roles/5ce68b651d084d388f8528d29fab2530` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:43.983436 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c05d30-678f-4889-b68c-6e56805b4866 admin admin] RBAC: Authorizing `identity:get_role(role_id=5ce68b651d084d388f8528d29fab2530)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:43.984425 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING py.warnings [None req-49c05d30-678f-4889-b68c-6e56805b4866 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:14:43.984425 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: warnings.warn(msg) Aug 27 01:14:43.984425 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: Aug 27 01:14:43.985324 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c05d30-678f-4889-b68c-6e56805b4866 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:43.986619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 500/1009] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:14:43 2021] GET /identity/v3/roles/5ce68b651d084d388f8528d29fab2530 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:43.992582 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843cca2-274c-4855-a675-ab6be7dba688 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:44.002011 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843cca2-274c-4855-a675-ab6be7dba688 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:44.006488 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb50a5-ea5e-4793-ac35-bef934cd8034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:44.007325 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb50a5-ea5e-4793-ac35-bef934cd8034 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:44.007605 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb50a5-ea5e-4793-ac35-bef934cd8034 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:44.007879 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb50a5-ea5e-4793-ac35-bef934cd8034 admin admin] PATH_INFO: `/v3/users/2466c96d515145a198dd22ea2b6d889c` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:44.020620 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb50a5-ea5e-4793-ac35-bef934cd8034 admin admin] RBAC: Authorizing `identity:get_user(user_id=2466c96d515145a198dd22ea2b6d889c)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:44.022777 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb50a5-ea5e-4793-ac35-bef934cd8034 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:44.024358 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 510/1010] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:14:43 2021] GET /identity/v3/users/2466c96d515145a198dd22ea2b6d889c => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:44.030692 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c05d30-678f-4889-b68c-6e56805b4866 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:44.039894 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c05d30-678f-4889-b68c-6e56805b4866 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:44.045065 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90e1d-3405-47f9-9416-9f143d7a96c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:44.045679 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90e1d-3405-47f9-9416-9f143d7a96c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:44.045959 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90e1d-3405-47f9-9416-9f143d7a96c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:44.046231 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90e1d-3405-47f9-9416-9f143d7a96c3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:44.053668 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d90e1d-3405-47f9-9416-9f143d7a96c3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:44.055353 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d90e1d-3405-47f9-9416-9f143d7a96c3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:44.064447 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 501/1011] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:14:44 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:14:44.070428 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb50a5-ea5e-4793-ac35-bef934cd8034 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:44.079999 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb50a5-ea5e-4793-ac35-bef934cd8034 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:44.084714 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcb51c-aa83-4916-aef4-370ad35402aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:44.085566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb51c-aa83-4916-aef4-370ad35402aa admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:44.085846 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb51c-aa83-4916-aef4-370ad35402aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:44.086119 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb51c-aa83-4916-aef4-370ad35402aa admin admin] PATH_INFO: `/v3/projects/feae8c164c6644db9ef9f226680b6513` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:44.087260 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcb51c-aa83-4916-aef4-370ad35402aa admin admin] RBAC: Authorizing `identity:get_project(project_id=feae8c164c6644db9ef9f226680b6513)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:44.089485 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcb51c-aa83-4916-aef4-370ad35402aa admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:44.091076 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 511/1012] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:14:44 2021] GET /identity/v3/projects/feae8c164c6644db9ef9f226680b6513 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:44.097143 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90e1d-3405-47f9-9416-9f143d7a96c3 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:44.106017 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90e1d-3405-47f9-9416-9f143d7a96c3 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:44.110463 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5b10f-d5c3-4588-857b-b91abf021030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:44.111067 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5b10f-d5c3-4588-857b-b91abf021030 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:44.111347 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5b10f-d5c3-4588-857b-b91abf021030 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:44.111621 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5b10f-d5c3-4588-857b-b91abf021030 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:44.112415 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5b10f-d5c3-4588-857b-b91abf021030 admin admin] RBAC: Adding query filter params (role.id=5ce68b651d084d388f8528d29fab2530, scope.project.id=feae8c164c6644db9ef9f226680b6513, user.id=2466c96d515145a198dd22ea2b6d889c) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:44.112722 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5b10f-d5c3-4588-857b-b91abf021030 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:44.114523 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5b10f-d5c3-4588-857b-b91abf021030 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:44.119593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 502/1013] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:14:44 2021] GET /identity/v3/role_assignments?user.id=2466c96d515145a198dd22ea2b6d889c&scope.project.id=feae8c164c6644db9ef9f226680b6513&role.id=5ce68b651d084d388f8528d29fab2530 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:46.211651 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937d588-9697-4f41-9698-022d90e5edac None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:46.212277 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937d588-9697-4f41-9698-022d90e5edac None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:46.212277 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937d588-9697-4f41-9698-022d90e5edac None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:46.214738 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 512/1014] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:46.220612 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17487a3-404a-4539-b5d7-5e9d354c95cb None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:46.221074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17487a3-404a-4539-b5d7-5e9d354c95cb None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:46.221201 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17487a3-404a-4539-b5d7-5e9d354c95cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:46.240596 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b17487a3-404a-4539-b5d7-5e9d354c95cb None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:46.241808 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b17487a3-404a-4539-b5d7-5e9d354c95cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:46.249661 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 503/1015] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:46 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:46.273698 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937d588-9697-4f41-9698-022d90e5edac None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:46.286374 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937d588-9697-4f41-9698-022d90e5edac None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:46.290692 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10c3bf-be19-4b17-9497-5cc21b503585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:46.291521 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10c3bf-be19-4b17-9497-5cc21b503585 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:46.291801 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10c3bf-be19-4b17-9497-5cc21b503585 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:46.292076 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10c3bf-be19-4b17-9497-5cc21b503585 admin admin] PATH_INFO: `/v3/roles/5ce68b651d084d388f8528d29fab2530` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:46.293566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10c3bf-be19-4b17-9497-5cc21b503585 admin admin] RBAC: Authorizing `identity:get_role(role_id=5ce68b651d084d388f8528d29fab2530)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:46.294563 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING py.warnings [None req-1d10c3bf-be19-4b17-9497-5cc21b503585 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:14:46.294563 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: warnings.warn(msg) Aug 27 01:14:46.294563 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: Aug 27 01:14:46.295433 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10c3bf-be19-4b17-9497-5cc21b503585 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:46.296740 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 513/1016] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:14:46 2021] GET /identity/v3/roles/5ce68b651d084d388f8528d29fab2530 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:46.302959 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17487a3-404a-4539-b5d7-5e9d354c95cb None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:46.312000 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17487a3-404a-4539-b5d7-5e9d354c95cb None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:46.316394 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4253f-5256-4688-8e7f-7bd1e72536bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:46.317266 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4253f-5256-4688-8e7f-7bd1e72536bb admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:46.317544 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4253f-5256-4688-8e7f-7bd1e72536bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:46.317813 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4253f-5256-4688-8e7f-7bd1e72536bb admin admin] PATH_INFO: `/v3/users/2466c96d515145a198dd22ea2b6d889c` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:46.319168 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4253f-5256-4688-8e7f-7bd1e72536bb admin admin] RBAC: Authorizing `identity:get_user(user_id=2466c96d515145a198dd22ea2b6d889c)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:46.321292 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4253f-5256-4688-8e7f-7bd1e72536bb admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:46.323714 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 504/1017] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:14:46 2021] GET /identity/v3/users/2466c96d515145a198dd22ea2b6d889c => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:46.329961 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10c3bf-be19-4b17-9497-5cc21b503585 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:46.339974 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10c3bf-be19-4b17-9497-5cc21b503585 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:46.344337 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0a57d-44db-40df-bf9e-d401b9d75f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:46.345175 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0a57d-44db-40df-bf9e-d401b9d75f1f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:46.345455 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0a57d-44db-40df-bf9e-d401b9d75f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:46.345725 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0a57d-44db-40df-bf9e-d401b9d75f1f admin admin] PATH_INFO: `/v3/projects/feae8c164c6644db9ef9f226680b6513` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:46.346857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0a57d-44db-40df-bf9e-d401b9d75f1f admin admin] RBAC: Authorizing `identity:get_project(project_id=feae8c164c6644db9ef9f226680b6513)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:46.348822 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0a57d-44db-40df-bf9e-d401b9d75f1f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:46.350585 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 514/1018] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:14:46 2021] GET /identity/v3/projects/feae8c164c6644db9ef9f226680b6513 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:46.356802 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4253f-5256-4688-8e7f-7bd1e72536bb admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:46.365818 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4253f-5256-4688-8e7f-7bd1e72536bb admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:46.370423 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368369ac-324c-4e51-88a3-96c8e540536f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:46.371239 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368369ac-324c-4e51-88a3-96c8e540536f admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:46.371511 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368369ac-324c-4e51-88a3-96c8e540536f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:46.371776 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368369ac-324c-4e51-88a3-96c8e540536f admin admin] PATH_INFO: `/v3/projects/feae8c164c6644db9ef9f226680b6513/users/2466c96d515145a198dd22ea2b6d889c/roles/5ce68b651d084d388f8528d29fab2530` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:46.373949 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368369ac-324c-4e51-88a3-96c8e540536f admin admin] RBAC: Authorizing `identity:create_grant(project_id=feae8c164c6644db9ef9f226680b6513, user_id=2466c96d515145a198dd22ea2b6d889c, role_id=5ce68b651d084d388f8528d29fab2530)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:46.376569 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368369ac-324c-4e51-88a3-96c8e540536f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:46.460017 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 505/1019] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:14:46 2021] PUT /identity/v3/projects/feae8c164c6644db9ef9f226680b6513/users/2466c96d515145a198dd22ea2b6d889c/roles/5ce68b651d084d388f8528d29fab2530 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:14:48.607010 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd0f73-a22c-4b9e-a574-e3f3ff225556 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:48.607531 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd0f73-a22c-4b9e-a574-e3f3ff225556 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:48.607651 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd0f73-a22c-4b9e-a574-e3f3ff225556 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:48.609374 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 515/1020] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:48.615328 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778bfcb-7e7b-44c7-9b55-a8270c03a13e None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:48.615709 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778bfcb-7e7b-44c7-9b55-a8270c03a13e None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:48.615890 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778bfcb-7e7b-44c7-9b55-a8270c03a13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:48.633125 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b778bfcb-7e7b-44c7-9b55-a8270c03a13e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:48.634302 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b778bfcb-7e7b-44c7-9b55-a8270c03a13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:48.688910 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 506/1021] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:48 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:48.715054 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd0f73-a22c-4b9e-a574-e3f3ff225556 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:48.726970 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd0f73-a22c-4b9e-a574-e3f3ff225556 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:48.732018 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e93d85-b1d8-4a69-a5d5-8a89cf5b75d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:48.732873 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e93d85-b1d8-4a69-a5d5-8a89cf5b75d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:48.733160 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e93d85-b1d8-4a69-a5d5-8a89cf5b75d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:48.733436 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e93d85-b1d8-4a69-a5d5-8a89cf5b75d2 admin admin] PATH_INFO: `/v3/roles/5ce68b651d084d388f8528d29fab2530` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:48.734888 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e93d85-b1d8-4a69-a5d5-8a89cf5b75d2 admin admin] RBAC: Authorizing `identity:get_role(role_id=5ce68b651d084d388f8528d29fab2530)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:48.736460 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e93d85-b1d8-4a69-a5d5-8a89cf5b75d2 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:48.737796 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 516/1022] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:14:48 2021] GET /identity/v3/roles/5ce68b651d084d388f8528d29fab2530 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:48.743896 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778bfcb-7e7b-44c7-9b55-a8270c03a13e None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:48.752932 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778bfcb-7e7b-44c7-9b55-a8270c03a13e None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:48.757340 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71aebf-012b-4260-ae78-fbffb9d65dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:48.758183 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71aebf-012b-4260-ae78-fbffb9d65dbe admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:48.758462 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71aebf-012b-4260-ae78-fbffb9d65dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:48.758733 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71aebf-012b-4260-ae78-fbffb9d65dbe admin admin] PATH_INFO: `/v3/users/2466c96d515145a198dd22ea2b6d889c` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:48.759901 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71aebf-012b-4260-ae78-fbffb9d65dbe admin admin] RBAC: Authorizing `identity:get_user(user_id=2466c96d515145a198dd22ea2b6d889c)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:48.762689 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71aebf-012b-4260-ae78-fbffb9d65dbe admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:48.764238 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 507/1023] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:14:48 2021] GET /identity/v3/users/2466c96d515145a198dd22ea2b6d889c => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:48.770100 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e93d85-b1d8-4a69-a5d5-8a89cf5b75d2 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:48.780393 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e93d85-b1d8-4a69-a5d5-8a89cf5b75d2 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:48.784878 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c482fb1-3443-4e3f-a733-4d1e5580f7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:48.785488 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c482fb1-3443-4e3f-a733-4d1e5580f7aa admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:48.785773 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c482fb1-3443-4e3f-a733-4d1e5580f7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:48.786052 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c482fb1-3443-4e3f-a733-4d1e5580f7aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:48.793653 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c482fb1-3443-4e3f-a733-4d1e5580f7aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:48.795341 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c482fb1-3443-4e3f-a733-4d1e5580f7aa admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:48.803931 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 517/1024] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:14:48 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:14:48.810695 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71aebf-012b-4260-ae78-fbffb9d65dbe admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:48.819911 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71aebf-012b-4260-ae78-fbffb9d65dbe admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:48.825252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32464ba-8bdb-4b9f-a18c-d2a62f786f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:48.826077 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32464ba-8bdb-4b9f-a18c-d2a62f786f3d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:48.826359 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32464ba-8bdb-4b9f-a18c-d2a62f786f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:48.826637 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32464ba-8bdb-4b9f-a18c-d2a62f786f3d admin admin] PATH_INFO: `/v3/projects/feae8c164c6644db9ef9f226680b6513` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:48.827790 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32464ba-8bdb-4b9f-a18c-d2a62f786f3d admin admin] RBAC: Authorizing `identity:get_project(project_id=feae8c164c6644db9ef9f226680b6513)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:48.830105 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32464ba-8bdb-4b9f-a18c-d2a62f786f3d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:48.831737 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 508/1025] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:14:48 2021] GET /identity/v3/projects/feae8c164c6644db9ef9f226680b6513 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:48.838116 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c482fb1-3443-4e3f-a733-4d1e5580f7aa admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:48.846762 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c482fb1-3443-4e3f-a733-4d1e5580f7aa admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:48.851192 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb13364-d0d8-4040-891a-d1b55a0fb2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:48.851811 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb13364-d0d8-4040-891a-d1b55a0fb2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:48.852094 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb13364-d0d8-4040-891a-d1b55a0fb2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:48.852366 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb13364-d0d8-4040-891a-d1b55a0fb2d8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:48.853214 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb13364-d0d8-4040-891a-d1b55a0fb2d8 admin admin] RBAC: Adding query filter params (role.id=5ce68b651d084d388f8528d29fab2530, scope.project.id=feae8c164c6644db9ef9f226680b6513, user.id=2466c96d515145a198dd22ea2b6d889c) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:48.853521 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb13364-d0d8-4040-891a-d1b55a0fb2d8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:48.855322 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb13364-d0d8-4040-891a-d1b55a0fb2d8 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:48.860724 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 518/1026] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:14:48 2021] GET /identity/v3/role_assignments?user.id=2466c96d515145a198dd22ea2b6d889c&scope.project.id=feae8c164c6644db9ef9f226680b6513&role.id=5ce68b651d084d388f8528d29fab2530 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:51.062140 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8350b7-e8e0-4e02-9598-a6745266bb3c None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:51.062674 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8350b7-e8e0-4e02-9598-a6745266bb3c None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:51.062674 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8350b7-e8e0-4e02-9598-a6745266bb3c None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:51.064444 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 509/1027] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:51.070242 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d73c3-96fc-4447-958f-bba9b1e838ff None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:51.070634 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d73c3-96fc-4447-958f-bba9b1e838ff None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:51.070795 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d73c3-96fc-4447-958f-bba9b1e838ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:51.088047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-062d73c3-96fc-4447-958f-bba9b1e838ff None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:51.089823 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-062d73c3-96fc-4447-958f-bba9b1e838ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:51.097236 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 519/1028] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:51 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:51.121538 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8350b7-e8e0-4e02-9598-a6745266bb3c None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:51.133389 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8350b7-e8e0-4e02-9598-a6745266bb3c None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:51.137946 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c025376-8889-4777-a32c-f1c5f48eab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:51.138708 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c025376-8889-4777-a32c-f1c5f48eab4c admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:51.138987 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c025376-8889-4777-a32c-f1c5f48eab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:51.139256 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c025376-8889-4777-a32c-f1c5f48eab4c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:51.140395 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c025376-8889-4777-a32c-f1c5f48eab4c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:51.142092 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c025376-8889-4777-a32c-f1c5f48eab4c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:51.143631 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 510/1029] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:51 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:51.149513 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d73c3-96fc-4447-958f-bba9b1e838ff None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:51.158935 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d73c3-96fc-4447-958f-bba9b1e838ff None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:51.163366 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bf0b9-05d9-4278-b7a9-216608540d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:51.163992 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bf0b9-05d9-4278-b7a9-216608540d96 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:51.164270 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bf0b9-05d9-4278-b7a9-216608540d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:51.164541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bf0b9-05d9-4278-b7a9-216608540d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:51.165278 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3bf0b9-05d9-4278-b7a9-216608540d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:51.167836 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3bf0b9-05d9-4278-b7a9-216608540d96 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:51.278214 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 520/1030] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 01:14:51 2021] POST /identity/v3/projects => generated 311 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:14:53.491731 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974259c0-8b1e-4fa5-b72c-3c58df0c07c6 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:53.492271 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974259c0-8b1e-4fa5-b72c-3c58df0c07c6 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:53.492271 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974259c0-8b1e-4fa5-b72c-3c58df0c07c6 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:53.494076 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 511/1031] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:53.500037 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cad1e0-9d77-4ee4-9014-aedbccd274ab None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:53.500465 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cad1e0-9d77-4ee4-9014-aedbccd274ab None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:53.500596 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cad1e0-9d77-4ee4-9014-aedbccd274ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:53.518120 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-85cad1e0-9d77-4ee4-9014-aedbccd274ab None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:53.519327 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-85cad1e0-9d77-4ee4-9014-aedbccd274ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:53.576819 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 521/1032] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:53 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:53.602971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974259c0-8b1e-4fa5-b72c-3c58df0c07c6 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:53.615492 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974259c0-8b1e-4fa5-b72c-3c58df0c07c6 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:53.620025 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114e7b3-2d41-4daf-8889-59d5131783e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:53.620823 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114e7b3-2d41-4daf-8889-59d5131783e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:53.621137 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114e7b3-2d41-4daf-8889-59d5131783e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:53.621419 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114e7b3-2d41-4daf-8889-59d5131783e7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:53.622590 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114e7b3-2d41-4daf-8889-59d5131783e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:53.624273 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114e7b3-2d41-4daf-8889-59d5131783e7 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:53.625884 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 512/1033] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:14:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:53.631893 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cad1e0-9d77-4ee4-9014-aedbccd274ab None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:53.640645 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cad1e0-9d77-4ee4-9014-aedbccd274ab None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:53.645130 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0133b03-5a0c-42c8-a14c-903562325164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:53.645776 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0133b03-5a0c-42c8-a14c-903562325164 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:53.646059 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0133b03-5a0c-42c8-a14c-903562325164 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:53.646338 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0133b03-5a0c-42c8-a14c-903562325164 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:53.647033 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0133b03-5a0c-42c8-a14c-903562325164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:53.648950 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0133b03-5a0c-42c8-a14c-903562325164 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:53.745153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 522/1034] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 01:14:53 2021] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:14:55.914525 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc49d7-53f4-46a1-ab83-c6be579cee6f None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:55.915070 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc49d7-53f4-46a1-ab83-c6be579cee6f None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:55.915070 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc49d7-53f4-46a1-ab83-c6be579cee6f None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:55.917404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 513/1035] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:55.923360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c414d52-0f58-4f54-85c1-f56a063dfeb1 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:55.923747 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c414d52-0f58-4f54-85c1-f56a063dfeb1 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:55.923904 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c414d52-0f58-4f54-85c1-f56a063dfeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:55.942096 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-2c414d52-0f58-4f54-85c1-f56a063dfeb1 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:55.943278 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-2c414d52-0f58-4f54-85c1-f56a063dfeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:55.951365 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 523/1036] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:55 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:14:55.975902 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc49d7-53f4-46a1-ab83-c6be579cee6f None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:55.988338 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc49d7-53f4-46a1-ab83-c6be579cee6f None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:55.992619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaac6c4-078b-4589-8cd5-e97d7200a871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:55.993414 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaac6c4-078b-4589-8cd5-e97d7200a871 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:55.993692 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaac6c4-078b-4589-8cd5-e97d7200a871 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:55.993963 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaac6c4-078b-4589-8cd5-e97d7200a871 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:56.004268 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaac6c4-078b-4589-8cd5-e97d7200a871 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:14:56.011493 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-beaac6c4-078b-4589-8cd5-e97d7200a871 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:14:56.012606 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 514/1037] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:14:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:56.018908 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c414d52-0f58-4f54-85c1-f56a063dfeb1 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:56.027571 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c414d52-0f58-4f54-85c1-f56a063dfeb1 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:56.031958 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62dce23-e507-4023-9e36-26cad03bfb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:56.032596 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dce23-e507-4023-9e36-26cad03bfb5d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:56.032899 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dce23-e507-4023-9e36-26cad03bfb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:56.033169 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dce23-e507-4023-9e36-26cad03bfb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:56.033901 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62dce23-e507-4023-9e36-26cad03bfb5d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:56.034201 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62dce23-e507-4023-9e36-26cad03bfb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:56.035771 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62dce23-e507-4023-9e36-26cad03bfb5d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:56.044235 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 524/1038] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:14:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:56.050348 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaac6c4-078b-4589-8cd5-e97d7200a871 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:56.060744 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaac6c4-078b-4589-8cd5-e97d7200a871 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:56.065233 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e226a-26a1-4376-b8f4-bd10b1e85926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:56.066083 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e226a-26a1-4376-b8f4-bd10b1e85926 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:56.066362 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e226a-26a1-4376-b8f4-bd10b1e85926 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:56.066633 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e226a-26a1-4376-b8f4-bd10b1e85926 admin admin] PATH_INFO: `/v3/users/de5afdccf21c44b79c47bb7fe4609104` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:56.079517 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e226a-26a1-4376-b8f4-bd10b1e85926 admin admin] RBAC: Authorizing `identity:get_user(user_id=de5afdccf21c44b79c47bb7fe4609104)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:56.081659 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e226a-26a1-4376-b8f4-bd10b1e85926 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:56.083236 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 515/1039] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:14:56 2021] GET /identity/v3/users/de5afdccf21c44b79c47bb7fe4609104 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:56.089385 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62dce23-e507-4023-9e36-26cad03bfb5d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:56.098714 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62dce23-e507-4023-9e36-26cad03bfb5d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:56.103224 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b859cfc-5817-458f-a7f1-7c59559d3414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:56.104559 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b859cfc-5817-458f-a7f1-7c59559d3414 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:56.104822 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b859cfc-5817-458f-a7f1-7c59559d3414 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:56.105126 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b859cfc-5817-458f-a7f1-7c59559d3414 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:56.112550 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b859cfc-5817-458f-a7f1-7c59559d3414 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:56.114310 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b859cfc-5817-458f-a7f1-7c59559d3414 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:56.123701 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 525/1040] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:14:56 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:14:56.129635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e226a-26a1-4376-b8f4-bd10b1e85926 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:56.138711 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e226a-26a1-4376-b8f4-bd10b1e85926 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:56.143118 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10e424-68f3-47bc-b906-e1b0dfd6ccf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:56.143922 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10e424-68f3-47bc-b906-e1b0dfd6ccf5 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:56.144200 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10e424-68f3-47bc-b906-e1b0dfd6ccf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:56.144473 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10e424-68f3-47bc-b906-e1b0dfd6ccf5 admin admin] PATH_INFO: `/v3/projects/4d40529491f64b6885c9f369c5354d38` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:56.145636 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10e424-68f3-47bc-b906-e1b0dfd6ccf5 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d40529491f64b6885c9f369c5354d38)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:56.147599 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10e424-68f3-47bc-b906-e1b0dfd6ccf5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:56.149340 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 516/1041] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:14:56 2021] GET /identity/v3/projects/4d40529491f64b6885c9f369c5354d38 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:56.155336 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b859cfc-5817-458f-a7f1-7c59559d3414 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:56.163619 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b859cfc-5817-458f-a7f1-7c59559d3414 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:56.168686 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd0818-ece1-45fa-9101-a92a3a16983c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:56.169270 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd0818-ece1-45fa-9101-a92a3a16983c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:56.169549 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd0818-ece1-45fa-9101-a92a3a16983c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:56.169816 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd0818-ece1-45fa-9101-a92a3a16983c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:56.170614 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd0818-ece1-45fa-9101-a92a3a16983c admin admin] RBAC: Adding query filter params (role.id=faadc5010ffb447ba5280e491c2ea2f5, scope.project.id=4d40529491f64b6885c9f369c5354d38, user.id=de5afdccf21c44b79c47bb7fe4609104) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:56.170917 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd0818-ece1-45fa-9101-a92a3a16983c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:56.172687 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd0818-ece1-45fa-9101-a92a3a16983c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:56.177809 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 526/1042] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:14:56 2021] GET /identity/v3/role_assignments?user.id=de5afdccf21c44b79c47bb7fe4609104&scope.project.id=4d40529491f64b6885c9f369c5354d38&role.id=faadc5010ffb447ba5280e491c2ea2f5 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:14:58.255421 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78e140-7330-4ef3-baaf-19063a4fa66d None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:58.255968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78e140-7330-4ef3-baaf-19063a4fa66d None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:58.255968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78e140-7330-4ef3-baaf-19063a4fa66d None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:58.257782 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 517/1043] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:14:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:14:58.264140 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d22a46-a99b-48c1-babf-475c7d04cf2e None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:58.264558 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d22a46-a99b-48c1-babf-475c7d04cf2e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:58.264690 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d22a46-a99b-48c1-babf-475c7d04cf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:58.282951 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-d6d22a46-a99b-48c1-babf-475c7d04cf2e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:14:58.284139 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-d6d22a46-a99b-48c1-babf-475c7d04cf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:14:58.292327 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 527/1044] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:14:58 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:14:58.315841 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78e140-7330-4ef3-baaf-19063a4fa66d None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:58.328496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78e140-7330-4ef3-baaf-19063a4fa66d None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:58.332809 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35b24d-640d-4a0c-8581-b9a70c90f2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:58.333624 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35b24d-640d-4a0c-8581-b9a70c90f2fb admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:58.333904 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35b24d-640d-4a0c-8581-b9a70c90f2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:58.334176 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35b24d-640d-4a0c-8581-b9a70c90f2fb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:58.344726 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35b24d-640d-4a0c-8581-b9a70c90f2fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:14:58.351436 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-6b35b24d-640d-4a0c-8581-b9a70c90f2fb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:14:58.352557 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 518/1045] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:14:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:14:58.359034 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d22a46-a99b-48c1-babf-475c7d04cf2e None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:58.367802 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d22a46-a99b-48c1-babf-475c7d04cf2e None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:58.372267 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977bcde-a26f-4359-88cf-c93127c0107b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:58.372946 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977bcde-a26f-4359-88cf-c93127c0107b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:58.373230 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977bcde-a26f-4359-88cf-c93127c0107b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:58.373510 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977bcde-a26f-4359-88cf-c93127c0107b admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:58.374238 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977bcde-a26f-4359-88cf-c93127c0107b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:14:58.374542 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977bcde-a26f-4359-88cf-c93127c0107b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:58.376107 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977bcde-a26f-4359-88cf-c93127c0107b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:58.384009 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 528/1046] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:14:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:58.390733 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35b24d-640d-4a0c-8581-b9a70c90f2fb admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:58.401489 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35b24d-640d-4a0c-8581-b9a70c90f2fb admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:58.405974 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cceb7-84d3-44ea-a653-812f5a63fe9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:58.406817 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cceb7-84d3-44ea-a653-812f5a63fe9c admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:58.407097 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cceb7-84d3-44ea-a653-812f5a63fe9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:58.407371 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cceb7-84d3-44ea-a653-812f5a63fe9c admin admin] PATH_INFO: `/v3/users/de5afdccf21c44b79c47bb7fe4609104` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:58.408538 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cceb7-84d3-44ea-a653-812f5a63fe9c admin admin] RBAC: Authorizing `identity:get_user(user_id=de5afdccf21c44b79c47bb7fe4609104)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:58.410676 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cceb7-84d3-44ea-a653-812f5a63fe9c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:58.412273 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 519/1047] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:14:58 2021] GET /identity/v3/users/de5afdccf21c44b79c47bb7fe4609104 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:58.419087 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977bcde-a26f-4359-88cf-c93127c0107b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:58.428509 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977bcde-a26f-4359-88cf-c93127c0107b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:58.433208 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5073149-0ec2-4e24-8788-6dc4750604d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:58.434047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5073149-0ec2-4e24-8788-6dc4750604d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:58.434328 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5073149-0ec2-4e24-8788-6dc4750604d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:58.434605 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5073149-0ec2-4e24-8788-6dc4750604d6 admin admin] PATH_INFO: `/v3/projects/4d40529491f64b6885c9f369c5354d38` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:58.435781 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5073149-0ec2-4e24-8788-6dc4750604d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d40529491f64b6885c9f369c5354d38)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:58.437839 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5073149-0ec2-4e24-8788-6dc4750604d6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:58.439464 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 529/1048] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:14:58 2021] GET /identity/v3/projects/4d40529491f64b6885c9f369c5354d38 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:14:58.445795 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cceb7-84d3-44ea-a653-812f5a63fe9c admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:14:58.456130 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cceb7-84d3-44ea-a653-812f5a63fe9c admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:14:58.460689 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d415bb7-19ca-47c3-8aa5-07a2b82f6bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:14:58.461565 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d415bb7-19ca-47c3-8aa5-07a2b82f6bc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:14:58.461841 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d415bb7-19ca-47c3-8aa5-07a2b82f6bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:14:58.462109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d415bb7-19ca-47c3-8aa5-07a2b82f6bc7 admin admin] PATH_INFO: `/v3/projects/4d40529491f64b6885c9f369c5354d38/users/de5afdccf21c44b79c47bb7fe4609104/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:14:58.464972 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d415bb7-19ca-47c3-8aa5-07a2b82f6bc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d40529491f64b6885c9f369c5354d38, user_id=de5afdccf21c44b79c47bb7fe4609104, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:14:58.467521 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d415bb7-19ca-47c3-8aa5-07a2b82f6bc7 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:14:58.562097 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 520/1049] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:14:58 2021] PUT /identity/v3/projects/4d40529491f64b6885c9f369c5354d38/users/de5afdccf21c44b79c47bb7fe4609104/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:15:00.678072 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd449b34-1a14-4428-bb73-0f76cd1bdd4c None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:00.678595 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd449b34-1a14-4428-bb73-0f76cd1bdd4c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:00.678595 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd449b34-1a14-4428-bb73-0f76cd1bdd4c None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:00.680294 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 530/1050] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:15:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:15:00.686676 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ec033-15f5-40f3-8e7b-e6dd50f4fd19 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:00.687104 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ec033-15f5-40f3-8e7b-e6dd50f4fd19 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:00.687230 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ec033-15f5-40f3-8e7b-e6dd50f4fd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:00.704570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-0f4ec033-15f5-40f3-8e7b-e6dd50f4fd19 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:15:00.705798 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-0f4ec033-15f5-40f3-8e7b-e6dd50f4fd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:15:00.759784 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 521/1051] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:15:00 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:15:00.784399 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd449b34-1a14-4428-bb73-0f76cd1bdd4c None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:00.796744 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd449b34-1a14-4428-bb73-0f76cd1bdd4c None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:00.801127 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e27c5-4195-4ba9-845f-6f48d9bc691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:00.801891 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e27c5-4195-4ba9-845f-6f48d9bc691e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:00.802174 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e27c5-4195-4ba9-845f-6f48d9bc691e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:00.802449 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e27c5-4195-4ba9-845f-6f48d9bc691e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:00.812894 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e27c5-4195-4ba9-845f-6f48d9bc691e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:15:00.819525 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-cb0e27c5-4195-4ba9-845f-6f48d9bc691e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:15:00.820646 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 531/1052] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:15:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:15:00.826793 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ec033-15f5-40f3-8e7b-e6dd50f4fd19 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:00.835680 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ec033-15f5-40f3-8e7b-e6dd50f4fd19 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:00.840772 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfca162-b485-4269-85ee-aa6e4fad0e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:00.841442 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfca162-b485-4269-85ee-aa6e4fad0e55 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:00.841725 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfca162-b485-4269-85ee-aa6e4fad0e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:00.841999 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfca162-b485-4269-85ee-aa6e4fad0e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:00.842733 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfca162-b485-4269-85ee-aa6e4fad0e55 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:15:00.843039 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfca162-b485-4269-85ee-aa6e4fad0e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:00.844646 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfca162-b485-4269-85ee-aa6e4fad0e55 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:00.852510 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 522/1053] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:15:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:15:00.859109 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e27c5-4195-4ba9-845f-6f48d9bc691e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:00.868896 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e27c5-4195-4ba9-845f-6f48d9bc691e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:00.873338 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515a5dd-e3d9-489b-8201-0797f186745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:00.874160 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515a5dd-e3d9-489b-8201-0797f186745d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:00.874439 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515a5dd-e3d9-489b-8201-0797f186745d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:00.874713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515a5dd-e3d9-489b-8201-0797f186745d admin admin] PATH_INFO: `/v3/users/de5afdccf21c44b79c47bb7fe4609104` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:00.875879 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515a5dd-e3d9-489b-8201-0797f186745d admin admin] RBAC: Authorizing `identity:get_user(user_id=de5afdccf21c44b79c47bb7fe4609104)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:00.878018 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515a5dd-e3d9-489b-8201-0797f186745d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:00.879548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 532/1054] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:15:00 2021] GET /identity/v3/users/de5afdccf21c44b79c47bb7fe4609104 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:15:00.885850 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfca162-b485-4269-85ee-aa6e4fad0e55 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:00.895071 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfca162-b485-4269-85ee-aa6e4fad0e55 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:00.899547 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68823c5b-e026-4a59-81bc-ee7974a7f677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:00.900663 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68823c5b-e026-4a59-81bc-ee7974a7f677 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:00.900984 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68823c5b-e026-4a59-81bc-ee7974a7f677 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:00.901262 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68823c5b-e026-4a59-81bc-ee7974a7f677 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:00.908784 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68823c5b-e026-4a59-81bc-ee7974a7f677 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:00.910503 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68823c5b-e026-4a59-81bc-ee7974a7f677 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:00.919608 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 523/1055] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:15:00 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:15:00.925537 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515a5dd-e3d9-489b-8201-0797f186745d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:00.934847 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515a5dd-e3d9-489b-8201-0797f186745d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:00.939179 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f644c-f90c-44b0-aee9-168dafca06f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:00.939973 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f644c-f90c-44b0-aee9-168dafca06f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:00.940254 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f644c-f90c-44b0-aee9-168dafca06f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:00.940525 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f644c-f90c-44b0-aee9-168dafca06f3 admin admin] PATH_INFO: `/v3/projects/4d40529491f64b6885c9f369c5354d38` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:00.941701 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f644c-f90c-44b0-aee9-168dafca06f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d40529491f64b6885c9f369c5354d38)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:00.943694 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f644c-f90c-44b0-aee9-168dafca06f3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:00.945320 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 533/1056] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:15:00 2021] GET /identity/v3/projects/4d40529491f64b6885c9f369c5354d38 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:15:00.951752 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68823c5b-e026-4a59-81bc-ee7974a7f677 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:00.960344 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68823c5b-e026-4a59-81bc-ee7974a7f677 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:00.965797 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e23bf-3820-448e-9a2c-9b75e95a107c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:00.966411 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e23bf-3820-448e-9a2c-9b75e95a107c admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:00.966698 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e23bf-3820-448e-9a2c-9b75e95a107c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:00.966977 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e23bf-3820-448e-9a2c-9b75e95a107c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:00.967781 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e23bf-3820-448e-9a2c-9b75e95a107c admin admin] RBAC: Adding query filter params (role.id=faadc5010ffb447ba5280e491c2ea2f5, scope.project.id=4d40529491f64b6885c9f369c5354d38, user.id=de5afdccf21c44b79c47bb7fe4609104) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:15:00.968094 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e23bf-3820-448e-9a2c-9b75e95a107c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:00.969924 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e23bf-3820-448e-9a2c-9b75e95a107c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:00.975538 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 524/1057] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:15:00 2021] GET /identity/v3/role_assignments?user.id=de5afdccf21c44b79c47bb7fe4609104&scope.project.id=4d40529491f64b6885c9f369c5354d38&role.id=faadc5010ffb447ba5280e491c2ea2f5 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:15:03.130518 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad07a1-e67d-40f7-90ad-98d381d472b8 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:03.131047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad07a1-e67d-40f7-90ad-98d381d472b8 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:03.131047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad07a1-e67d-40f7-90ad-98d381d472b8 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:03.132945 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 534/1058] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:15:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:15:03.139578 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c0077-ea28-419e-aa31-69996b83aa08 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:03.139990 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c0077-ea28-419e-aa31-69996b83aa08 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:03.140126 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c0077-ea28-419e-aa31-69996b83aa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:03.157085 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-144c0077-ea28-419e-aa31-69996b83aa08 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:15:03.158253 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-144c0077-ea28-419e-aa31-69996b83aa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:15:03.165721 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 525/1059] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:15:03 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:15:03.189413 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad07a1-e67d-40f7-90ad-98d381d472b8 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:03.202308 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad07a1-e67d-40f7-90ad-98d381d472b8 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:03.206945 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d81833-f5cb-4190-884a-f21c28e3c089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:03.207572 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d81833-f5cb-4190-884a-f21c28e3c089 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:03.207852 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d81833-f5cb-4190-884a-f21c28e3c089 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:03.208123 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d81833-f5cb-4190-884a-f21c28e3c089 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:03.215684 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d81833-f5cb-4190-884a-f21c28e3c089 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:03.217448 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d81833-f5cb-4190-884a-f21c28e3c089 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:03.225997 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 535/1060] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:15:03 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:15:03.232421 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c0077-ea28-419e-aa31-69996b83aa08 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:03.241039 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c0077-ea28-419e-aa31-69996b83aa08 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:03.246173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3aea78-a767-4234-86c6-a175041db5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:03.246943 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aea78-a767-4234-86c6-a175041db5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:03.247220 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aea78-a767-4234-86c6-a175041db5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:03.247487 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aea78-a767-4234-86c6-a175041db5e1 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:03.254098 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3aea78-a767-4234-86c6-a175041db5e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:03.255886 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3aea78-a767-4234-86c6-a175041db5e1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:03.269898 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-1d3aea78-a767-4234-86c6-a175041db5e1 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 27 01:15:03.270995 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 526/1061] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Aug 27 01:15:03 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:15:03.277482 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d81833-f5cb-4190-884a-f21c28e3c089 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:03.285950 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d81833-f5cb-4190-884a-f21c28e3c089 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:03.290401 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a6530-4b3d-4d28-ab28-4ecaab8b9b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:03.291054 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a6530-4b3d-4d28-ab28-4ecaab8b9b20 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:03.291335 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a6530-4b3d-4d28-ab28-4ecaab8b9b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:03.291608 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a6530-4b3d-4d28-ab28-4ecaab8b9b20 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:03.292306 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a6530-4b3d-4d28-ab28-4ecaab8b9b20 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:15:03.292611 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a6530-4b3d-4d28-ab28-4ecaab8b9b20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:03.294199 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a6530-4b3d-4d28-ab28-4ecaab8b9b20 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:03.301367 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 536/1062] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Aug 27 01:15:03 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:15:05.438394 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808efce-73f9-40e1-bd15-70a7f939d948 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:05.438858 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808efce-73f9-40e1-bd15-70a7f939d948 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:05.438951 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808efce-73f9-40e1-bd15-70a7f939d948 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:05.440684 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 527/1063] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:15:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:15:05.446637 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b812b3-33fa-4dd6-8eda-397fce7a1a1d None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:05.447212 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b812b3-33fa-4dd6-8eda-397fce7a1a1d None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:05.447212 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b812b3-33fa-4dd6-8eda-397fce7a1a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:05.464900 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-b8b812b3-33fa-4dd6-8eda-397fce7a1a1d None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:15:05.466070 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-b8b812b3-33fa-4dd6-8eda-397fce7a1a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:15:05.473465 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 537/1064] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:15:05 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:15:05.497509 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808efce-73f9-40e1-bd15-70a7f939d948 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:05.511599 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808efce-73f9-40e1-bd15-70a7f939d948 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:05.515901 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e3df8-e3f3-4ca2-8c69-6ff0d1ff49ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:05.516534 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e3df8-e3f3-4ca2-8c69-6ff0d1ff49ce admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:05.516814 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e3df8-e3f3-4ca2-8c69-6ff0d1ff49ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:05.517116 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e3df8-e3f3-4ca2-8c69-6ff0d1ff49ce admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:05.517854 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e3df8-e3f3-4ca2-8c69-6ff0d1ff49ce admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:05.518841 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING py.warnings [None req-229e3df8-e3f3-4ca2-8c69-6ff0d1ff49ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:15:05.518841 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: warnings.warn(msg) Aug 27 01:15:05.518841 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: Aug 27 01:15:05.519716 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e3df8-e3f3-4ca2-8c69-6ff0d1ff49ce admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:05.602738 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 528/1065] 10.222.0.25 () {60 vars in 1160 bytes} [Fri Aug 27 01:15:05 2021] POST /identity/v3/domains => generated 267 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:15:07.740047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c8074-615e-40f6-9944-a48188b07f6e None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:07.740545 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c8074-615e-40f6-9944-a48188b07f6e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:07.740545 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c8074-615e-40f6-9944-a48188b07f6e None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:07.742348 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 538/1066] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:15:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:15:07.749029 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982650d-c592-4de8-9cf9-9125b60f4fbd None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:07.749441 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982650d-c592-4de8-9cf9-9125b60f4fbd None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:07.749579 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982650d-c592-4de8-9cf9-9125b60f4fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:07.767246 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-c982650d-c592-4de8-9cf9-9125b60f4fbd None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:15:07.768412 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-c982650d-c592-4de8-9cf9-9125b60f4fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:15:07.821607 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 529/1067] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:15:07 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:15:07.846264 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c8074-615e-40f6-9944-a48188b07f6e None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:07.858201 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c8074-615e-40f6-9944-a48188b07f6e None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:07.862534 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7279d-6369-41eb-a4ae-70aef36bd2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:07.863364 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7279d-6369-41eb-a4ae-70aef36bd2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:07.863646 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7279d-6369-41eb-a4ae-70aef36bd2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:07.863923 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7279d-6369-41eb-a4ae-70aef36bd2b6 admin admin] PATH_INFO: `/v3/domains/d97a93525f964df3bad9103cc554a97d` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:07.874772 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7279d-6369-41eb-a4ae-70aef36bd2b6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=d97a93525f964df3bad9103cc554a97d)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:07.876757 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7279d-6369-41eb-a4ae-70aef36bd2b6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:07.878364 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 539/1068] 10.222.0.25 () {56 vars in 1205 bytes} [Fri Aug 27 01:15:07 2021] GET /identity/v3/domains/d97a93525f964df3bad9103cc554a97d => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:15:07.885137 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982650d-c592-4de8-9cf9-9125b60f4fbd None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:07.893661 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982650d-c592-4de8-9cf9-9125b60f4fbd None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:07.898063 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fc387-6dc4-4283-8e3d-9c5871cbdc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:07.898696 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fc387-6dc4-4283-8e3d-9c5871cbdc5d admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:07.898973 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fc387-6dc4-4283-8e3d-9c5871cbdc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:07.899242 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fc387-6dc4-4283-8e3d-9c5871cbdc5d admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:07.899937 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fc387-6dc4-4283-8e3d-9c5871cbdc5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:07.901841 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fc387-6dc4-4283-8e3d-9c5871cbdc5d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:07.985746 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 530/1069] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 01:15:07 2021] POST /identity/v3/projects => generated 361 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:15:10.133318 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be4cb1-91bf-4a08-8676-b8cbec7d5af6 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:10.133847 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be4cb1-91bf-4a08-8676-b8cbec7d5af6 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:10.133847 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be4cb1-91bf-4a08-8676-b8cbec7d5af6 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:10.135678 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 540/1070] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:15:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:15:10.141808 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413c4bb-e084-4543-b056-9446d40ef9a6 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:10.142511 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413c4bb-e084-4543-b056-9446d40ef9a6 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:10.142731 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413c4bb-e084-4543-b056-9446d40ef9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:10.161845 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-a413c4bb-e084-4543-b056-9446d40ef9a6 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:15:10.163043 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a413c4bb-e084-4543-b056-9446d40ef9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:15:10.218301 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 531/1071] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:15:10 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:15:10.243537 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be4cb1-91bf-4a08-8676-b8cbec7d5af6 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:10.255426 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be4cb1-91bf-4a08-8676-b8cbec7d5af6 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:10.260275 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34868a0-ce97-4f1e-986c-f0bd574b2515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:10.261136 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34868a0-ce97-4f1e-986c-f0bd574b2515 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:10.261415 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34868a0-ce97-4f1e-986c-f0bd574b2515 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:10.261693 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34868a0-ce97-4f1e-986c-f0bd574b2515 admin admin] PATH_INFO: `/v3/domains/d97a93525f964df3bad9103cc554a97d` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:10.262849 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34868a0-ce97-4f1e-986c-f0bd574b2515 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=d97a93525f964df3bad9103cc554a97d)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:10.264775 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34868a0-ce97-4f1e-986c-f0bd574b2515 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:10.266349 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 541/1072] 10.222.0.25 () {56 vars in 1205 bytes} [Fri Aug 27 01:15:10 2021] GET /identity/v3/domains/d97a93525f964df3bad9103cc554a97d => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:15:10.272292 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413c4bb-e084-4543-b056-9446d40ef9a6 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:10.281524 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413c4bb-e084-4543-b056-9446d40ef9a6 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:10.286000 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91cb06-a9e4-42a5-95ff-a12c359cdbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:10.286636 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91cb06-a9e4-42a5-95ff-a12c359cdbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:10.286913 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91cb06-a9e4-42a5-95ff-a12c359cdbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:10.287181 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91cb06-a9e4-42a5-95ff-a12c359cdbf3 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:10.287880 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91cb06-a9e4-42a5-95ff-a12c359cdbf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:10.289786 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91cb06-a9e4-42a5-95ff-a12c359cdbf3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:10.395741 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 532/1073] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 01:15:10 2021] POST /identity/v3/users => generated 311 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:15:12.570376 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272414f0-fc6a-454b-b00a-413edbefb1e0 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:12.570918 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272414f0-fc6a-454b-b00a-413edbefb1e0 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:12.570918 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272414f0-fc6a-454b-b00a-413edbefb1e0 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:12.573205 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 542/1074] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:15:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:15:12.579529 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb304311-ed32-44ce-8ac3-ec432b8d22b3 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:12.579922 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb304311-ed32-44ce-8ac3-ec432b8d22b3 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:12.580087 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb304311-ed32-44ce-8ac3-ec432b8d22b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:12.597915 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-bb304311-ed32-44ce-8ac3-ec432b8d22b3 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:15:12.599095 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-bb304311-ed32-44ce-8ac3-ec432b8d22b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:15:12.606778 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 533/1075] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:15:12 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:15:12.630934 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272414f0-fc6a-454b-b00a-413edbefb1e0 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:12.643390 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272414f0-fc6a-454b-b00a-413edbefb1e0 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:12.647764 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83997f09-2598-4682-b9dc-10fee90f7efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:12.648533 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83997f09-2598-4682-b9dc-10fee90f7efd admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:12.648816 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83997f09-2598-4682-b9dc-10fee90f7efd admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:12.649115 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83997f09-2598-4682-b9dc-10fee90f7efd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:12.668575 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83997f09-2598-4682-b9dc-10fee90f7efd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:15:12.675231 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-83997f09-2598-4682-b9dc-10fee90f7efd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:15:12.676362 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 543/1076] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:15:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:15:12.683055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb304311-ed32-44ce-8ac3-ec432b8d22b3 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:12.691751 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb304311-ed32-44ce-8ac3-ec432b8d22b3 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:12.696214 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b8870-faac-46da-be64-74355efd5a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:12.697719 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b8870-faac-46da-be64-74355efd5a22 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:12.698005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b8870-faac-46da-be64-74355efd5a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:12.698282 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b8870-faac-46da-be64-74355efd5a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:12.699022 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b8870-faac-46da-be64-74355efd5a22 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:15:12.699326 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b8870-faac-46da-be64-74355efd5a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:12.700929 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b8870-faac-46da-be64-74355efd5a22 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:12.709109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 534/1077] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:15:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:15:12.715201 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83997f09-2598-4682-b9dc-10fee90f7efd admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:12.724526 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83997f09-2598-4682-b9dc-10fee90f7efd admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:12.729712 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10797a9f-0a03-4cc8-bb2f-098626484490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:12.730541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10797a9f-0a03-4cc8-bb2f-098626484490 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:12.730825 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10797a9f-0a03-4cc8-bb2f-098626484490 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:12.731103 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10797a9f-0a03-4cc8-bb2f-098626484490 admin admin] PATH_INFO: `/v3/users/8bafb4448db34581ba42bfaebce2cec6` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:12.744156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10797a9f-0a03-4cc8-bb2f-098626484490 admin admin] RBAC: Authorizing `identity:get_user(user_id=8bafb4448db34581ba42bfaebce2cec6)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:12.746335 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10797a9f-0a03-4cc8-bb2f-098626484490 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:12.747912 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 544/1078] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:15:12 2021] GET /identity/v3/users/8bafb4448db34581ba42bfaebce2cec6 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:15:12.753902 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b8870-faac-46da-be64-74355efd5a22 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:12.763703 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b8870-faac-46da-be64-74355efd5a22 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:12.768181 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12768d0a-1e06-4213-bd64-ed1dffebd7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:12.768949 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12768d0a-1e06-4213-bd64-ed1dffebd7df admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:12.769233 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12768d0a-1e06-4213-bd64-ed1dffebd7df admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:12.769506 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12768d0a-1e06-4213-bd64-ed1dffebd7df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:12.777091 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12768d0a-1e06-4213-bd64-ed1dffebd7df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:12.778792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12768d0a-1e06-4213-bd64-ed1dffebd7df admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:12.787305 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 535/1079] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:15:12 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:15:12.793963 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10797a9f-0a03-4cc8-bb2f-098626484490 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:12.803195 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10797a9f-0a03-4cc8-bb2f-098626484490 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:12.807855 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88ae3d-ea33-4ae9-b9f4-6925b0f2dff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:12.808671 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88ae3d-ea33-4ae9-b9f4-6925b0f2dff6 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:12.808994 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88ae3d-ea33-4ae9-b9f4-6925b0f2dff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:12.809272 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88ae3d-ea33-4ae9-b9f4-6925b0f2dff6 admin admin] PATH_INFO: `/v3/projects/d00d6d9d61694b048193e6e899572083` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:12.810425 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88ae3d-ea33-4ae9-b9f4-6925b0f2dff6 admin admin] RBAC: Authorizing `identity:get_project(project_id=d00d6d9d61694b048193e6e899572083)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:12.812424 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88ae3d-ea33-4ae9-b9f4-6925b0f2dff6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:12.814065 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 545/1080] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:15:12 2021] GET /identity/v3/projects/d00d6d9d61694b048193e6e899572083 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:15:12.820096 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12768d0a-1e06-4213-bd64-ed1dffebd7df admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:12.829196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12768d0a-1e06-4213-bd64-ed1dffebd7df admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:12.833646 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f264f-5428-403a-a65a-e2104b9850c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:12.834254 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f264f-5428-403a-a65a-e2104b9850c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:12.834536 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f264f-5428-403a-a65a-e2104b9850c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:12.834811 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f264f-5428-403a-a65a-e2104b9850c3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:12.835607 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f264f-5428-403a-a65a-e2104b9850c3 admin admin] RBAC: Adding query filter params (role.id=faadc5010ffb447ba5280e491c2ea2f5, scope.project.id=d00d6d9d61694b048193e6e899572083, user.id=8bafb4448db34581ba42bfaebce2cec6) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:15:12.835914 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f264f-5428-403a-a65a-e2104b9850c3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:12.838424 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f264f-5428-403a-a65a-e2104b9850c3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:12.843449 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 536/1081] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:15:12 2021] GET /identity/v3/role_assignments?user.id=8bafb4448db34581ba42bfaebce2cec6&scope.project.id=d00d6d9d61694b048193e6e899572083&role.id=faadc5010ffb447ba5280e491c2ea2f5 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:15:14.928451 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1c7cc-9735-47bd-b699-624d8ebaa489 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:14.928990 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1c7cc-9735-47bd-b699-624d8ebaa489 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:14.929165 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1c7cc-9735-47bd-b699-624d8ebaa489 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:14.930952 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 546/1082] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:15:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:15:14.937659 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ab944-de03-4f7f-923f-de57dccca183 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:14.938093 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ab944-de03-4f7f-923f-de57dccca183 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:14.938214 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ab944-de03-4f7f-923f-de57dccca183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:14.955404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-9a5ab944-de03-4f7f-923f-de57dccca183 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:15:14.956564 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-9a5ab944-de03-4f7f-923f-de57dccca183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:15:14.964058 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 537/1083] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:15:14 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:15:14.987933 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1c7cc-9735-47bd-b699-624d8ebaa489 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:15.000600 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1c7cc-9735-47bd-b699-624d8ebaa489 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:15.005174 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b43d0b-0ebd-4484-9731-119738d07201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:15.005939 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b43d0b-0ebd-4484-9731-119738d07201 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:15.006219 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b43d0b-0ebd-4484-9731-119738d07201 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:15.006494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b43d0b-0ebd-4484-9731-119738d07201 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:15.016445 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b43d0b-0ebd-4484-9731-119738d07201 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:15:15.023067 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-e4b43d0b-0ebd-4484-9731-119738d07201 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:15:15.024185 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 547/1084] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:15:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:15:15.030508 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ab944-de03-4f7f-923f-de57dccca183 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:15.039186 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ab944-de03-4f7f-923f-de57dccca183 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:15.044279 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b2b4b-f3f2-4484-8edc-b4206f0eed66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:15.044942 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b2b4b-f3f2-4484-8edc-b4206f0eed66 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:15.045221 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b2b4b-f3f2-4484-8edc-b4206f0eed66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:15.045493 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b2b4b-f3f2-4484-8edc-b4206f0eed66 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:15.046216 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b2b4b-f3f2-4484-8edc-b4206f0eed66 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:15:15.046517 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b2b4b-f3f2-4484-8edc-b4206f0eed66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:15.048072 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b2b4b-f3f2-4484-8edc-b4206f0eed66 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:15.056514 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 538/1085] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:15:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:15:15.062782 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b43d0b-0ebd-4484-9731-119738d07201 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:15.073376 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b43d0b-0ebd-4484-9731-119738d07201 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:15.078052 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae45d9c-bb2a-4507-b3db-bb6161c620f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:15.078867 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae45d9c-bb2a-4507-b3db-bb6161c620f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:15.079144 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae45d9c-bb2a-4507-b3db-bb6161c620f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:15.079414 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae45d9c-bb2a-4507-b3db-bb6161c620f3 admin admin] PATH_INFO: `/v3/users/8bafb4448db34581ba42bfaebce2cec6` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:15.080568 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae45d9c-bb2a-4507-b3db-bb6161c620f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=8bafb4448db34581ba42bfaebce2cec6)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:15.082693 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae45d9c-bb2a-4507-b3db-bb6161c620f3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:15.084356 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 548/1086] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:15:15 2021] GET /identity/v3/users/8bafb4448db34581ba42bfaebce2cec6 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:15:15.090644 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b2b4b-f3f2-4484-8edc-b4206f0eed66 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:15.099755 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b2b4b-f3f2-4484-8edc-b4206f0eed66 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:15.104778 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9ba50-d948-4285-a050-5c4c3877cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:15.105623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9ba50-d948-4285-a050-5c4c3877cc9a admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:15.105899 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9ba50-d948-4285-a050-5c4c3877cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:15.106167 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9ba50-d948-4285-a050-5c4c3877cc9a admin admin] PATH_INFO: `/v3/projects/d00d6d9d61694b048193e6e899572083` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:15.107297 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9ba50-d948-4285-a050-5c4c3877cc9a admin admin] RBAC: Authorizing `identity:get_project(project_id=d00d6d9d61694b048193e6e899572083)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:15.109318 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9ba50-d948-4285-a050-5c4c3877cc9a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:15.110898 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 539/1087] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:15:15 2021] GET /identity/v3/projects/d00d6d9d61694b048193e6e899572083 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:15:15.117030 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae45d9c-bb2a-4507-b3db-bb6161c620f3 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:15.126285 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae45d9c-bb2a-4507-b3db-bb6161c620f3 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:15.130817 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe8c9f-ac6c-4a66-b2d1-07597a532e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:15.131657 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe8c9f-ac6c-4a66-b2d1-07597a532e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:15.131939 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe8c9f-ac6c-4a66-b2d1-07597a532e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:15.132215 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe8c9f-ac6c-4a66-b2d1-07597a532e19 admin admin] PATH_INFO: `/v3/projects/d00d6d9d61694b048193e6e899572083/users/8bafb4448db34581ba42bfaebce2cec6/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:15.134203 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe8c9f-ac6c-4a66-b2d1-07597a532e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00d6d9d61694b048193e6e899572083, user_id=8bafb4448db34581ba42bfaebce2cec6, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:15.136764 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe8c9f-ac6c-4a66-b2d1-07597a532e19 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:15.219220 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 549/1088] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:15:15 2021] PUT /identity/v3/projects/d00d6d9d61694b048193e6e899572083/users/8bafb4448db34581ba42bfaebce2cec6/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:15:17.324822 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfa756-236b-449f-bd67-b60bc540af5a None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:17.325490 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfa756-236b-449f-bd67-b60bc540af5a None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:17.325490 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfa756-236b-449f-bd67-b60bc540af5a None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:17.327434 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 540/1089] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:15:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:15:17.333203 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec210d47-a87b-4c28-9f72-1dfa1a3526dd None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:17.333631 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec210d47-a87b-4c28-9f72-1dfa1a3526dd None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:17.333752 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec210d47-a87b-4c28-9f72-1dfa1a3526dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:17.351788 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-ec210d47-a87b-4c28-9f72-1dfa1a3526dd None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:15:17.353649 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-ec210d47-a87b-4c28-9f72-1dfa1a3526dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:15:17.407791 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 550/1090] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:15:17 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:15:17.432900 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfa756-236b-449f-bd67-b60bc540af5a None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:17.444800 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfa756-236b-449f-bd67-b60bc540af5a None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:17.449886 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efefb4e-76f7-4826-a1f8-ac0a4a50c3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:17.450656 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efefb4e-76f7-4826-a1f8-ac0a4a50c3ff admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:17.450942 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efefb4e-76f7-4826-a1f8-ac0a4a50c3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:17.451218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efefb4e-76f7-4826-a1f8-ac0a4a50c3ff admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:17.461356 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efefb4e-76f7-4826-a1f8-ac0a4a50c3ff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:15:17.468424 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-1efefb4e-76f7-4826-a1f8-ac0a4a50c3ff admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:15:17.469584 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 541/1091] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:15:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:15:17.475928 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec210d47-a87b-4c28-9f72-1dfa1a3526dd None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:17.484610 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec210d47-a87b-4c28-9f72-1dfa1a3526dd None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:17.489036 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d551c-d636-4fc0-94cf-1ac947f2a4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:17.489689 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d551c-d636-4fc0-94cf-1ac947f2a4ac admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:17.489971 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d551c-d636-4fc0-94cf-1ac947f2a4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:17.490247 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d551c-d636-4fc0-94cf-1ac947f2a4ac admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:17.490984 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d551c-d636-4fc0-94cf-1ac947f2a4ac admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:15:17.491289 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d551c-d636-4fc0-94cf-1ac947f2a4ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:17.492883 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d551c-d636-4fc0-94cf-1ac947f2a4ac admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:17.501296 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 551/1092] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:15:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:15:17.507255 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efefb4e-76f7-4826-a1f8-ac0a4a50c3ff admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:17.517710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efefb4e-76f7-4826-a1f8-ac0a4a50c3ff admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:17.522240 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df47872-ca26-43bb-9bfe-8bdc3b986b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:17.523058 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df47872-ca26-43bb-9bfe-8bdc3b986b8d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:17.523334 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df47872-ca26-43bb-9bfe-8bdc3b986b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:17.523600 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df47872-ca26-43bb-9bfe-8bdc3b986b8d admin admin] PATH_INFO: `/v3/users/8bafb4448db34581ba42bfaebce2cec6` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:17.524775 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df47872-ca26-43bb-9bfe-8bdc3b986b8d admin admin] RBAC: Authorizing `identity:get_user(user_id=8bafb4448db34581ba42bfaebce2cec6)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:17.526861 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df47872-ca26-43bb-9bfe-8bdc3b986b8d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:17.528384 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 542/1093] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:15:17 2021] GET /identity/v3/users/8bafb4448db34581ba42bfaebce2cec6 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:15:17.534248 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d551c-d636-4fc0-94cf-1ac947f2a4ac admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:17.543593 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d551c-d636-4fc0-94cf-1ac947f2a4ac admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:17.548016 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76e554-768d-43ae-a772-7a239e9ee941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:17.548624 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76e554-768d-43ae-a772-7a239e9ee941 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:17.548945 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76e554-768d-43ae-a772-7a239e9ee941 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:17.549238 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76e554-768d-43ae-a772-7a239e9ee941 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:17.557543 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76e554-768d-43ae-a772-7a239e9ee941 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:17.559236 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76e554-768d-43ae-a772-7a239e9ee941 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:17.567745 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 552/1094] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:15:17 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:15:17.574260 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df47872-ca26-43bb-9bfe-8bdc3b986b8d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:17.583546 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df47872-ca26-43bb-9bfe-8bdc3b986b8d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:17.588292 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a39ad7-0b2e-40d2-85dd-176722aaa50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:17.589116 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a39ad7-0b2e-40d2-85dd-176722aaa50b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:17.589395 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a39ad7-0b2e-40d2-85dd-176722aaa50b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:17.589669 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a39ad7-0b2e-40d2-85dd-176722aaa50b admin admin] PATH_INFO: `/v3/projects/d00d6d9d61694b048193e6e899572083` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:17.590791 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a39ad7-0b2e-40d2-85dd-176722aaa50b admin admin] RBAC: Authorizing `identity:get_project(project_id=d00d6d9d61694b048193e6e899572083)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:17.592757 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a39ad7-0b2e-40d2-85dd-176722aaa50b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:17.594362 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 543/1095] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:15:17 2021] GET /identity/v3/projects/d00d6d9d61694b048193e6e899572083 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:15:17.600381 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76e554-768d-43ae-a772-7a239e9ee941 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:15:17.608927 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76e554-768d-43ae-a772-7a239e9ee941 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:15:17.613340 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e38854-ed53-49f9-b88b-f9958772dd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:15:17.613943 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e38854-ed53-49f9-b88b-f9958772dd5e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:15:17.614222 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e38854-ed53-49f9-b88b-f9958772dd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:15:17.614493 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e38854-ed53-49f9-b88b-f9958772dd5e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:15:17.615290 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e38854-ed53-49f9-b88b-f9958772dd5e admin admin] RBAC: Adding query filter params (role.id=faadc5010ffb447ba5280e491c2ea2f5, scope.project.id=d00d6d9d61694b048193e6e899572083, user.id=8bafb4448db34581ba42bfaebce2cec6) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:15:17.615602 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e38854-ed53-49f9-b88b-f9958772dd5e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:15:17.617390 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e38854-ed53-49f9-b88b-f9958772dd5e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:15:17.623537 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 553/1096] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:15:17 2021] GET /identity/v3/role_assignments?user.id=8bafb4448db34581ba42bfaebce2cec6&scope.project.id=d00d6d9d61694b048193e6e899572083&role.id=faadc5010ffb447ba5280e491c2ea2f5 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:29.506467 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89d0ce-ecd2-4f29-baed-05dc19e0d8cd None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:29.507036 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89d0ce-ecd2-4f29-baed-05dc19e0d8cd None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:29.507036 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89d0ce-ecd2-4f29-baed-05dc19e0d8cd None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:29.509148 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 544/1097] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:16:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:16:29.515151 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08dca4-2932-4c06-a12e-25c39c480f8f None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:29.516473 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08dca4-2932-4c06-a12e-25c39c480f8f None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:29.516473 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08dca4-2932-4c06-a12e-25c39c480f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:29.533346 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-9e08dca4-2932-4c06-a12e-25c39c480f8f None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:16:29.534550 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-9e08dca4-2932-4c06-a12e-25c39c480f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:16:29.543188 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 554/1098] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:16:29 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:16:29.568852 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89d0ce-ecd2-4f29-baed-05dc19e0d8cd None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:29.581541 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89d0ce-ecd2-4f29-baed-05dc19e0d8cd None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:29.586294 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe7c7c-4630-4e23-8253-46875270b7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:29.587066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe7c7c-4630-4e23-8253-46875270b7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:29.587345 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe7c7c-4630-4e23-8253-46875270b7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:29.587617 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe7c7c-4630-4e23-8253-46875270b7a1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:29.597633 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe7c7c-4630-4e23-8253-46875270b7a1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:29.599652 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe7c7c-4630-4e23-8253-46875270b7a1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:29.616535 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-8dfe7c7c-4630-4e23-8253-46875270b7a1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:16:29.618305 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 545/1099] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:16:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:29.624757 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08dca4-2932-4c06-a12e-25c39c480f8f None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:29.634390 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08dca4-2932-4c06-a12e-25c39c480f8f None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:29.638967 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c93ce4-d171-4208-a731-52301271f12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:29.639612 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c93ce4-d171-4208-a731-52301271f12e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:29.639894 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c93ce4-d171-4208-a731-52301271f12e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:29.640169 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c93ce4-d171-4208-a731-52301271f12e admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:29.640919 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c93ce4-d171-4208-a731-52301271f12e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:29.641228 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c93ce4-d171-4208-a731-52301271f12e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:29.642816 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c93ce4-d171-4208-a731-52301271f12e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:29.654752 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 555/1100] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:16:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:29.660771 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe7c7c-4630-4e23-8253-46875270b7a1 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:29.671365 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe7c7c-4630-4e23-8253-46875270b7a1 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:29.675873 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34773ed0-96ce-4e0c-96da-8cf850cb09ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:29.676519 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34773ed0-96ce-4e0c-96da-8cf850cb09ea admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:29.676804 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34773ed0-96ce-4e0c-96da-8cf850cb09ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:29.679323 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34773ed0-96ce-4e0c-96da-8cf850cb09ea admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:29.679323 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34773ed0-96ce-4e0c-96da-8cf850cb09ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:29.680047 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34773ed0-96ce-4e0c-96da-8cf850cb09ea admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:29.803663 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 546/1101] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Aug 27 01:16:29 2021] POST /identity/v3/users => generated 251 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:16:31.952216 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ed99f-bd59-49a5-bfbb-840ab138edb4 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:31.952767 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ed99f-bd59-49a5-bfbb-840ab138edb4 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:31.952767 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ed99f-bd59-49a5-bfbb-840ab138edb4 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:31.954593 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 556/1102] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:16:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:16:31.960314 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152537c-78ac-4162-af74-d149cc07e393 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:31.961031 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152537c-78ac-4162-af74-d149cc07e393 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:31.961309 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152537c-78ac-4162-af74-d149cc07e393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:31.982247 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-a152537c-78ac-4162-af74-d149cc07e393 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:16:31.984918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a152537c-78ac-4162-af74-d149cc07e393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:16:31.991521 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 547/1103] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:16:31 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:16:32.017741 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ed99f-bd59-49a5-bfbb-840ab138edb4 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:32.030242 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ed99f-bd59-49a5-bfbb-840ab138edb4 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:32.034537 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082f52f-0300-47f4-82ab-255a09436b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:32.035310 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082f52f-0300-47f4-82ab-255a09436b67 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:32.035591 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082f52f-0300-47f4-82ab-255a09436b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:32.035886 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082f52f-0300-47f4-82ab-255a09436b67 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:32.046304 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082f52f-0300-47f4-82ab-255a09436b67 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:16:32.053005 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-c082f52f-0300-47f4-82ab-255a09436b67 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:16:32.054671 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 557/1104] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:16:32 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:32.061705 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152537c-78ac-4162-af74-d149cc07e393 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:32.071515 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152537c-78ac-4162-af74-d149cc07e393 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:32.076452 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c73804-e3b8-47ff-bc64-102978e5a975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:32.077162 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73804-e3b8-47ff-bc64-102978e5a975 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:32.077443 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73804-e3b8-47ff-bc64-102978e5a975 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:32.077718 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73804-e3b8-47ff-bc64-102978e5a975 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:32.079037 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c73804-e3b8-47ff-bc64-102978e5a975 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:32.079037 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c73804-e3b8-47ff-bc64-102978e5a975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:32.080439 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c73804-e3b8-47ff-bc64-102978e5a975 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:32.088388 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 548/1105] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:16:32 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:32.094667 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082f52f-0300-47f4-82ab-255a09436b67 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:32.104024 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082f52f-0300-47f4-82ab-255a09436b67 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:32.108510 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85a232-3f6a-4278-8c88-171b1fb2ace9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:32.109299 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85a232-3f6a-4278-8c88-171b1fb2ace9 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:32.109578 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85a232-3f6a-4278-8c88-171b1fb2ace9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:32.109850 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85a232-3f6a-4278-8c88-171b1fb2ace9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:32.120819 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85a232-3f6a-4278-8c88-171b1fb2ace9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:32.122651 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85a232-3f6a-4278-8c88-171b1fb2ace9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:32.139602 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-2c85a232-3f6a-4278-8c88-171b1fb2ace9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:16:32.140748 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 558/1106] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:16:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:16:32.147194 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c73804-e3b8-47ff-bc64-102978e5a975 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:32.157030 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c73804-e3b8-47ff-bc64-102978e5a975 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:32.172767 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd593d6-bfd4-4e31-9cab-fa25c05aeacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:32.172767 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd593d6-bfd4-4e31-9cab-fa25c05aeacc admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:32.172767 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd593d6-bfd4-4e31-9cab-fa25c05aeacc admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:32.172767 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd593d6-bfd4-4e31-9cab-fa25c05aeacc admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:32.173151 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd593d6-bfd4-4e31-9cab-fa25c05aeacc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:32.173151 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd593d6-bfd4-4e31-9cab-fa25c05aeacc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:32.173151 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd593d6-bfd4-4e31-9cab-fa25c05aeacc admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:32.176717 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 549/1107] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:16:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:32.183291 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85a232-3f6a-4278-8c88-171b1fb2ace9 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:32.193017 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85a232-3f6a-4278-8c88-171b1fb2ace9 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:32.197673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da14a16-6a7e-4e03-9551-4e3e18909fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:32.198441 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da14a16-6a7e-4e03-9551-4e3e18909fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:32.198719 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da14a16-6a7e-4e03-9551-4e3e18909fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:32.198990 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da14a16-6a7e-4e03-9551-4e3e18909fa7 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:32.206476 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da14a16-6a7e-4e03-9551-4e3e18909fa7 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:32.208413 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da14a16-6a7e-4e03-9551-4e3e18909fa7 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:32.222318 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-4da14a16-6a7e-4e03-9551-4e3e18909fa7 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 01:16:32.223417 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 559/1108] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:16:32 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:16:32.230394 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd593d6-bfd4-4e31-9cab-fa25c05aeacc admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:32.239915 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd593d6-bfd4-4e31-9cab-fa25c05aeacc admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:32.244476 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f0632-9306-4d96-9a20-a066426bf8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:32.245156 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f0632-9306-4d96-9a20-a066426bf8fc admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:32.245437 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f0632-9306-4d96-9a20-a066426bf8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:32.245711 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f0632-9306-4d96-9a20-a066426bf8fc admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:32.246537 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f0632-9306-4d96-9a20-a066426bf8fc admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:32.246842 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f0632-9306-4d96-9a20-a066426bf8fc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:32.248643 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f0632-9306-4d96-9a20-a066426bf8fc admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:32.265646 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 550/1109] 10.222.0.25 () {56 vars in 1165 bytes} [Fri Aug 27 01:16:32 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:32.271772 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da14a16-6a7e-4e03-9551-4e3e18909fa7 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:32.281749 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da14a16-6a7e-4e03-9551-4e3e18909fa7 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:32.286214 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebc093-e8e9-4eca-b4ed-07f4ffb374f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:32.286835 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebc093-e8e9-4eca-b4ed-07f4ffb374f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:32.287114 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebc093-e8e9-4eca-b4ed-07f4ffb374f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:32.287384 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebc093-e8e9-4eca-b4ed-07f4ffb374f2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:32.295438 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebc093-e8e9-4eca-b4ed-07f4ffb374f2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:32.297196 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebc093-e8e9-4eca-b4ed-07f4ffb374f2 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:32.306072 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 560/1110] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:16:32 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:16:32.312235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f0632-9306-4d96-9a20-a066426bf8fc admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:32.322344 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f0632-9306-4d96-9a20-a066426bf8fc admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:32.327399 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84c85b-f197-4209-b217-c664123831d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:32.328176 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84c85b-f197-4209-b217-c664123831d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:32.328452 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84c85b-f197-4209-b217-c664123831d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:32.328717 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84c85b-f197-4209-b217-c664123831d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:32.339318 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84c85b-f197-4209-b217-c664123831d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:32.341188 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84c85b-f197-4209-b217-c664123831d4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:32.357235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-ef84c85b-f197-4209-b217-c664123831d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:16:32.358361 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 551/1111] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:16:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:16:32.364486 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebc093-e8e9-4eca-b4ed-07f4ffb374f2 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:32.373132 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebc093-e8e9-4eca-b4ed-07f4ffb374f2 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:32.377673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49685d0d-27a1-4855-ae7f-7f785de1fd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:32.378303 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49685d0d-27a1-4855-ae7f-7f785de1fd6d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:32.378579 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49685d0d-27a1-4855-ae7f-7f785de1fd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:32.378850 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49685d0d-27a1-4855-ae7f-7f785de1fd6d admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:32.379600 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49685d0d-27a1-4855-ae7f-7f785de1fd6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:32.379901 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49685d0d-27a1-4855-ae7f-7f785de1fd6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:32.381530 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49685d0d-27a1-4855-ae7f-7f785de1fd6d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:32.393275 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 561/1112] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:16:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:32.400246 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84c85b-f197-4209-b217-c664123831d4 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:32.409967 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84c85b-f197-4209-b217-c664123831d4 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:32.414607 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bffa8-3136-463c-bdc1-8da02a1de023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:32.415423 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bffa8-3136-463c-bdc1-8da02a1de023 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:32.415730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bffa8-3136-463c-bdc1-8da02a1de023 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:32.416004 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bffa8-3136-463c-bdc1-8da02a1de023 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:32.423069 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bffa8-3136-463c-bdc1-8da02a1de023 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:32.425097 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bffa8-3136-463c-bdc1-8da02a1de023 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:32.437643 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-cb6bffa8-3136-463c-bdc1-8da02a1de023 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:16:32.438842 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 552/1113] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:16:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:16:32.446325 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49685d0d-27a1-4855-ae7f-7f785de1fd6d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:32.456115 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49685d0d-27a1-4855-ae7f-7f785de1fd6d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:32.461822 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deaae47-1f17-4e4d-9b51-e8211a7a09fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:32.462411 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaae47-1f17-4e4d-9b51-e8211a7a09fc admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:32.462694 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaae47-1f17-4e4d-9b51-e8211a7a09fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:32.462973 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaae47-1f17-4e4d-9b51-e8211a7a09fc admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:32.463752 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deaae47-1f17-4e4d-9b51-e8211a7a09fc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:32.464067 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deaae47-1f17-4e4d-9b51-e8211a7a09fc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:32.465927 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deaae47-1f17-4e4d-9b51-e8211a7a09fc admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:32.478197 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 562/1114] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:16:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:32.485033 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bffa8-3136-463c-bdc1-8da02a1de023 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:32.495382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bffa8-3136-463c-bdc1-8da02a1de023 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:32.499939 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f971786-8376-48da-b990-f7f6a052d9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:32.500543 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f971786-8376-48da-b990-f7f6a052d9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:32.500823 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f971786-8376-48da-b990-f7f6a052d9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:32.501128 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f971786-8376-48da-b990-f7f6a052d9e3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:32.501943 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f971786-8376-48da-b990-f7f6a052d9e3 admin admin] RBAC: Adding query filter params (role.id=c72f13c7e83e471b8cc350d318503763, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=d67c0b68ca7349399d9ea9f4a0b2b564) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:32.502252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f971786-8376-48da-b990-f7f6a052d9e3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:32.504055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f971786-8376-48da-b990-f7f6a052d9e3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:32.510179 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 553/1115] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:16:32 2021] GET /identity/v3/role_assignments?user.id=d67c0b68ca7349399d9ea9f4a0b2b564&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=c72f13c7e83e471b8cc350d318503763 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:34.618200 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3fe37-07d5-4bff-9bfd-66a19f22dadc None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:34.618722 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3fe37-07d5-4bff-9bfd-66a19f22dadc None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:34.618722 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3fe37-07d5-4bff-9bfd-66a19f22dadc None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:34.620501 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 563/1116] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:16:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:16:34.626291 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788de956-9c5d-496a-9851-e4459f258125 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:34.626740 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788de956-9c5d-496a-9851-e4459f258125 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:34.626932 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788de956-9c5d-496a-9851-e4459f258125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:34.644791 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-788de956-9c5d-496a-9851-e4459f258125 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:16:34.645993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-788de956-9c5d-496a-9851-e4459f258125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:16:34.654601 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 554/1117] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:16:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:16:34.683216 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3fe37-07d5-4bff-9bfd-66a19f22dadc None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:34.696589 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3fe37-07d5-4bff-9bfd-66a19f22dadc None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:34.701359 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d3e7f-5822-4a2b-ae88-457f62b8f1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:34.703509 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d3e7f-5822-4a2b-ae88-457f62b8f1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:34.703509 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d3e7f-5822-4a2b-ae88-457f62b8f1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:34.703509 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d3e7f-5822-4a2b-ae88-457f62b8f1e1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:34.713877 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d3e7f-5822-4a2b-ae88-457f62b8f1e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:16:34.720672 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-d40d3e7f-5822-4a2b-ae88-457f62b8f1e1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:16:34.721840 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 564/1118] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:16:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:34.728474 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788de956-9c5d-496a-9851-e4459f258125 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:34.737500 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788de956-9c5d-496a-9851-e4459f258125 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:34.742001 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285196a8-7ea1-4bc6-aeaf-48210ddfb141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:34.743699 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285196a8-7ea1-4bc6-aeaf-48210ddfb141 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:34.743699 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285196a8-7ea1-4bc6-aeaf-48210ddfb141 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:34.743699 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285196a8-7ea1-4bc6-aeaf-48210ddfb141 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:34.743990 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285196a8-7ea1-4bc6-aeaf-48210ddfb141 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:34.744295 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285196a8-7ea1-4bc6-aeaf-48210ddfb141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:34.745896 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285196a8-7ea1-4bc6-aeaf-48210ddfb141 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:34.753982 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 555/1119] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:16:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:34.760840 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d3e7f-5822-4a2b-ae88-457f62b8f1e1 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:34.771023 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d3e7f-5822-4a2b-ae88-457f62b8f1e1 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:34.776285 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a89fc-ac5f-4d20-8ea9-939043025c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:34.777085 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a89fc-ac5f-4d20-8ea9-939043025c5a admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:34.777367 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a89fc-ac5f-4d20-8ea9-939043025c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:34.777643 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a89fc-ac5f-4d20-8ea9-939043025c5a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:34.787736 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a89fc-ac5f-4d20-8ea9-939043025c5a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:34.789826 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a89fc-ac5f-4d20-8ea9-939043025c5a admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:34.806214 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-810a89fc-ac5f-4d20-8ea9-939043025c5a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:16:34.807357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 565/1120] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:16:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:34.813640 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285196a8-7ea1-4bc6-aeaf-48210ddfb141 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:34.823821 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285196a8-7ea1-4bc6-aeaf-48210ddfb141 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:34.828744 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fcf6b-69e5-4dfb-9065-f413921fa978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:34.829407 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fcf6b-69e5-4dfb-9065-f413921fa978 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:34.829693 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fcf6b-69e5-4dfb-9065-f413921fa978 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:34.829963 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fcf6b-69e5-4dfb-9065-f413921fa978 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:34.830663 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fcf6b-69e5-4dfb-9065-f413921fa978 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:34.830963 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fcf6b-69e5-4dfb-9065-f413921fa978 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:34.832579 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fcf6b-69e5-4dfb-9065-f413921fa978 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:34.844476 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 556/1121] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:16:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:34.850753 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a89fc-ac5f-4d20-8ea9-939043025c5a admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:34.860277 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a89fc-ac5f-4d20-8ea9-939043025c5a admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:34.864914 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b44bd-79e0-4fd7-b006-c68ba17e37cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:34.865682 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b44bd-79e0-4fd7-b006-c68ba17e37cc admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:34.865967 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b44bd-79e0-4fd7-b006-c68ba17e37cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:34.866316 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b44bd-79e0-4fd7-b006-c68ba17e37cc admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:34.873676 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b44bd-79e0-4fd7-b006-c68ba17e37cc admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:34.875675 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b44bd-79e0-4fd7-b006-c68ba17e37cc admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:34.890052 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-905b44bd-79e0-4fd7-b006-c68ba17e37cc admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 01:16:34.891151 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 566/1122] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:16:34 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:34.897230 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fcf6b-69e5-4dfb-9065-f413921fa978 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:34.906894 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fcf6b-69e5-4dfb-9065-f413921fa978 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:34.911599 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ec13b-d0bd-4e1a-94c3-e7eaf402861e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:34.912257 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ec13b-d0bd-4e1a-94c3-e7eaf402861e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:34.912517 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ec13b-d0bd-4e1a-94c3-e7eaf402861e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:34.912787 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ec13b-d0bd-4e1a-94c3-e7eaf402861e admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:34.913840 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ec13b-d0bd-4e1a-94c3-e7eaf402861e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:34.914145 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ec13b-d0bd-4e1a-94c3-e7eaf402861e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:34.918249 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ec13b-d0bd-4e1a-94c3-e7eaf402861e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:34.934587 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 557/1123] 10.222.0.25 () {56 vars in 1165 bytes} [Fri Aug 27 01:16:34 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:34.940547 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b44bd-79e0-4fd7-b006-c68ba17e37cc admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:34.951251 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b44bd-79e0-4fd7-b006-c68ba17e37cc admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:34.955889 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5abfd-8fc8-4d3c-8720-e74f0ba78dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:34.956662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5abfd-8fc8-4d3c-8720-e74f0ba78dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:34.956976 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5abfd-8fc8-4d3c-8720-e74f0ba78dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:34.957256 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5abfd-8fc8-4d3c-8720-e74f0ba78dc6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:34.967450 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5abfd-8fc8-4d3c-8720-e74f0ba78dc6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:34.969319 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5abfd-8fc8-4d3c-8720-e74f0ba78dc6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:34.985572 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-66b5abfd-8fc8-4d3c-8720-e74f0ba78dc6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:16:34.986704 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 567/1124] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:16:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:34.993898 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ec13b-d0bd-4e1a-94c3-e7eaf402861e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:35.003487 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ec13b-d0bd-4e1a-94c3-e7eaf402861e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:35.009146 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3656b-086e-463e-bf10-38d4bcb1555f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:35.009806 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3656b-086e-463e-bf10-38d4bcb1555f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:35.010086 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3656b-086e-463e-bf10-38d4bcb1555f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:35.010354 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3656b-086e-463e-bf10-38d4bcb1555f admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:35.011064 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3656b-086e-463e-bf10-38d4bcb1555f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:35.011366 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3656b-086e-463e-bf10-38d4bcb1555f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:35.012971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3656b-086e-463e-bf10-38d4bcb1555f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:35.024496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 558/1125] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:16:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:35.030620 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5abfd-8fc8-4d3c-8720-e74f0ba78dc6 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:35.040137 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5abfd-8fc8-4d3c-8720-e74f0ba78dc6 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:35.044735 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a298d89-41af-4ca2-b42b-18b0f06d77e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:35.045531 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a298d89-41af-4ca2-b42b-18b0f06d77e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:35.045810 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a298d89-41af-4ca2-b42b-18b0f06d77e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:35.046080 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a298d89-41af-4ca2-b42b-18b0f06d77e6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:35.053013 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a298d89-41af-4ca2-b42b-18b0f06d77e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:35.055516 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a298d89-41af-4ca2-b42b-18b0f06d77e6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:35.068279 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-8a298d89-41af-4ca2-b42b-18b0f06d77e6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:16:35.069430 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 568/1126] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:16:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:35.076450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3656b-086e-463e-bf10-38d4bcb1555f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:35.086372 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3656b-086e-463e-bf10-38d4bcb1555f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:35.090964 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4907f-f3ae-4d9b-93cc-9705f2ab05cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:35.091601 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4907f-f3ae-4d9b-93cc-9705f2ab05cb admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:35.091881 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4907f-f3ae-4d9b-93cc-9705f2ab05cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:35.092153 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4907f-f3ae-4d9b-93cc-9705f2ab05cb admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:35.092992 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4907f-f3ae-4d9b-93cc-9705f2ab05cb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:35.093301 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4907f-f3ae-4d9b-93cc-9705f2ab05cb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:35.095112 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4907f-f3ae-4d9b-93cc-9705f2ab05cb admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:35.107670 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 559/1127] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:16:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:16:35.114002 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a298d89-41af-4ca2-b42b-18b0f06d77e6 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:35.125867 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a298d89-41af-4ca2-b42b-18b0f06d77e6 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:35.130508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600573d-d93f-4b44-985a-d311e678fd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:35.131352 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600573d-d93f-4b44-985a-d311e678fd6d admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:35.131627 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600573d-d93f-4b44-985a-d311e678fd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:35.131898 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600573d-d93f-4b44-985a-d311e678fd6d admin admin] PATH_INFO: `/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/d67c0b68ca7349399d9ea9f4a0b2b564/roles/c72f13c7e83e471b8cc350d318503763` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:35.146325 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600573d-d93f-4b44-985a-d311e678fd6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0094d4fd0a114a2cbf5919f2a0e88e82, user_id=d67c0b68ca7349399d9ea9f4a0b2b564, role_id=c72f13c7e83e471b8cc350d318503763)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:35.149195 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600573d-d93f-4b44-985a-d311e678fd6d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:35.291001 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 569/1128] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:16:35 2021] PUT /identity/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/d67c0b68ca7349399d9ea9f4a0b2b564/roles/c72f13c7e83e471b8cc350d318503763 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:16:37.443663 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599893a2-b8e2-4a8f-9d17-2a4b2d719edc None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:37.444097 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599893a2-b8e2-4a8f-9d17-2a4b2d719edc None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:37.444198 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599893a2-b8e2-4a8f-9d17-2a4b2d719edc None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:37.446546 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 560/1129] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:16:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:16:37.452586 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b481-5ea5-4ed6-888b-1c50664b02bd None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:37.453037 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b481-5ea5-4ed6-888b-1c50664b02bd None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:37.454972 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b481-5ea5-4ed6-888b-1c50664b02bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:37.471452 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-fac4b481-5ea5-4ed6-888b-1c50664b02bd None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:16:37.472774 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-fac4b481-5ea5-4ed6-888b-1c50664b02bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:16:37.529663 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 570/1130] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:16:37 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:16:37.556818 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599893a2-b8e2-4a8f-9d17-2a4b2d719edc None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:37.569086 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599893a2-b8e2-4a8f-9d17-2a4b2d719edc None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:37.573919 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3593a-5e47-465d-9981-8e48f1f69c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:37.574961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3593a-5e47-465d-9981-8e48f1f69c9e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:37.575231 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3593a-5e47-465d-9981-8e48f1f69c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:37.575497 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3593a-5e47-465d-9981-8e48f1f69c9e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:37.585972 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3593a-5e47-465d-9981-8e48f1f69c9e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:16:37.592631 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-15b3593a-5e47-465d-9981-8e48f1f69c9e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 01:16:37.593793 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 561/1131] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Aug 27 01:16:37 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:37.600251 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4b481-5ea5-4ed6-888b-1c50664b02bd None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:37.609239 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4b481-5ea5-4ed6-888b-1c50664b02bd None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:37.613689 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f0852-5819-4713-b7e0-2ed0e0e99125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:37.614336 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f0852-5819-4713-b7e0-2ed0e0e99125 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:37.614613 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f0852-5819-4713-b7e0-2ed0e0e99125 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:37.614922 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f0852-5819-4713-b7e0-2ed0e0e99125 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:37.615650 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f0852-5819-4713-b7e0-2ed0e0e99125 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:37.615949 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f0852-5819-4713-b7e0-2ed0e0e99125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:37.617803 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f0852-5819-4713-b7e0-2ed0e0e99125 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:37.625645 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 571/1132] 10.222.0.25 () {56 vars in 1125 bytes} [Fri Aug 27 01:16:37 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:37.631871 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3593a-5e47-465d-9981-8e48f1f69c9e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:37.642407 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3593a-5e47-465d-9981-8e48f1f69c9e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:37.646894 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afe1ff-9de2-4128-b84a-2426260436b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:37.648207 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afe1ff-9de2-4128-b84a-2426260436b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:37.648482 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afe1ff-9de2-4128-b84a-2426260436b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:37.648749 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afe1ff-9de2-4128-b84a-2426260436b7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:37.658532 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afe1ff-9de2-4128-b84a-2426260436b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:37.660341 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afe1ff-9de2-4128-b84a-2426260436b7 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:37.676759 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-a0afe1ff-9de2-4128-b84a-2426260436b7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:16:37.677928 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 562/1133] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:16:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:37.684379 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f0852-5819-4713-b7e0-2ed0e0e99125 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:37.693927 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f0852-5819-4713-b7e0-2ed0e0e99125 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:37.698990 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7471cf-521e-4efe-8cc7-a06f045fbe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:37.699867 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7471cf-521e-4efe-8cc7-a06f045fbe8b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:37.700147 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7471cf-521e-4efe-8cc7-a06f045fbe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:37.700449 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7471cf-521e-4efe-8cc7-a06f045fbe8b admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:37.701257 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7471cf-521e-4efe-8cc7-a06f045fbe8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:37.701557 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7471cf-521e-4efe-8cc7-a06f045fbe8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:37.703145 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7471cf-521e-4efe-8cc7-a06f045fbe8b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:37.715360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 572/1134] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:16:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:37.721372 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afe1ff-9de2-4128-b84a-2426260436b7 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:37.731622 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afe1ff-9de2-4128-b84a-2426260436b7 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:37.736161 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b697221-ecc4-4993-b2fb-7eab4449c102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:37.736969 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b697221-ecc4-4993-b2fb-7eab4449c102 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:37.737247 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b697221-ecc4-4993-b2fb-7eab4449c102 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:37.737521 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b697221-ecc4-4993-b2fb-7eab4449c102 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:37.744862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b697221-ecc4-4993-b2fb-7eab4449c102 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:37.746854 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b697221-ecc4-4993-b2fb-7eab4449c102 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:37.760932 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-7b697221-ecc4-4993-b2fb-7eab4449c102 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 01:16:37.762041 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 563/1135] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:16:37 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:16:37.768300 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7471cf-521e-4efe-8cc7-a06f045fbe8b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:37.778776 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7471cf-521e-4efe-8cc7-a06f045fbe8b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:37.783427 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f1c53-4ae5-4bce-a9ef-862bd3fd271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:37.784069 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f1c53-4ae5-4bce-a9ef-862bd3fd271f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:37.784344 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f1c53-4ae5-4bce-a9ef-862bd3fd271f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:37.784613 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f1c53-4ae5-4bce-a9ef-862bd3fd271f admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:37.785464 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f1c53-4ae5-4bce-a9ef-862bd3fd271f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:37.785771 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f1c53-4ae5-4bce-a9ef-862bd3fd271f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:37.787662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f1c53-4ae5-4bce-a9ef-862bd3fd271f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:37.804955 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 573/1136] 10.222.0.25 () {56 vars in 1165 bytes} [Fri Aug 27 01:16:37 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:37.811205 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b697221-ecc4-4993-b2fb-7eab4449c102 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:37.821391 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b697221-ecc4-4993-b2fb-7eab4449c102 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:37.826190 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f58eb-cdfa-4cbc-8a81-a14972aaf7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:37.826814 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f58eb-cdfa-4cbc-8a81-a14972aaf7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:37.827094 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f58eb-cdfa-4cbc-8a81-a14972aaf7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:37.827369 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f58eb-cdfa-4cbc-8a81-a14972aaf7d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:37.834939 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f58eb-cdfa-4cbc-8a81-a14972aaf7d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:37.837574 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f58eb-cdfa-4cbc-8a81-a14972aaf7d4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:37.846462 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 564/1137] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:16:37 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:16:37.852993 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f1c53-4ae5-4bce-a9ef-862bd3fd271f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:37.862664 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f1c53-4ae5-4bce-a9ef-862bd3fd271f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:37.867182 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ee5f3-2411-488d-b615-833a74eaa223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:37.867944 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ee5f3-2411-488d-b615-833a74eaa223 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:37.868219 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ee5f3-2411-488d-b615-833a74eaa223 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:37.868507 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ee5f3-2411-488d-b615-833a74eaa223 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:37.878444 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ee5f3-2411-488d-b615-833a74eaa223 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:37.880245 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ee5f3-2411-488d-b615-833a74eaa223 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:37.896802 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-031ee5f3-2411-488d-b615-833a74eaa223 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:16:37.898602 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 574/1138] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:16:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:37.904780 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f58eb-cdfa-4cbc-8a81-a14972aaf7d4 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:37.913655 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f58eb-cdfa-4cbc-8a81-a14972aaf7d4 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:37.918410 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55264d6-40d8-48ec-9bb5-48d238ad7a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:37.919055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55264d6-40d8-48ec-9bb5-48d238ad7a26 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:37.919335 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55264d6-40d8-48ec-9bb5-48d238ad7a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:37.919607 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55264d6-40d8-48ec-9bb5-48d238ad7a26 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:37.920306 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55264d6-40d8-48ec-9bb5-48d238ad7a26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:37.920626 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55264d6-40d8-48ec-9bb5-48d238ad7a26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:37.922270 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55264d6-40d8-48ec-9bb5-48d238ad7a26 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:37.933820 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 565/1139] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:16:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:37.939671 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ee5f3-2411-488d-b615-833a74eaa223 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:37.950419 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ee5f3-2411-488d-b615-833a74eaa223 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:37.955035 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06229d-3c3d-4c7e-baa5-8f327a737687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:37.955804 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06229d-3c3d-4c7e-baa5-8f327a737687 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:37.956079 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06229d-3c3d-4c7e-baa5-8f327a737687 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:37.956348 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06229d-3c3d-4c7e-baa5-8f327a737687 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:37.963102 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06229d-3c3d-4c7e-baa5-8f327a737687 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:37.965167 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06229d-3c3d-4c7e-baa5-8f327a737687 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:37.978380 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-1d06229d-3c3d-4c7e-baa5-8f327a737687 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:16:37.979518 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 575/1140] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:16:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:37.985642 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55264d6-40d8-48ec-9bb5-48d238ad7a26 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:37.997567 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55264d6-40d8-48ec-9bb5-48d238ad7a26 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:38.002301 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe30273-c4e2-4e53-9db8-6fcb018b92d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:38.003058 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe30273-c4e2-4e53-9db8-6fcb018b92d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:38.003335 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe30273-c4e2-4e53-9db8-6fcb018b92d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:38.003610 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe30273-c4e2-4e53-9db8-6fcb018b92d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:38.005077 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe30273-c4e2-4e53-9db8-6fcb018b92d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:38.005392 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe30273-c4e2-4e53-9db8-6fcb018b92d6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:38.007951 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe30273-c4e2-4e53-9db8-6fcb018b92d6 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:38.019951 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 566/1141] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:16:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:38.026956 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06229d-3c3d-4c7e-baa5-8f327a737687 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:38.037217 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06229d-3c3d-4c7e-baa5-8f327a737687 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:38.041977 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f34f5-1363-4ea9-9627-4c3b3f50927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:38.042600 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f34f5-1363-4ea9-9627-4c3b3f50927c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:38.042923 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f34f5-1363-4ea9-9627-4c3b3f50927c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:38.043196 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f34f5-1363-4ea9-9627-4c3b3f50927c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:38.044010 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f34f5-1363-4ea9-9627-4c3b3f50927c admin admin] RBAC: Adding query filter params (role.id=c72f13c7e83e471b8cc350d318503763, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=d67c0b68ca7349399d9ea9f4a0b2b564) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:38.044315 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f34f5-1363-4ea9-9627-4c3b3f50927c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:38.046197 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f34f5-1363-4ea9-9627-4c3b3f50927c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:38.051823 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 576/1142] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:16:38 2021] GET /identity/v3/role_assignments?user.id=d67c0b68ca7349399d9ea9f4a0b2b564&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=c72f13c7e83e471b8cc350d318503763 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:40.221256 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2afcc4-49ed-4ca2-bb48-e20be248fc13 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:40.221792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2afcc4-49ed-4ca2-bb48-e20be248fc13 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:40.221792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2afcc4-49ed-4ca2-bb48-e20be248fc13 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:40.223608 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 567/1143] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:16:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:16:40.230236 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d5a47-be61-4fa4-9ec2-5223836ebee4 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:40.230657 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d5a47-be61-4fa4-9ec2-5223836ebee4 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:40.230800 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d5a47-be61-4fa4-9ec2-5223836ebee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:40.248466 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-816d5a47-be61-4fa4-9ec2-5223836ebee4 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:16:40.249693 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-816d5a47-be61-4fa4-9ec2-5223836ebee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:16:40.257642 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 577/1144] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:16:40 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:16:40.282712 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2afcc4-49ed-4ca2-bb48-e20be248fc13 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:40.295496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2afcc4-49ed-4ca2-bb48-e20be248fc13 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:40.299908 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1aeac-b2d1-4611-87ab-20a80ed31652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:40.300672 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1aeac-b2d1-4611-87ab-20a80ed31652 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:40.300988 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1aeac-b2d1-4611-87ab-20a80ed31652 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:40.304505 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1aeac-b2d1-4611-87ab-20a80ed31652 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:40.311585 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1aeac-b2d1-4611-87ab-20a80ed31652 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:16:40.318369 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-99a1aeac-b2d1-4611-87ab-20a80ed31652 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:16:40.319594 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 568/1145] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:16:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:40.326257 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d5a47-be61-4fa4-9ec2-5223836ebee4 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:40.335661 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d5a47-be61-4fa4-9ec2-5223836ebee4 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:40.340319 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977fba0-8040-4cc9-a4c0-05ddd69f8900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:40.341006 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977fba0-8040-4cc9-a4c0-05ddd69f8900 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:40.341292 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977fba0-8040-4cc9-a4c0-05ddd69f8900 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:40.341566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977fba0-8040-4cc9-a4c0-05ddd69f8900 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:40.342300 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977fba0-8040-4cc9-a4c0-05ddd69f8900 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:40.342605 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977fba0-8040-4cc9-a4c0-05ddd69f8900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:40.344177 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977fba0-8040-4cc9-a4c0-05ddd69f8900 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:40.352950 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 578/1146] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:16:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:40.358932 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1aeac-b2d1-4611-87ab-20a80ed31652 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:40.369181 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1aeac-b2d1-4611-87ab-20a80ed31652 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:40.373656 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b378a-8eec-4340-8c5e-c64b7affadf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:40.374416 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b378a-8eec-4340-8c5e-c64b7affadf4 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:40.374696 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b378a-8eec-4340-8c5e-c64b7affadf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:40.374973 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b378a-8eec-4340-8c5e-c64b7affadf4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:40.385226 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b378a-8eec-4340-8c5e-c64b7affadf4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:40.387166 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b378a-8eec-4340-8c5e-c64b7affadf4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:40.405123 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-679b378a-8eec-4340-8c5e-c64b7affadf4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:16:40.406310 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 569/1147] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:16:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:40.412688 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977fba0-8040-4cc9-a4c0-05ddd69f8900 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:40.423617 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977fba0-8040-4cc9-a4c0-05ddd69f8900 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:40.428253 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd738b-a5e9-485c-aafa-beb1b86fa701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:40.429460 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd738b-a5e9-485c-aafa-beb1b86fa701 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:40.429754 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd738b-a5e9-485c-aafa-beb1b86fa701 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:40.430042 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd738b-a5e9-485c-aafa-beb1b86fa701 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:40.430794 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd738b-a5e9-485c-aafa-beb1b86fa701 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:40.431104 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd738b-a5e9-485c-aafa-beb1b86fa701 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:40.432691 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd738b-a5e9-485c-aafa-beb1b86fa701 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:40.444183 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 579/1148] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:16:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:16:40.450937 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b378a-8eec-4340-8c5e-c64b7affadf4 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:40.461361 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b378a-8eec-4340-8c5e-c64b7affadf4 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:40.466007 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3f7b8-ffb9-4d99-8452-efdb21396f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:40.466809 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3f7b8-ffb9-4d99-8452-efdb21396f4a admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:40.467088 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3f7b8-ffb9-4d99-8452-efdb21396f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:40.471453 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3f7b8-ffb9-4d99-8452-efdb21396f4a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:40.474563 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3f7b8-ffb9-4d99-8452-efdb21396f4a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:40.477259 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3f7b8-ffb9-4d99-8452-efdb21396f4a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:40.491109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-09b3f7b8-ffb9-4d99-8452-efdb21396f4a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 01:16:40.494427 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 570/1149] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:16:40 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:40.498728 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd738b-a5e9-485c-aafa-beb1b86fa701 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:40.508926 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd738b-a5e9-485c-aafa-beb1b86fa701 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:40.513508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe11c25-22c1-4e4b-a48c-e8bd98bf2c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:40.514162 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe11c25-22c1-4e4b-a48c-e8bd98bf2c65 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:40.514447 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe11c25-22c1-4e4b-a48c-e8bd98bf2c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:40.517474 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe11c25-22c1-4e4b-a48c-e8bd98bf2c65 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:40.517474 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe11c25-22c1-4e4b-a48c-e8bd98bf2c65 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:40.517474 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe11c25-22c1-4e4b-a48c-e8bd98bf2c65 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:40.517760 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe11c25-22c1-4e4b-a48c-e8bd98bf2c65 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:40.535268 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 580/1150] 10.222.0.25 () {56 vars in 1165 bytes} [Fri Aug 27 01:16:40 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:40.542800 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3f7b8-ffb9-4d99-8452-efdb21396f4a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:40.552568 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3f7b8-ffb9-4d99-8452-efdb21396f4a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:40.557869 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe2929-22c1-41d5-814f-a97166655000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:40.558504 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe2929-22c1-41d5-814f-a97166655000 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:40.558786 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe2929-22c1-41d5-814f-a97166655000 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:40.559061 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe2929-22c1-41d5-814f-a97166655000 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:40.566623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe2929-22c1-41d5-814f-a97166655000 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:40.568394 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe2929-22c1-41d5-814f-a97166655000 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:40.578505 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 571/1151] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:16:40 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:16:40.584753 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe11c25-22c1-4e4b-a48c-e8bd98bf2c65 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:40.595152 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe11c25-22c1-4e4b-a48c-e8bd98bf2c65 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:40.599802 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614b923-42c5-46f9-8d5e-4ab50660eaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:40.603538 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614b923-42c5-46f9-8d5e-4ab50660eaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:40.603538 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614b923-42c5-46f9-8d5e-4ab50660eaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:40.603538 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614b923-42c5-46f9-8d5e-4ab50660eaf3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:40.611382 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614b923-42c5-46f9-8d5e-4ab50660eaf3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:40.613243 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614b923-42c5-46f9-8d5e-4ab50660eaf3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:40.630145 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-d614b923-42c5-46f9-8d5e-4ab50660eaf3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:16:40.631295 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 581/1152] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:16:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:40.637931 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe2929-22c1-41d5-814f-a97166655000 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:40.646793 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe2929-22c1-41d5-814f-a97166655000 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:40.652358 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca1bc2-26aa-485b-ae4f-11556184039f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:40.653026 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca1bc2-26aa-485b-ae4f-11556184039f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:40.653305 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca1bc2-26aa-485b-ae4f-11556184039f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:40.653576 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca1bc2-26aa-485b-ae4f-11556184039f admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:40.654280 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca1bc2-26aa-485b-ae4f-11556184039f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:40.654583 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca1bc2-26aa-485b-ae4f-11556184039f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:40.656182 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca1bc2-26aa-485b-ae4f-11556184039f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:40.667413 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 572/1153] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:16:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:40.673291 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614b923-42c5-46f9-8d5e-4ab50660eaf3 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:40.682850 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614b923-42c5-46f9-8d5e-4ab50660eaf3 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:40.687386 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a419fb-a8de-4843-bf15-3e02e7da109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:40.688148 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a419fb-a8de-4843-bf15-3e02e7da109b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:40.688426 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a419fb-a8de-4843-bf15-3e02e7da109b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:40.688697 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a419fb-a8de-4843-bf15-3e02e7da109b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:40.696357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a419fb-a8de-4843-bf15-3e02e7da109b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:40.698413 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a419fb-a8de-4843-bf15-3e02e7da109b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:40.712179 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-c1a419fb-a8de-4843-bf15-3e02e7da109b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:16:40.713348 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 582/1154] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:16:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:40.719699 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca1bc2-26aa-485b-ae4f-11556184039f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:40.729364 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca1bc2-26aa-485b-ae4f-11556184039f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:40.733903 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ac7fa-cbc0-4a42-9da6-63018b896620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:40.734579 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ac7fa-cbc0-4a42-9da6-63018b896620 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:40.734863 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ac7fa-cbc0-4a42-9da6-63018b896620 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:40.735142 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ac7fa-cbc0-4a42-9da6-63018b896620 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:40.741205 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ac7fa-cbc0-4a42-9da6-63018b896620 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:40.741205 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ac7fa-cbc0-4a42-9da6-63018b896620 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:40.741205 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ac7fa-cbc0-4a42-9da6-63018b896620 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:40.750000 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 573/1155] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:16:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:40.756409 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a419fb-a8de-4843-bf15-3e02e7da109b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:40.768292 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a419fb-a8de-4843-bf15-3e02e7da109b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:40.773472 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5ea52-6c20-4680-83bb-61fcc5931de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:40.774217 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5ea52-6c20-4680-83bb-61fcc5931de3 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:40.774500 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5ea52-6c20-4680-83bb-61fcc5931de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:40.774770 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5ea52-6c20-4680-83bb-61fcc5931de3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:40.775581 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5ea52-6c20-4680-83bb-61fcc5931de3 admin admin] RBAC: Adding query filter params (role.id=faadc5010ffb447ba5280e491c2ea2f5, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=d67c0b68ca7349399d9ea9f4a0b2b564) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:40.775888 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5ea52-6c20-4680-83bb-61fcc5931de3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:40.777734 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5ea52-6c20-4680-83bb-61fcc5931de3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:40.783109 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 583/1156] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:16:40 2021] GET /identity/v3/role_assignments?user.id=d67c0b68ca7349399d9ea9f4a0b2b564&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=faadc5010ffb447ba5280e491c2ea2f5 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:42.890036 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc94de-1242-465b-9aa3-47f396a6b6b9 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:42.890549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc94de-1242-465b-9aa3-47f396a6b6b9 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:42.890549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc94de-1242-465b-9aa3-47f396a6b6b9 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:42.892267 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 574/1157] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:16:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:16:42.898930 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134af50-59d2-432c-8747-f2facb01b827 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:42.902985 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134af50-59d2-432c-8747-f2facb01b827 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:42.902985 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134af50-59d2-432c-8747-f2facb01b827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:42.917754 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-5134af50-59d2-432c-8747-f2facb01b827 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:16:42.918943 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-5134af50-59d2-432c-8747-f2facb01b827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:16:42.926602 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 584/1158] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:16:42 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:16:42.951607 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc94de-1242-465b-9aa3-47f396a6b6b9 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:42.964549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc94de-1242-465b-9aa3-47f396a6b6b9 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:42.968958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3aed9-a753-4d2d-806d-3ed9474e9b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:42.969725 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3aed9-a753-4d2d-806d-3ed9474e9b5d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:42.970005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3aed9-a753-4d2d-806d-3ed9474e9b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:42.970277 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3aed9-a753-4d2d-806d-3ed9474e9b5d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:42.980546 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3aed9-a753-4d2d-806d-3ed9474e9b5d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:16:42.987706 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-59e3aed9-a753-4d2d-806d-3ed9474e9b5d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:16:42.988902 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 575/1159] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:16:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:42.995589 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134af50-59d2-432c-8747-f2facb01b827 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:43.004364 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134af50-59d2-432c-8747-f2facb01b827 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:43.009706 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c16add-c169-4950-b483-a598a69c678c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:43.010344 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c16add-c169-4950-b483-a598a69c678c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:43.010621 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c16add-c169-4950-b483-a598a69c678c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:43.010891 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c16add-c169-4950-b483-a598a69c678c admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:43.011619 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c16add-c169-4950-b483-a598a69c678c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:43.011932 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c16add-c169-4950-b483-a598a69c678c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:43.013519 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c16add-c169-4950-b483-a598a69c678c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:43.021607 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 585/1160] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:16:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:43.028401 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3aed9-a753-4d2d-806d-3ed9474e9b5d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:43.038696 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3aed9-a753-4d2d-806d-3ed9474e9b5d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:43.043244 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470acda1-9510-4c57-9960-9be754239113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:43.044049 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470acda1-9510-4c57-9960-9be754239113 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:43.044325 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470acda1-9510-4c57-9960-9be754239113 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:43.044593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470acda1-9510-4c57-9960-9be754239113 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:43.054669 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470acda1-9510-4c57-9960-9be754239113 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:43.056503 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470acda1-9510-4c57-9960-9be754239113 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:43.072891 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-470acda1-9510-4c57-9960-9be754239113 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:16:43.074046 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 576/1161] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:16:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:16:43.080551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c16add-c169-4950-b483-a598a69c678c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:43.090821 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c16add-c169-4950-b483-a598a69c678c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:43.095393 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c6e5c-745a-4bc6-8d75-0e1dbe0ce7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:43.096026 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c6e5c-745a-4bc6-8d75-0e1dbe0ce7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:43.096301 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c6e5c-745a-4bc6-8d75-0e1dbe0ce7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:43.096569 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c6e5c-745a-4bc6-8d75-0e1dbe0ce7e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:43.097307 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c6e5c-745a-4bc6-8d75-0e1dbe0ce7e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:43.097609 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c6e5c-745a-4bc6-8d75-0e1dbe0ce7e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:43.099156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c6e5c-745a-4bc6-8d75-0e1dbe0ce7e6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:43.110662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 586/1162] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:16:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:43.116858 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470acda1-9510-4c57-9960-9be754239113 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:43.126348 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470acda1-9510-4c57-9960-9be754239113 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:43.130840 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b95f17-fec4-473a-b28d-6deade776c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:43.131600 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b95f17-fec4-473a-b28d-6deade776c00 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:43.135710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b95f17-fec4-473a-b28d-6deade776c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:43.135710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b95f17-fec4-473a-b28d-6deade776c00 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:43.139863 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b95f17-fec4-473a-b28d-6deade776c00 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:43.142028 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b95f17-fec4-473a-b28d-6deade776c00 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:43.157180 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-27b95f17-fec4-473a-b28d-6deade776c00 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 01:16:43.158284 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 577/1163] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:16:43 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:43.164586 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c6e5c-745a-4bc6-8d75-0e1dbe0ce7e6 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:43.174074 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c6e5c-745a-4bc6-8d75-0e1dbe0ce7e6 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:43.178548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c84ddf-8827-4568-bb6d-7b8cd26332d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:43.179713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c84ddf-8827-4568-bb6d-7b8cd26332d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:43.179986 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c84ddf-8827-4568-bb6d-7b8cd26332d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:43.180259 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c84ddf-8827-4568-bb6d-7b8cd26332d5 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:43.181107 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c84ddf-8827-4568-bb6d-7b8cd26332d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:43.181414 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c84ddf-8827-4568-bb6d-7b8cd26332d5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:43.183226 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c84ddf-8827-4568-bb6d-7b8cd26332d5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:43.200917 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 587/1164] 10.222.0.25 () {56 vars in 1165 bytes} [Fri Aug 27 01:16:43 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:43.206990 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b95f17-fec4-473a-b28d-6deade776c00 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:43.216863 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b95f17-fec4-473a-b28d-6deade776c00 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:43.221456 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe8abc-a835-4c6e-b19e-fba857c395f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:43.222207 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe8abc-a835-4c6e-b19e-fba857c395f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:43.222483 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe8abc-a835-4c6e-b19e-fba857c395f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:43.222750 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe8abc-a835-4c6e-b19e-fba857c395f7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:43.232631 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe8abc-a835-4c6e-b19e-fba857c395f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:43.234570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe8abc-a835-4c6e-b19e-fba857c395f7 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:43.251758 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-20fe8abc-a835-4c6e-b19e-fba857c395f7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:16:43.252906 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 578/1165] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:16:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:16:43.259613 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c84ddf-8827-4568-bb6d-7b8cd26332d5 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:43.269149 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c84ddf-8827-4568-bb6d-7b8cd26332d5 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:43.273645 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832453c4-8ac4-45a4-8b7c-21119cc4b0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:43.274285 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832453c4-8ac4-45a4-8b7c-21119cc4b0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:43.274566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832453c4-8ac4-45a4-8b7c-21119cc4b0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:43.274839 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832453c4-8ac4-45a4-8b7c-21119cc4b0b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:43.275546 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832453c4-8ac4-45a4-8b7c-21119cc4b0b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:43.275853 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832453c4-8ac4-45a4-8b7c-21119cc4b0b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:43.277492 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832453c4-8ac4-45a4-8b7c-21119cc4b0b0 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:43.288396 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 588/1166] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:16:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:43.294445 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe8abc-a835-4c6e-b19e-fba857c395f7 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:43.304683 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe8abc-a835-4c6e-b19e-fba857c395f7 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:43.309299 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682ee96-4d25-42d7-ac44-fd8010f7d126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:43.310062 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682ee96-4d25-42d7-ac44-fd8010f7d126 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:43.310340 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682ee96-4d25-42d7-ac44-fd8010f7d126 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:43.310612 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682ee96-4d25-42d7-ac44-fd8010f7d126 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:43.317224 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682ee96-4d25-42d7-ac44-fd8010f7d126 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:43.319138 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682ee96-4d25-42d7-ac44-fd8010f7d126 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:43.332926 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-c682ee96-4d25-42d7-ac44-fd8010f7d126 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:16:43.334085 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 579/1167] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:16:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:16:43.340390 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832453c4-8ac4-45a4-8b7c-21119cc4b0b0 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:43.350072 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832453c4-8ac4-45a4-8b7c-21119cc4b0b0 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:43.354886 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643324e-cc75-427c-ac3d-04ca31c75e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:43.355522 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643324e-cc75-427c-ac3d-04ca31c75e49 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:43.355802 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643324e-cc75-427c-ac3d-04ca31c75e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:43.356076 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643324e-cc75-427c-ac3d-04ca31c75e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:43.356871 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643324e-cc75-427c-ac3d-04ca31c75e49 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:43.357182 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643324e-cc75-427c-ac3d-04ca31c75e49 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:43.359002 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643324e-cc75-427c-ac3d-04ca31c75e49 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:43.371386 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 589/1168] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:16:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:43.377559 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682ee96-4d25-42d7-ac44-fd8010f7d126 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:43.388248 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682ee96-4d25-42d7-ac44-fd8010f7d126 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:43.392930 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4964a-ede6-43ac-a8cb-e73ac196ad52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:43.393757 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4964a-ede6-43ac-a8cb-e73ac196ad52 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:43.394023 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4964a-ede6-43ac-a8cb-e73ac196ad52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:43.394306 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4964a-ede6-43ac-a8cb-e73ac196ad52 admin admin] PATH_INFO: `/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/d67c0b68ca7349399d9ea9f4a0b2b564/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:43.396302 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4964a-ede6-43ac-a8cb-e73ac196ad52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0094d4fd0a114a2cbf5919f2a0e88e82, user_id=d67c0b68ca7349399d9ea9f4a0b2b564, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:43.399005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4964a-ede6-43ac-a8cb-e73ac196ad52 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:43.484782 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 580/1169] 10.222.0.25 () {58 vars in 1461 bytes} [Fri Aug 27 01:16:43 2021] PUT /identity/v3/projects/0094d4fd0a114a2cbf5919f2a0e88e82/users/d67c0b68ca7349399d9ea9f4a0b2b564/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:16:45.623895 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c7b97-0687-48de-9248-4cda0a02741c None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:45.624412 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c7b97-0687-48de-9248-4cda0a02741c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:45.624412 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c7b97-0687-48de-9248-4cda0a02741c None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:45.626381 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 590/1170] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:16:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:16:45.633116 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489302bb-35c1-4277-9187-1aff467e94f5 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:45.633539 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489302bb-35c1-4277-9187-1aff467e94f5 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:45.633717 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489302bb-35c1-4277-9187-1aff467e94f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:45.650645 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-489302bb-35c1-4277-9187-1aff467e94f5 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:16:45.651849 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-489302bb-35c1-4277-9187-1aff467e94f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:16:45.706313 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 581/1171] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:16:45 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:16:45.731066 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c7b97-0687-48de-9248-4cda0a02741c None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:45.743801 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c7b97-0687-48de-9248-4cda0a02741c None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:45.748266 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d22f75-32aa-4345-94dd-edbfb2ad752f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:45.749066 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d22f75-32aa-4345-94dd-edbfb2ad752f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:45.749377 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d22f75-32aa-4345-94dd-edbfb2ad752f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:45.749649 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d22f75-32aa-4345-94dd-edbfb2ad752f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:45.760570 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d22f75-32aa-4345-94dd-edbfb2ad752f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 01:16:45.767238 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-16d22f75-32aa-4345-94dd-edbfb2ad752f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 01:16:45.768395 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 591/1172] 10.222.0.25 () {56 vars in 1118 bytes} [Fri Aug 27 01:16:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:45.774971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489302bb-35c1-4277-9187-1aff467e94f5 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:45.783726 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489302bb-35c1-4277-9187-1aff467e94f5 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:45.789036 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305d2da-1509-46a9-9fd4-52e8f78b8dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:45.789688 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305d2da-1509-46a9-9fd4-52e8f78b8dcc admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:45.789980 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305d2da-1509-46a9-9fd4-52e8f78b8dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:45.790254 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305d2da-1509-46a9-9fd4-52e8f78b8dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:45.790991 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305d2da-1509-46a9-9fd4-52e8f78b8dcc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:45.791295 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305d2da-1509-46a9-9fd4-52e8f78b8dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:45.792911 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305d2da-1509-46a9-9fd4-52e8f78b8dcc admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:45.800911 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 582/1173] 10.222.0.25 () {56 vars in 1121 bytes} [Fri Aug 27 01:16:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:45.807642 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d22f75-32aa-4345-94dd-edbfb2ad752f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:45.817647 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d22f75-32aa-4345-94dd-edbfb2ad752f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:45.822310 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787104f9-9942-4193-9d39-d97d69aede8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:45.823060 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787104f9-9942-4193-9d39-d97d69aede8e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:45.823337 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787104f9-9942-4193-9d39-d97d69aede8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:45.823615 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787104f9-9942-4193-9d39-d97d69aede8e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:45.833826 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787104f9-9942-4193-9d39-d97d69aede8e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:45.835727 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787104f9-9942-4193-9d39-d97d69aede8e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:45.852100 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-787104f9-9942-4193-9d39-d97d69aede8e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:16:45.853308 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 592/1174] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:16:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:45.859466 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305d2da-1509-46a9-9fd4-52e8f78b8dcc admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:45.870049 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305d2da-1509-46a9-9fd4-52e8f78b8dcc admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:45.875341 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aae249-22ad-4542-83bd-5f538d681ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:45.876980 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aae249-22ad-4542-83bd-5f538d681ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:45.876980 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aae249-22ad-4542-83bd-5f538d681ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:45.876980 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aae249-22ad-4542-83bd-5f538d681ab1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:45.877252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aae249-22ad-4542-83bd-5f538d681ab1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:45.877895 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aae249-22ad-4542-83bd-5f538d681ab1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:45.879146 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aae249-22ad-4542-83bd-5f538d681ab1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:45.891653 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 583/1175] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:16:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:45.898711 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787104f9-9942-4193-9d39-d97d69aede8e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:45.908202 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787104f9-9942-4193-9d39-d97d69aede8e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:45.912694 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ec058-01ce-4243-baae-3389a70c5bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:45.914104 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ec058-01ce-4243-baae-3389a70c5bdf admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:45.914390 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ec058-01ce-4243-baae-3389a70c5bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:45.914662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ec058-01ce-4243-baae-3389a70c5bdf admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:45.921725 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ec058-01ce-4243-baae-3389a70c5bdf admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:45.923729 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ec058-01ce-4243-baae-3389a70c5bdf admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:45.937743 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-ea3ec058-01ce-4243-baae-3389a70c5bdf admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 01:16:45.938856 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 593/1176] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:16:45 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:45.945281 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aae249-22ad-4542-83bd-5f538d681ab1 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:45.955208 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aae249-22ad-4542-83bd-5f538d681ab1 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:45.959870 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00982cb8-872d-4895-8a9c-1bdb3c613d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:45.960583 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00982cb8-872d-4895-8a9c-1bdb3c613d93 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:45.960893 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00982cb8-872d-4895-8a9c-1bdb3c613d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:45.961166 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00982cb8-872d-4895-8a9c-1bdb3c613d93 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:45.961993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00982cb8-872d-4895-8a9c-1bdb3c613d93 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:45.962294 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00982cb8-872d-4895-8a9c-1bdb3c613d93 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:45.964113 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00982cb8-872d-4895-8a9c-1bdb3c613d93 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:45.981246 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 584/1177] 10.222.0.25 () {56 vars in 1165 bytes} [Fri Aug 27 01:16:45 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:45.987403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ec058-01ce-4243-baae-3389a70c5bdf admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:45.997605 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ec058-01ce-4243-baae-3389a70c5bdf admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:46.002082 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427d02f-f1b2-4f49-90d3-0819f6255e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:46.002704 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427d02f-f1b2-4f49-90d3-0819f6255e06 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:46.002985 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427d02f-f1b2-4f49-90d3-0819f6255e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:46.003405 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427d02f-f1b2-4f49-90d3-0819f6255e06 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:46.011465 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427d02f-f1b2-4f49-90d3-0819f6255e06 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:46.013249 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427d02f-f1b2-4f49-90d3-0819f6255e06 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:46.021859 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 594/1178] 10.222.0.25 () {58 vars in 1325 bytes} [Fri Aug 27 01:16:45 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:16:46.027916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00982cb8-872d-4895-8a9c-1bdb3c613d93 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:46.037271 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00982cb8-872d-4895-8a9c-1bdb3c613d93 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:46.045383 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c47975-e00e-495b-88f8-9973b45796f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:46.046174 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c47975-e00e-495b-88f8-9973b45796f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:46.046459 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c47975-e00e-495b-88f8-9973b45796f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:46.046731 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c47975-e00e-495b-88f8-9973b45796f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:46.058127 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c47975-e00e-495b-88f8-9973b45796f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:46.059955 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c47975-e00e-495b-88f8-9973b45796f0 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:46.076272 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-d9c47975-e00e-495b-88f8-9973b45796f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 01:16:46.077741 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 585/1179] 10.222.0.25 () {56 vars in 1130 bytes} [Fri Aug 27 01:16:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:46.083750 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427d02f-f1b2-4f49-90d3-0819f6255e06 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:46.092916 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427d02f-f1b2-4f49-90d3-0819f6255e06 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:46.097555 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a97867-0fe1-4007-93ad-adaec8be6dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:46.098197 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a97867-0fe1-4007-93ad-adaec8be6dfb admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:46.098481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a97867-0fe1-4007-93ad-adaec8be6dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:46.098758 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a97867-0fe1-4007-93ad-adaec8be6dfb admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:46.099468 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a97867-0fe1-4007-93ad-adaec8be6dfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:46.099777 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a97867-0fe1-4007-93ad-adaec8be6dfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:46.101874 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a97867-0fe1-4007-93ad-adaec8be6dfb admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:46.112941 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 595/1180] 10.222.0.25 () {56 vars in 1131 bytes} [Fri Aug 27 01:16:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:46.119643 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c47975-e00e-495b-88f8-9973b45796f0 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:46.129215 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c47975-e00e-495b-88f8-9973b45796f0 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:46.133823 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cac2b2-2436-43fe-b4e9-fa3cf60d8dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:46.134613 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cac2b2-2436-43fe-b4e9-fa3cf60d8dfd admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:46.134949 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cac2b2-2436-43fe-b4e9-fa3cf60d8dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:46.135161 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cac2b2-2436-43fe-b4e9-fa3cf60d8dfd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:46.141710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cac2b2-2436-43fe-b4e9-fa3cf60d8dfd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:46.143650 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cac2b2-2436-43fe-b4e9-fa3cf60d8dfd admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:46.156727 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING keystone.server.flask.application [None req-98cac2b2-2436-43fe-b4e9-fa3cf60d8dfd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 01:16:46.157860 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 586/1181] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Aug 27 01:16:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 01:16:46.164671 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a97867-0fe1-4007-93ad-adaec8be6dfb admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:46.174358 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a97867-0fe1-4007-93ad-adaec8be6dfb admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:46.180160 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b246c49-b8a4-47be-a44b-fd2f73c27ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:46.180160 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b246c49-b8a4-47be-a44b-fd2f73c27ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:46.180160 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b246c49-b8a4-47be-a44b-fd2f73c27ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:46.181857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b246c49-b8a4-47be-a44b-fd2f73c27ec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:46.182641 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b246c49-b8a4-47be-a44b-fd2f73c27ec4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:46.182947 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b246c49-b8a4-47be-a44b-fd2f73c27ec4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:46.184772 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b246c49-b8a4-47be-a44b-fd2f73c27ec4 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:46.197722 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 596/1182] 10.222.0.25 () {56 vars in 1170 bytes} [Fri Aug 27 01:16:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:16:46.206056 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cac2b2-2436-43fe-b4e9-fa3cf60d8dfd admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:46.217035 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cac2b2-2436-43fe-b4e9-fa3cf60d8dfd admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:46.221466 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c9d94-2b55-4e10-a253-1976d2d43859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:46.222084 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c9d94-2b55-4e10-a253-1976d2d43859 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:46.222359 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c9d94-2b55-4e10-a253-1976d2d43859 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:46.222626 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c9d94-2b55-4e10-a253-1976d2d43859 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:46.223429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c9d94-2b55-4e10-a253-1976d2d43859 admin admin] RBAC: Adding query filter params (role.id=faadc5010ffb447ba5280e491c2ea2f5, scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82, user.id=d67c0b68ca7349399d9ea9f4a0b2b564) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:46.223784 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c9d94-2b55-4e10-a253-1976d2d43859 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:46.226485 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c9d94-2b55-4e10-a253-1976d2d43859 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:46.231934 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 587/1183] 10.222.0.25 () {56 vars in 1396 bytes} [Fri Aug 27 01:16:46 2021] GET /identity/v3/role_assignments?user.id=d67c0b68ca7349399d9ea9f4a0b2b564&scope.project.id=0094d4fd0a114a2cbf5919f2a0e88e82&role.id=faadc5010ffb447ba5280e491c2ea2f5 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:48.390360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbb0aa-2ee2-45b5-9eee-75ab3d4ed5c9 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:48.390895 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbb0aa-2ee2-45b5-9eee-75ab3d4ed5c9 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:48.390895 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbb0aa-2ee2-45b5-9eee-75ab3d4ed5c9 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:48.392684 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 597/1184] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:16:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:16:48.399697 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33cb56-91d9-45ce-b461-e5e556e0678c None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:48.400129 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33cb56-91d9-45ce-b461-e5e556e0678c None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:48.400218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33cb56-91d9-45ce-b461-e5e556e0678c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:48.417594 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-1e33cb56-91d9-45ce-b461-e5e556e0678c None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:16:48.418816 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1e33cb56-91d9-45ce-b461-e5e556e0678c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:16:48.428887 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 588/1185] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:16:48 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:16:48.451396 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbb0aa-2ee2-45b5-9eee-75ab3d4ed5c9 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:48.463425 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbb0aa-2ee2-45b5-9eee-75ab3d4ed5c9 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:48.467750 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8a429-d11b-496c-a391-8dd4151fe6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:48.468521 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8a429-d11b-496c-a391-8dd4151fe6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:48.468796 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8a429-d11b-496c-a391-8dd4151fe6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:48.469094 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8a429-d11b-496c-a391-8dd4151fe6b6 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:48.473090 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8a429-d11b-496c-a391-8dd4151fe6b6 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:48.473090 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8a429-d11b-496c-a391-8dd4151fe6b6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:48.481789 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-e5c8a429-d11b-496c-a391-8dd4151fe6b6 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 01:16:48.482889 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 598/1186] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Aug 27 01:16:48 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:48.489477 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33cb56-91d9-45ce-b461-e5e556e0678c None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:48.498924 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33cb56-91d9-45ce-b461-e5e556e0678c None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:48.503888 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b0218-7b96-4b4c-a68c-393ee03085ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:48.507789 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b0218-7b96-4b4c-a68c-393ee03085ee admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:48.507789 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b0218-7b96-4b4c-a68c-393ee03085ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:48.507789 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b0218-7b96-4b4c-a68c-393ee03085ee admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:48.507789 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b0218-7b96-4b4c-a68c-393ee03085ee admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:48.507789 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b0218-7b96-4b4c-a68c-393ee03085ee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:48.508234 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b0218-7b96-4b4c-a68c-393ee03085ee admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:48.512937 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 589/1187] 10.222.0.25 () {56 vars in 1138 bytes} [Fri Aug 27 01:16:48 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:16:48.518865 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8a429-d11b-496c-a391-8dd4151fe6b6 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:48.528467 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8a429-d11b-496c-a391-8dd4151fe6b6 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:48.533132 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce43f7-00b3-4bfb-8086-5cb7ffe85e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:48.533780 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce43f7-00b3-4bfb-8086-5cb7ffe85e84 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:48.534066 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce43f7-00b3-4bfb-8086-5cb7ffe85e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:48.534348 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce43f7-00b3-4bfb-8086-5cb7ffe85e84 admin admin] PATH_INFO: `/v3/services` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:48.535044 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce43f7-00b3-4bfb-8086-5cb7ffe85e84 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:48.535352 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce43f7-00b3-4bfb-8086-5cb7ffe85e84 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:48.536955 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce43f7-00b3-4bfb-8086-5cb7ffe85e84 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:48.542031 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 599/1188] 10.222.0.25 () {56 vars in 1138 bytes} [Fri Aug 27 01:16:48 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:50.705412 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade09cd-a549-4403-9dd7-260a34c31a5f None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:50.705971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade09cd-a549-4403-9dd7-260a34c31a5f None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:50.705971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade09cd-a549-4403-9dd7-260a34c31a5f None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:50.707710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 590/1189] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:16:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:16:50.713799 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782db0b-c6b3-46f0-8bcd-42d28a4435fa None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:50.714262 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782db0b-c6b3-46f0-8bcd-42d28a4435fa None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:50.714360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782db0b-c6b3-46f0-8bcd-42d28a4435fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:50.733173 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-a782db0b-c6b3-46f0-8bcd-42d28a4435fa None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:16:50.739281 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a782db0b-c6b3-46f0-8bcd-42d28a4435fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:16:50.742792 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 600/1190] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:16:50 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:16:50.766700 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade09cd-a549-4403-9dd7-260a34c31a5f None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:50.779598 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade09cd-a549-4403-9dd7-260a34c31a5f None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:50.784162 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06735b77-fa46-410e-a683-b91177c7989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:50.786186 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06735b77-fa46-410e-a683-b91177c7989f admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:50.786186 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06735b77-fa46-410e-a683-b91177c7989f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:50.786186 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06735b77-fa46-410e-a683-b91177c7989f admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:50.786186 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06735b77-fa46-410e-a683-b91177c7989f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:50.788206 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06735b77-fa46-410e-a683-b91177c7989f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:50.894918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 591/1191] 10.222.0.25 () {60 vars in 1163 bytes} [Fri Aug 27 01:16:50 2021] POST /identity/v3/services => generated 246 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:16:53.129154 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada7fde-dfe8-47f5-9918-eb2efbcd4c05 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:53.129719 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada7fde-dfe8-47f5-9918-eb2efbcd4c05 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:53.129719 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada7fde-dfe8-47f5-9918-eb2efbcd4c05 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:53.132400 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 601/1192] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:16:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:16:53.140335 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c1ca2-b982-40c8-84a5-7922c77b422d None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:53.140816 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c1ca2-b982-40c8-84a5-7922c77b422d None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:53.140946 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c1ca2-b982-40c8-84a5-7922c77b422d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:53.159181 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-759c1ca2-b982-40c8-84a5-7922c77b422d None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:16:53.160425 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-759c1ca2-b982-40c8-84a5-7922c77b422d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:16:53.178070 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 592/1193] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:16:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:16:53.208083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada7fde-dfe8-47f5-9918-eb2efbcd4c05 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:53.221173 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada7fde-dfe8-47f5-9918-eb2efbcd4c05 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:53.225727 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9ea5b-5f24-4ab6-a0f9-d862e1d27173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:53.226508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9ea5b-5f24-4ab6-a0f9-d862e1d27173 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:53.226787 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9ea5b-5f24-4ab6-a0f9-d862e1d27173 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:53.227058 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9ea5b-5f24-4ab6-a0f9-d862e1d27173 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:53.227900 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9ea5b-5f24-4ab6-a0f9-d862e1d27173 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:53.230014 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9ea5b-5f24-4ab6-a0f9-d862e1d27173 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:53.243261 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-18a9ea5b-5f24-4ab6-a0f9-d862e1d27173 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 01:16:53.245489 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 602/1194] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Aug 27 01:16:53 2021] GET /identity/v3/services/placement => generated 90 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:53.252372 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c1ca2-b982-40c8-84a5-7922c77b422d None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:53.262636 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c1ca2-b982-40c8-84a5-7922c77b422d None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:53.267272 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29ad17-c492-4efb-83b9-4604d4e7f6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:53.267935 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29ad17-c492-4efb-83b9-4604d4e7f6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:53.268295 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29ad17-c492-4efb-83b9-4604d4e7f6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:53.268532 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29ad17-c492-4efb-83b9-4604d4e7f6c6 admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:53.270102 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29ad17-c492-4efb-83b9-4604d4e7f6c6 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:53.270411 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29ad17-c492-4efb-83b9-4604d4e7f6c6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:53.272042 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29ad17-c492-4efb-83b9-4604d4e7f6c6 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:53.280573 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 593/1195] 10.222.0.25 () {56 vars in 1138 bytes} [Fri Aug 27 01:16:53 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:53.288994 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9ea5b-5f24-4ab6-a0f9-d862e1d27173 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:53.301386 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9ea5b-5f24-4ab6-a0f9-d862e1d27173 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:53.308948 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfc36d-768e-46e0-9153-9918c248d2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:53.310068 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfc36d-768e-46e0-9153-9918c248d2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:53.310547 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfc36d-768e-46e0-9153-9918c248d2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:53.311003 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfc36d-768e-46e0-9153-9918c248d2e1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:53.312333 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfc36d-768e-46e0-9153-9918c248d2e1 admin admin] RBAC: Adding query filter params (interface=public, service_id=670b46f8427c4ea2a82d32b920aaff89, region_id=RegionOne) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:53.312875 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfc36d-768e-46e0-9153-9918c248d2e1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:53.314649 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfc36d-768e-46e0-9153-9918c248d2e1 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:53.322285 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 603/1196] 10.222.0.25 () {56 vars in 1273 bytes} [Fri Aug 27 01:16:53 2021] GET /identity/v3/endpoints?service_id=670b46f8427c4ea2a82d32b920aaff89&interface=public®ion_id=RegionOne => generated 194 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:16:53.328942 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29ad17-c492-4efb-83b9-4604d4e7f6c6 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:53.338924 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29ad17-c492-4efb-83b9-4604d4e7f6c6 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:53.343598 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340b4c2-360b-4564-a198-81ecac173d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:53.344946 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340b4c2-360b-4564-a198-81ecac173d45 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:53.344946 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340b4c2-360b-4564-a198-81ecac173d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:53.344946 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340b4c2-360b-4564-a198-81ecac173d45 admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:53.345510 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340b4c2-360b-4564-a198-81ecac173d45 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:53.347105 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340b4c2-360b-4564-a198-81ecac173d45 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:53.354865 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 594/1197] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 01:16:53 2021] GET /identity/v3/services => generated 2191 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:16:55.523297 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d5b21-e5be-421a-bba2-0a8b05a0e2a7 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:55.523837 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d5b21-e5be-421a-bba2-0a8b05a0e2a7 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:55.523837 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d5b21-e5be-421a-bba2-0a8b05a0e2a7 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:55.525712 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 604/1198] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:16:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:16:55.531551 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6effb-c2fd-482b-945f-46aaec74e499 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:55.532011 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6effb-c2fd-482b-945f-46aaec74e499 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:55.532116 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6effb-c2fd-482b-945f-46aaec74e499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:55.550378 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-80f6effb-c2fd-482b-945f-46aaec74e499 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:16:55.551623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-80f6effb-c2fd-482b-945f-46aaec74e499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:16:55.559628 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 595/1199] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:16:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:16:55.584246 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d5b21-e5be-421a-bba2-0a8b05a0e2a7 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:55.596794 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d5b21-e5be-421a-bba2-0a8b05a0e2a7 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:55.601265 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0fc7f-52db-4e41-b792-a9474e830586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:55.602036 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0fc7f-52db-4e41-b792-a9474e830586 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:55.602312 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0fc7f-52db-4e41-b792-a9474e830586 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:55.602582 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0fc7f-52db-4e41-b792-a9474e830586 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:55.603217 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0fc7f-52db-4e41-b792-a9474e830586 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:55.604780 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0fc7f-52db-4e41-b792-a9474e830586 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:55.615701 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING keystone.server.flask.application [None req-17e0fc7f-52db-4e41-b792-a9474e830586 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 01:16:55.616913 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 605/1200] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Aug 27 01:16:55 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 01:16:55.623590 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6effb-c2fd-482b-945f-46aaec74e499 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:55.633674 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6effb-c2fd-482b-945f-46aaec74e499 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:55.638362 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4dcb4a-a927-4841-9d80-5c1ac82a4307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:55.639015 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dcb4a-a927-4841-9d80-5c1ac82a4307 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:55.639299 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dcb4a-a927-4841-9d80-5c1ac82a4307 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:55.639575 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dcb4a-a927-4841-9d80-5c1ac82a4307 admin admin] PATH_INFO: `/v3/services` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:55.640283 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4dcb4a-a927-4841-9d80-5c1ac82a4307 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:16:55.640591 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4dcb4a-a927-4841-9d80-5c1ac82a4307 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:55.642263 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4dcb4a-a927-4841-9d80-5c1ac82a4307 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:55.648514 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 596/1201] 10.222.0.25 () {56 vars in 1138 bytes} [Fri Aug 27 01:16:55 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:16:55.654780 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0fc7f-52db-4e41-b792-a9474e830586 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:16:55.664980 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0fc7f-52db-4e41-b792-a9474e830586 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:16:55.669506 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747e355-fa61-461e-95da-0904c54ddef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:16:55.670088 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747e355-fa61-461e-95da-0904c54ddef5 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:16:55.670371 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747e355-fa61-461e-95da-0904c54ddef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:16:55.670648 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747e355-fa61-461e-95da-0904c54ddef5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:16:55.671386 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747e355-fa61-461e-95da-0904c54ddef5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:16:55.672984 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747e355-fa61-461e-95da-0904c54ddef5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:16:55.781005 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 606/1202] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Aug 27 01:16:55 2021] POST /identity/v3/endpoints => generated 331 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:22:15.470068 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a4e4e-d758-4759-bde0-0d3c1805ac98 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:15.470530 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a4e4e-d758-4759-bde0-0d3c1805ac98 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:15.470530 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a4e4e-d758-4759-bde0-0d3c1805ac98 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:15.478849 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491fbe8-db55-4dc3-890d-efecda7defc2 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:15.479269 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491fbe8-db55-4dc3-890d-efecda7defc2 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:15.479412 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491fbe8-db55-4dc3-890d-efecda7defc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:15.482182 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 597/1203] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:22:15 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:22:15.593787 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-c491fbe8-db55-4dc3-890d-efecda7defc2 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:22:15.595407 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c491fbe8-db55-4dc3-890d-efecda7defc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:15.808915 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 607/1204] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:22:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:22:15.819925 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a4e4e-d758-4759-bde0-0d3c1805ac98 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:22:15.822390 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-297a4e4e-d758-4759-bde0-0d3c1805ac98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:15.983293 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a4e4e-d758-4759-bde0-0d3c1805ac98 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:22:16.087440 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c60e6-6e89-429f-b6d6-716a6e2c62e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:22:16.088464 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c60e6-6e89-429f-b6d6-716a6e2c62e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:16.088992 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c60e6-6e89-429f-b6d6-716a6e2c62e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:16.089479 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c60e6-6e89-429f-b6d6-716a6e2c62e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:16.091134 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c60e6-6e89-429f-b6d6-716a6e2c62e4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:22:16.093313 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c60e6-6e89-429f-b6d6-716a6e2c62e4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:22:16.114114 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 598/1205] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 01:22:15 2021] GET /identity/v3/projects => generated 2553 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:22:18.367088 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edfcbb-3f49-49fb-af49-00695c73fabb None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:18.367627 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edfcbb-3f49-49fb-af49-00695c73fabb None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:18.367627 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edfcbb-3f49-49fb-af49-00695c73fabb None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:18.369424 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 608/1206] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:22:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:22:18.376072 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16273a46-5936-431c-9634-8989920bc2a7 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:18.376515 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16273a46-5936-431c-9634-8989920bc2a7 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:18.376642 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16273a46-5936-431c-9634-8989920bc2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:18.461637 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-16273a46-5936-431c-9634-8989920bc2a7 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:22:18.462863 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-16273a46-5936-431c-9634-8989920bc2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:18.556574 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 599/1207] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:22:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:22:18.607529 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a4053-1d53-43fa-b0f6-a50b1aefc119 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:18.607815 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a4053-1d53-43fa-b0f6-a50b1aefc119 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:18.608095 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a4053-1d53-43fa-b0f6-a50b1aefc119 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:18.610092 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 609/1208] 10.222.0.25 () {54 vars in 964 bytes} [Fri Aug 27 01:22:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:22:18.616389 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16337de7-afef-46d2-962f-7ab28b6ddcfb None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:18.616676 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16337de7-afef-46d2-962f-7ab28b6ddcfb None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:18.616975 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16337de7-afef-46d2-962f-7ab28b6ddcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:18.701169 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-16337de7-afef-46d2-962f-7ab28b6ddcfb None None] MFA Rules not processed for user `2e2182e4d74047a399e7ffea63e7ce6e`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:22:18.703072 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-16337de7-afef-46d2-962f-7ab28b6ddcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:18.804273 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 600/1209] 10.222.0.25 () {58 vars in 1062 bytes} [Fri Aug 27 01:22:18 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:22:18.813911 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a4053-1d53-43fa-b0f6-a50b1aefc119 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:22:18.815431 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-189a4053-1d53-43fa-b0f6-a50b1aefc119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:18.916440 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a4053-1d53-43fa-b0f6-a50b1aefc119 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:22:18.990347 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf5bc2-fb18-4c27-9432-d5d9cf893e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:22:18.990936 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf5bc2-fb18-4c27-9432-d5d9cf893e79 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:18.991219 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf5bc2-fb18-4c27-9432-d5d9cf893e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:18.991498 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf5bc2-fb18-4c27-9432-d5d9cf893e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:18.993153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-7faf5bc2-fb18-4c27-9432-d5d9cf893e79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:19.099401 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf5bc2-fb18-4c27-9432-d5d9cf893e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:22:19.100862 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf5bc2-fb18-4c27-9432-d5d9cf893e79 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:22:19.118686 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 610/1210] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:22:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:22:21.641497 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ce86a-8c3a-4577-8c5a-fd303f4f974e None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:21.642020 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ce86a-8c3a-4577-8c5a-fd303f4f974e None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:21.642096 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ce86a-8c3a-4577-8c5a-fd303f4f974e None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:21.643825 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 601/1211] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:22:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:22:21.649579 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6afe9-d8d8-4ef4-9650-52afefe8efa1 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:21.649976 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6afe9-d8d8-4ef4-9650-52afefe8efa1 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:21.650131 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6afe9-d8d8-4ef4-9650-52afefe8efa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:21.713046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-93b6afe9-d8d8-4ef4-9650-52afefe8efa1 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:22:21.714171 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-93b6afe9-d8d8-4ef4-9650-52afefe8efa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:21.806257 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 611/1212] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:22:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:22:21.845295 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ce86a-8c3a-4577-8c5a-fd303f4f974e None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:22:21.847070 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-bf6ce86a-8c3a-4577-8c5a-fd303f4f974e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:21.944183 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ce86a-8c3a-4577-8c5a-fd303f4f974e None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:22:22.013811 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1540c8b-535a-4fda-831e-a2111b8fb253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:22:22.014625 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1540c8b-535a-4fda-831e-a2111b8fb253 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:22.014904 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1540c8b-535a-4fda-831e-a2111b8fb253 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:22.015173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1540c8b-535a-4fda-831e-a2111b8fb253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:22.016809 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-c1540c8b-535a-4fda-831e-a2111b8fb253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:22.122446 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1540c8b-535a-4fda-831e-a2111b8fb253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:22:22.123890 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1540c8b-535a-4fda-831e-a2111b8fb253 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:22:22.142543 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 602/1213] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:22:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:22:24.772157 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd527f9-83b6-4289-bdec-a95de6d9ef10 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:24.772679 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd527f9-83b6-4289-bdec-a95de6d9ef10 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:24.772768 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd527f9-83b6-4289-bdec-a95de6d9ef10 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:24.774519 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 612/1214] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:22:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:22:24.781189 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c45363-ebba-4968-8ba2-1589a52d1b07 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:24.781657 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c45363-ebba-4968-8ba2-1589a52d1b07 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:24.781746 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c45363-ebba-4968-8ba2-1589a52d1b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:24.844051 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-c5c45363-ebba-4968-8ba2-1589a52d1b07 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:22:24.845273 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-c5c45363-ebba-4968-8ba2-1589a52d1b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:24.937118 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 603/1215] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:22:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:22:24.971801 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd527f9-83b6-4289-bdec-a95de6d9ef10 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:22:24.973271 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-bbd527f9-83b6-4289-bdec-a95de6d9ef10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:25.090777 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd527f9-83b6-4289-bdec-a95de6d9ef10 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:22:25.178972 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33450ea-baaf-458c-9946-36552c9f1f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:22:25.179811 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33450ea-baaf-458c-9946-36552c9f1f50 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:25.180090 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33450ea-baaf-458c-9946-36552c9f1f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:25.180360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33450ea-baaf-458c-9946-36552c9f1f50 admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:25.190462 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33450ea-baaf-458c-9946-36552c9f1f50 admin admin] RBAC: Authorizing `identity:get_project(project_id=966196fad6e9467e93b5762e459a1d84)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:22:25.192517 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33450ea-baaf-458c-9946-36552c9f1f50 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:22:25.194446 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 613/1216] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:22:24 2021] GET /identity/v3/projects/966196fad6e9467e93b5762e459a1d84 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:22:25.207009 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c45363-ebba-4968-8ba2-1589a52d1b07 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:22:25.208228 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-c5c45363-ebba-4968-8ba2-1589a52d1b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:25.293650 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c45363-ebba-4968-8ba2-1589a52d1b07 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:22:25.362394 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651be855-8da5-4002-8b11-dcd66194b68a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:22:25.363025 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651be855-8da5-4002-8b11-dcd66194b68a service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:25.363302 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651be855-8da5-4002-8b11-dcd66194b68a service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:25.363570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651be855-8da5-4002-8b11-dcd66194b68a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:25.365174 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-651be855-8da5-4002-8b11-dcd66194b68a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:25.468074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651be855-8da5-4002-8b11-dcd66194b68a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:22:25.469536 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651be855-8da5-4002-8b11-dcd66194b68a service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:22:25.487502 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 604/1217] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:22:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:22:28.474763 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e6383-567e-4ee9-abfe-e67609446ad5 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:28.475341 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e6383-567e-4ee9-abfe-e67609446ad5 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:28.475341 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e6383-567e-4ee9-abfe-e67609446ad5 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:28.477078 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 614/1218] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:22:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:22:28.483209 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4075e-d73e-4c7b-bc26-fe800051d634 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:28.483694 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4075e-d73e-4c7b-bc26-fe800051d634 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:28.483828 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4075e-d73e-4c7b-bc26-fe800051d634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:28.548506 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-5ce4075e-d73e-4c7b-bc26-fe800051d634 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:22:28.549791 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-5ce4075e-d73e-4c7b-bc26-fe800051d634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:28.642363 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 605/1219] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:22:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:22:28.676738 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e6383-567e-4ee9-abfe-e67609446ad5 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:22:28.678254 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c94e6383-567e-4ee9-abfe-e67609446ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:28.800940 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e6383-567e-4ee9-abfe-e67609446ad5 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:22:28.890473 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e85f33-b4aa-4622-840c-13b7e49ccf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:22:28.891322 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e85f33-b4aa-4622-840c-13b7e49ccf07 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:28.891601 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e85f33-b4aa-4622-840c-13b7e49ccf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:28.891872 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e85f33-b4aa-4622-840c-13b7e49ccf07 admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:28.901249 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e85f33-b4aa-4622-840c-13b7e49ccf07 admin admin] RBAC: Authorizing `identity:get_project(project_id=966196fad6e9467e93b5762e459a1d84)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:22:28.904118 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e85f33-b4aa-4622-840c-13b7e49ccf07 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:22:28.905836 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 615/1220] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:22:28 2021] GET /identity/v3/projects/966196fad6e9467e93b5762e459a1d84 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:22:28.933580 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a418306-bb25-4f5e-b5fe-81262c695e9a None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:28.933767 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a418306-bb25-4f5e-b5fe-81262c695e9a None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:28.934047 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a418306-bb25-4f5e-b5fe-81262c695e9a None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:28.935858 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 606/1221] 10.222.0.25 () {54 vars in 964 bytes} [Fri Aug 27 01:22:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:22:28.941992 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76771e35-df42-47b2-a110-a225141aff8c None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:28.942280 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76771e35-df42-47b2-a110-a225141aff8c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:28.942561 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76771e35-df42-47b2-a110-a225141aff8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:29.015354 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-76771e35-df42-47b2-a110-a225141aff8c None None] MFA Rules not processed for user `2e2182e4d74047a399e7ffea63e7ce6e`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:22:29.016557 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-76771e35-df42-47b2-a110-a225141aff8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:29.089793 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 616/1222] 10.222.0.25 () {58 vars in 1062 bytes} [Fri Aug 27 01:22:28 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:22:29.099191 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a418306-bb25-4f5e-b5fe-81262c695e9a None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:22:29.100730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1a418306-bb25-4f5e-b5fe-81262c695e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:29.200926 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a418306-bb25-4f5e-b5fe-81262c695e9a None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:22:29.269128 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cefaa4-638c-472d-bc9f-0259503a503d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:22:29.269763 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cefaa4-638c-472d-bc9f-0259503a503d service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:29.270042 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cefaa4-638c-472d-bc9f-0259503a503d service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:29.270308 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cefaa4-638c-472d-bc9f-0259503a503d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:29.271909 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d1cefaa4-638c-472d-bc9f-0259503a503d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:29.377163 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cefaa4-638c-472d-bc9f-0259503a503d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:22:29.378866 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cefaa4-638c-472d-bc9f-0259503a503d service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:22:29.401283 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 607/1223] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:22:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:22:33.053715 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0babe3-b1b4-45b4-a62f-99e2c1726ac7 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:33.054255 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0babe3-b1b4-45b4-a62f-99e2c1726ac7 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:33.054255 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0babe3-b1b4-45b4-a62f-99e2c1726ac7 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:33.056000 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 617/1224] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:22:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:22:33.062481 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be73ec6-79a3-4b16-b08e-d072647e4a6e None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:33.062906 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be73ec6-79a3-4b16-b08e-d072647e4a6e None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:33.063041 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be73ec6-79a3-4b16-b08e-d072647e4a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:33.126156 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-4be73ec6-79a3-4b16-b08e-d072647e4a6e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:22:33.127375 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-4be73ec6-79a3-4b16-b08e-d072647e4a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:33.220123 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 608/1225] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:22:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:22:33.258418 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0babe3-b1b4-45b4-a62f-99e2c1726ac7 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:22:33.259962 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-4a0babe3-b1b4-45b4-a62f-99e2c1726ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:33.366714 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0babe3-b1b4-45b4-a62f-99e2c1726ac7 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:22:33.442115 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc1282-3aec-40bd-a505-f83b62cfda09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:22:33.442762 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc1282-3aec-40bd-a505-f83b62cfda09 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:33.443040 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc1282-3aec-40bd-a505-f83b62cfda09 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:33.443311 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc1282-3aec-40bd-a505-f83b62cfda09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:33.445283 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-08cc1282-3aec-40bd-a505-f83b62cfda09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:33.551946 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc1282-3aec-40bd-a505-f83b62cfda09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:22:33.553431 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc1282-3aec-40bd-a505-f83b62cfda09 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:22:33.572927 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 618/1226] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:22:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:22:35.761891 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b9544-8726-4322-ac45-320dcd1e535a None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:35.761891 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b9544-8726-4322-ac45-320dcd1e535a None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:35.762471 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b9544-8726-4322-ac45-320dcd1e535a None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:35.763945 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 609/1227] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:22:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:22:35.769775 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9902b-e80c-4218-a01e-e1a9d5234b0e None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:35.770198 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9902b-e80c-4218-a01e-e1a9d5234b0e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:35.770453 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9902b-e80c-4218-a01e-e1a9d5234b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:35.833588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-7bf9902b-e80c-4218-a01e-e1a9d5234b0e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:22:35.834776 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-7bf9902b-e80c-4218-a01e-e1a9d5234b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:35.930032 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 619/1228] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:22:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:22:35.967280 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b9544-8726-4322-ac45-320dcd1e535a None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:22:35.968822 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-714b9544-8726-4322-ac45-320dcd1e535a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:36.070372 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b9544-8726-4322-ac45-320dcd1e535a None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:22:36.140793 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6b8c7-a67a-4f3e-984a-6f147c79b98d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:22:36.141447 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6b8c7-a67a-4f3e-984a-6f147c79b98d service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:36.141726 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6b8c7-a67a-4f3e-984a-6f147c79b98d service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:36.141994 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6b8c7-a67a-4f3e-984a-6f147c79b98d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:36.143654 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-6cd6b8c7-a67a-4f3e-984a-6f147c79b98d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:36.246738 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6b8c7-a67a-4f3e-984a-6f147c79b98d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:22:36.248159 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6b8c7-a67a-4f3e-984a-6f147c79b98d service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:22:36.266741 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 610/1229] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:22:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:22:38.498480 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3a253-4e1b-41d0-9753-25c2f8e2c652 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:38.499033 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3a253-4e1b-41d0-9753-25c2f8e2c652 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:38.499033 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3a253-4e1b-41d0-9753-25c2f8e2c652 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:38.500804 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 620/1230] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:22:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:22:38.506845 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6c252-67ca-41b3-a10b-77641704bccc None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:38.507249 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6c252-67ca-41b3-a10b-77641704bccc None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:38.507469 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6c252-67ca-41b3-a10b-77641704bccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:38.571427 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-dca6c252-67ca-41b3-a10b-77641704bccc None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:22:38.572661 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-dca6c252-67ca-41b3-a10b-77641704bccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:38.667989 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 611/1231] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:22:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:22:38.701611 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3a253-4e1b-41d0-9753-25c2f8e2c652 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:22:38.703154 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-1af3a253-4e1b-41d0-9753-25c2f8e2c652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:38.828367 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3a253-4e1b-41d0-9753-25c2f8e2c652 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:22:38.920250 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bd37e-63d0-4683-8fa0-5403989095e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:22:38.921091 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd37e-63d0-4683-8fa0-5403989095e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:38.921377 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd37e-63d0-4683-8fa0-5403989095e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:38.921655 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd37e-63d0-4683-8fa0-5403989095e3 admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:38.931515 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bd37e-63d0-4683-8fa0-5403989095e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=966196fad6e9467e93b5762e459a1d84)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:22:38.933828 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bd37e-63d0-4683-8fa0-5403989095e3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:22:38.935677 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 621/1232] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:22:38 2021] GET /identity/v3/projects/966196fad6e9467e93b5762e459a1d84 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:22:38.948219 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6c252-67ca-41b3-a10b-77641704bccc None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:22:38.949566 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-dca6c252-67ca-41b3-a10b-77641704bccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:39.037853 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6c252-67ca-41b3-a10b-77641704bccc None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:22:39.108416 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54766cf6-1725-47c8-ae43-e3a6d420fd3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:22:39.109093 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54766cf6-1725-47c8-ae43-e3a6d420fd3a service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:39.109376 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54766cf6-1725-47c8-ae43-e3a6d420fd3a service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:39.109651 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54766cf6-1725-47c8-ae43-e3a6d420fd3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:39.111300 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-54766cf6-1725-47c8-ae43-e3a6d420fd3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:39.219074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54766cf6-1725-47c8-ae43-e3a6d420fd3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:22:39.220513 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54766cf6-1725-47c8-ae43-e3a6d420fd3a service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:22:39.238414 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 612/1233] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:22:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:22:41.929709 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46493d98-2d72-4b14-b332-953ab996f6e1 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:41.930261 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46493d98-2d72-4b14-b332-953ab996f6e1 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:41.930343 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46493d98-2d72-4b14-b332-953ab996f6e1 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:41.932052 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 622/1234] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:22:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:22:41.938109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82e7bf-4111-43b4-8ba3-453c12167d01 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:41.938544 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82e7bf-4111-43b4-8ba3-453c12167d01 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:41.938672 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82e7bf-4111-43b4-8ba3-453c12167d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:42.002119 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-5c82e7bf-4111-43b4-8ba3-453c12167d01 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:22:42.003311 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-5c82e7bf-4111-43b4-8ba3-453c12167d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:42.093841 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 613/1235] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:22:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:22:42.130801 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46493d98-2d72-4b14-b332-953ab996f6e1 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:22:42.132315 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-46493d98-2d72-4b14-b332-953ab996f6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:42.231736 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46493d98-2d72-4b14-b332-953ab996f6e1 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:22:42.300454 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3e635-5824-4136-a5a1-8bd4e155e11f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:22:42.301114 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3e635-5824-4136-a5a1-8bd4e155e11f service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:42.301391 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3e635-5824-4136-a5a1-8bd4e155e11f service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:42.301661 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3e635-5824-4136-a5a1-8bd4e155e11f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:42.303247 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-d0e3e635-5824-4136-a5a1-8bd4e155e11f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:42.406889 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e3e635-5824-4136-a5a1-8bd4e155e11f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:22:42.408325 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e3e635-5824-4136-a5a1-8bd4e155e11f service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:22:42.426909 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 623/1236] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:22:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:22:44.625908 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6bc0f-1bf3-42f9-9383-23f2b1de8f47 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:44.626395 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6bc0f-1bf3-42f9-9383-23f2b1de8f47 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:44.626485 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6bc0f-1bf3-42f9-9383-23f2b1de8f47 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:44.628221 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 614/1237] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:22:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:22:44.634192 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f077b2-5235-471d-b859-c968a547752e None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:44.634587 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f077b2-5235-471d-b859-c968a547752e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:44.634744 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f077b2-5235-471d-b859-c968a547752e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:44.698552 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f1f077b2-5235-471d-b859-c968a547752e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:22:44.699683 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f1f077b2-5235-471d-b859-c968a547752e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:44.795052 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 624/1238] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:22:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:22:44.836413 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6bc0f-1bf3-42f9-9383-23f2b1de8f47 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:22:44.837988 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-04a6bc0f-1bf3-42f9-9383-23f2b1de8f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:44.934937 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6bc0f-1bf3-42f9-9383-23f2b1de8f47 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:22:45.004355 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f53028-d234-4e18-8782-2e6301a7896a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:22:45.004949 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f53028-d234-4e18-8782-2e6301a7896a service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:45.005233 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f53028-d234-4e18-8782-2e6301a7896a service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:45.005508 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f53028-d234-4e18-8782-2e6301a7896a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:45.007115 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-14f53028-d234-4e18-8782-2e6301a7896a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:45.110406 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f53028-d234-4e18-8782-2e6301a7896a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:22:45.111832 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f53028-d234-4e18-8782-2e6301a7896a service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:22:45.128926 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 615/1239] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:22:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:22:47.877090 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35506670-87eb-4f6e-93a2-df5bfc81d303 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:47.877625 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35506670-87eb-4f6e-93a2-df5bfc81d303 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:47.877625 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35506670-87eb-4f6e-93a2-df5bfc81d303 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:47.879410 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 625/1240] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:22:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:22:47.885144 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acc117-64b5-4513-9822-fe8b937708f6 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:47.885516 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acc117-64b5-4513-9822-fe8b937708f6 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:47.885689 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acc117-64b5-4513-9822-fe8b937708f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:47.953401 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-92acc117-64b5-4513-9822-fe8b937708f6 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:22:47.954622 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-92acc117-64b5-4513-9822-fe8b937708f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:48.055178 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 616/1241] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:22:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:22:48.093617 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35506670-87eb-4f6e-93a2-df5bfc81d303 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:22:48.095745 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-35506670-87eb-4f6e-93a2-df5bfc81d303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:48.189976 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35506670-87eb-4f6e-93a2-df5bfc81d303 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:22:48.193539 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c95a4-ef3c-454f-9203-7d796198f006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:22:48.194444 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c95a4-ef3c-454f-9203-7d796198f006 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:48.194727 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c95a4-ef3c-454f-9203-7d796198f006 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:48.195005 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c95a4-ef3c-454f-9203-7d796198f006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:48.204650 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c95a4-ef3c-454f-9203-7d796198f006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:22:48.206106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c95a4-ef3c-454f-9203-7d796198f006 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:22:48.216103 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 626/1242] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:22:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:22:52.556751 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2d330-b858-4361-9e6f-36844a1dd3f0 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:52.557302 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2d330-b858-4361-9e6f-36844a1dd3f0 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:52.557390 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2d330-b858-4361-9e6f-36844a1dd3f0 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:52.559288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 617/1243] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:22:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:22:52.565168 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c9962-f32d-44a1-bb86-14a0046f292e None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:52.565599 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c9962-f32d-44a1-bb86-14a0046f292e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:52.565763 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c9962-f32d-44a1-bb86-14a0046f292e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:52.583642 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-2d2c9962-f32d-44a1-bb86-14a0046f292e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:22:52.584849 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-2d2c9962-f32d-44a1-bb86-14a0046f292e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:52.593347 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 627/1244] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:22:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:22:52.632652 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2d330-b858-4361-9e6f-36844a1dd3f0 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:22:52.634397 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1db2d330-b858-4361-9e6f-36844a1dd3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:52.647324 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2d330-b858-4361-9e6f-36844a1dd3f0 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:22:52.650882 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e235c9-e0c7-4707-ac4d-b1d33dc353bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:22:52.652025 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e235c9-e0c7-4707-ac4d-b1d33dc353bb service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:52.652298 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e235c9-e0c7-4707-ac4d-b1d33dc353bb service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:52.652566 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e235c9-e0c7-4707-ac4d-b1d33dc353bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:52.661310 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e235c9-e0c7-4707-ac4d-b1d33dc353bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:22:52.662725 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e235c9-e0c7-4707-ac4d-b1d33dc353bb service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:22:52.672469 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 618/1245] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:22:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:22:55.738057 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a21c28-123f-4df7-85c2-a886d45024f0 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:55.738571 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a21c28-123f-4df7-85c2-a886d45024f0 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:55.738571 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a21c28-123f-4df7-85c2-a886d45024f0 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:55.740302 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 628/1246] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:22:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:22:55.746396 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e87dfe-b2d7-44d5-a2b1-41e4a1838d38 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:55.746850 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e87dfe-b2d7-44d5-a2b1-41e4a1838d38 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:55.747000 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e87dfe-b2d7-44d5-a2b1-41e4a1838d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:55.764910 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b6e87dfe-b2d7-44d5-a2b1-41e4a1838d38 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:22:55.766120 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b6e87dfe-b2d7-44d5-a2b1-41e4a1838d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:22:55.774251 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 619/1247] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:22:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:22:55.813455 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a21c28-123f-4df7-85c2-a886d45024f0 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:22:55.825833 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a21c28-123f-4df7-85c2-a886d45024f0 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:22:55.829801 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d813e-017e-4f8c-b613-7ac7a73cfd71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:22:55.830586 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d813e-017e-4f8c-b613-7ac7a73cfd71 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:22:55.831042 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d813e-017e-4f8c-b613-7ac7a73cfd71 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:22:55.831390 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d813e-017e-4f8c-b613-7ac7a73cfd71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:22:55.842653 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d813e-017e-4f8c-b613-7ac7a73cfd71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:22:55.844244 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d813e-017e-4f8c-b613-7ac7a73cfd71 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:22:55.854935 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 629/1248] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:22:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:23:00.429799 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b1aeb-bab3-4dc5-9462-7cc79c503ea3 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:00.430356 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b1aeb-bab3-4dc5-9462-7cc79c503ea3 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:00.430356 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b1aeb-bab3-4dc5-9462-7cc79c503ea3 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:00.432565 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 620/1249] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:23:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:00.440396 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5b4d6-719e-4d2f-bd17-121db5d92a39 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:00.441363 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5b4d6-719e-4d2f-bd17-121db5d92a39 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:00.441363 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5b4d6-719e-4d2f-bd17-121db5d92a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:00.460562 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-01c5b4d6-719e-4d2f-bd17-121db5d92a39 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:00.461804 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-01c5b4d6-719e-4d2f-bd17-121db5d92a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:00.471050 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 630/1250] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:23:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:00.509969 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b1aeb-bab3-4dc5-9462-7cc79c503ea3 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:23:00.521453 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b1aeb-bab3-4dc5-9462-7cc79c503ea3 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:23:00.525196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffaf8f-2d2f-4cfc-8ec2-f323c716c2ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:23:00.525853 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffaf8f-2d2f-4cfc-8ec2-f323c716c2ff service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:00.526679 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffaf8f-2d2f-4cfc-8ec2-f323c716c2ff service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:00.527320 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffaf8f-2d2f-4cfc-8ec2-f323c716c2ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:00.536895 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffaf8f-2d2f-4cfc-8ec2-f323c716c2ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:23:00.538324 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffaf8f-2d2f-4cfc-8ec2-f323c716c2ff service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:23:00.550785 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 621/1251] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:23:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:23:05.717162 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78d49e-54d0-4d72-986f-02b96ea78f65 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:05.718066 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78d49e-54d0-4d72-986f-02b96ea78f65 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:05.718499 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78d49e-54d0-4d72-986f-02b96ea78f65 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:05.720905 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 631/1252] 10.222.0.25 () {54 vars in 921 bytes} [Fri Aug 27 01:23:05 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:05.727256 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe7496-5c06-4975-ac7d-215431ec3beb None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:05.728200 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe7496-5c06-4975-ac7d-215431ec3beb None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:05.728635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe7496-5c06-4975-ac7d-215431ec3beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:05.817380 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-c8fe7496-5c06-4975-ac7d-215431ec3beb None None] MFA Rules not processed for user `d67c0b68ca7349399d9ea9f4a0b2b564`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:05.819333 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-c8fe7496-5c06-4975-ac7d-215431ec3beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:05.951115 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 622/1253] 10.222.0.25 () {58 vars in 1019 bytes} [Fri Aug 27 01:23:05 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:10.294755 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaec2e6-2c8e-4eed-9e15-b2cf01655b0d None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:10.295264 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaec2e6-2c8e-4eed-9e15-b2cf01655b0d None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:10.295367 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaec2e6-2c8e-4eed-9e15-b2cf01655b0d None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:10.297166 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 632/1254] 10.222.0.25 () {54 vars in 921 bytes} [Fri Aug 27 01:23:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:10.302418 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94a133-0bdd-4a55-a43b-085e34426fb8 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:10.302846 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94a133-0bdd-4a55-a43b-085e34426fb8 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:10.302972 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94a133-0bdd-4a55-a43b-085e34426fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:10.322391 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-ef94a133-0bdd-4a55-a43b-085e34426fb8 None None] MFA Rules not processed for user `d67c0b68ca7349399d9ea9f4a0b2b564`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:10.323732 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ef94a133-0bdd-4a55-a43b-085e34426fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:10.332230 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 623/1255] 10.222.0.25 () {58 vars in 1019 bytes} [Fri Aug 27 01:23:10 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:11.878924 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a8878-ff35-496c-9c40-532b3c418f32 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:11.879498 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a8878-ff35-496c-9c40-532b3c418f32 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:11.879612 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a8878-ff35-496c-9c40-532b3c418f32 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:11.881542 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 633/1256] 10.222.0.25 () {54 vars in 921 bytes} [Fri Aug 27 01:23:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:11.887472 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdc0ae-8a88-4cba-ae96-6cd2a503fa94 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:11.887925 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdc0ae-8a88-4cba-ae96-6cd2a503fa94 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:11.888046 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdc0ae-8a88-4cba-ae96-6cd2a503fa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:11.907034 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-09bdc0ae-8a88-4cba-ae96-6cd2a503fa94 None None] MFA Rules not processed for user `d67c0b68ca7349399d9ea9f4a0b2b564`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:11.908274 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-09bdc0ae-8a88-4cba-ae96-6cd2a503fa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:11.917340 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 624/1257] 10.222.0.25 () {58 vars in 1019 bytes} [Fri Aug 27 01:23:11 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:15.651919 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd9991-a8a0-47b3-aa4a-b0c63ad2544d None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:15.652445 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd9991-a8a0-47b3-aa4a-b0c63ad2544d None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:15.652749 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd9991-a8a0-47b3-aa4a-b0c63ad2544d None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:15.654811 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 634/1258] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:23:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:15.660522 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593bac3-4d08-4bc4-8cf9-98fe0e90ab95 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:15.660951 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593bac3-4d08-4bc4-8cf9-98fe0e90ab95 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:15.661118 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593bac3-4d08-4bc4-8cf9-98fe0e90ab95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:15.679444 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-f593bac3-4d08-4bc4-8cf9-98fe0e90ab95 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:15.680636 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-f593bac3-4d08-4bc4-8cf9-98fe0e90ab95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:15.688992 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 625/1259] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:23:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:15.740381 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9ca8-d1ea-4761-a5aa-e0141bc7ace0 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:15.740677 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9ca8-d1ea-4761-a5aa-e0141bc7ace0 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:15.740984 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9ca8-d1ea-4761-a5aa-e0141bc7ace0 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:15.742725 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 635/1260] 10.222.0.25 () {54 vars in 961 bytes} [Fri Aug 27 01:23:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:15.749474 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfb974-cadb-497f-ab1c-51b62234c883 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:15.749836 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfb974-cadb-497f-ab1c-51b62234c883 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:15.750210 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfb974-cadb-497f-ab1c-51b62234c883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:15.801853 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-d6dfb974-cadb-497f-ab1c-51b62234c883 None None] MFA Rules not processed for user `249a7642a0284dde91a7719f732b2d70`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:15.803129 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d6dfb974-cadb-497f-ab1c-51b62234c883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:15.883329 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 626/1261] 10.222.0.25 () {58 vars in 1059 bytes} [Fri Aug 27 01:23:15 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:15.892287 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a9ca8-d1ea-4761-a5aa-e0141bc7ace0 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:23:15.909054 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a9ca8-d1ea-4761-a5aa-e0141bc7ace0 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:23:15.914498 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497f339-ad93-456b-8f8a-3f41b836158c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:23:15.915252 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497f339-ad93-456b-8f8a-3f41b836158c service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:15.915627 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497f339-ad93-456b-8f8a-3f41b836158c service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:15.916876 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497f339-ad93-456b-8f8a-3f41b836158c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:15.928895 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497f339-ad93-456b-8f8a-3f41b836158c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:23:15.930662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497f339-ad93-456b-8f8a-3f41b836158c service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:23:15.940775 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 636/1262] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:23:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:23:18.320576 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e00a8-f63f-4661-bd7b-0289555adc16 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:18.321153 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e00a8-f63f-4661-bd7b-0289555adc16 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:18.321153 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e00a8-f63f-4661-bd7b-0289555adc16 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:18.323420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 627/1263] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:23:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:18.330109 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0538de-abe9-4081-b5ee-1aa4903e130d None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:18.330674 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0538de-abe9-4081-b5ee-1aa4903e130d None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:18.330674 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0538de-abe9-4081-b5ee-1aa4903e130d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:18.351076 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-0e0538de-abe9-4081-b5ee-1aa4903e130d None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:18.352369 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-0e0538de-abe9-4081-b5ee-1aa4903e130d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:18.361620 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 637/1264] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:23:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:18.409223 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e00a8-f63f-4661-bd7b-0289555adc16 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:23:18.428574 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e00a8-f63f-4661-bd7b-0289555adc16 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:23:18.434784 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5aca9-9be4-4cea-8dae-116c5dffccab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:23:18.435426 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5aca9-9be4-4cea-8dae-116c5dffccab service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:18.435710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5aca9-9be4-4cea-8dae-116c5dffccab service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:18.435990 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5aca9-9be4-4cea-8dae-116c5dffccab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:18.444713 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5aca9-9be4-4cea-8dae-116c5dffccab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:23:18.446335 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5aca9-9be4-4cea-8dae-116c5dffccab service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:23:18.456092 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 628/1265] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:23:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:23:21.037529 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b21eb-1c9c-4977-b58a-69bdf65c7c3a None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:21.038023 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b21eb-1c9c-4977-b58a-69bdf65c7c3a None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:21.038023 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b21eb-1c9c-4977-b58a-69bdf65c7c3a None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:21.039754 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 638/1266] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:23:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:21.045846 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28449096-608d-4cff-8c61-797aba7ad265 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:21.046252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28449096-608d-4cff-8c61-797aba7ad265 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:21.046400 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28449096-608d-4cff-8c61-797aba7ad265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:21.064805 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-28449096-608d-4cff-8c61-797aba7ad265 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:21.066019 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-28449096-608d-4cff-8c61-797aba7ad265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:21.074724 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 629/1267] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:23:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:21.120655 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e4143-c518-4be9-be21-b579de34b5d4 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:21.120976 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e4143-c518-4be9-be21-b579de34b5d4 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:21.121256 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e4143-c518-4be9-be21-b579de34b5d4 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:21.123068 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 639/1268] 10.222.0.25 () {54 vars in 961 bytes} [Fri Aug 27 01:23:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:21.128642 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efe16a-5055-46a0-80dc-cf34ec550ba3 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:21.129122 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efe16a-5055-46a0-80dc-cf34ec550ba3 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:21.129544 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efe16a-5055-46a0-80dc-cf34ec550ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:21.148511 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-44efe16a-5055-46a0-80dc-cf34ec550ba3 None None] MFA Rules not processed for user `249a7642a0284dde91a7719f732b2d70`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:21.149724 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-44efe16a-5055-46a0-80dc-cf34ec550ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:21.159122 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 630/1269] 10.222.0.25 () {58 vars in 1059 bytes} [Fri Aug 27 01:23:21 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:21.167927 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e4143-c518-4be9-be21-b579de34b5d4 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:23:21.182655 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e4143-c518-4be9-be21-b579de34b5d4 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:23:21.188149 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f43cf0-bbdc-4096-b436-73427bfa7863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:23:21.188782 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f43cf0-bbdc-4096-b436-73427bfa7863 service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:21.189088 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f43cf0-bbdc-4096-b436-73427bfa7863 service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:21.189368 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f43cf0-bbdc-4096-b436-73427bfa7863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:21.198209 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f43cf0-bbdc-4096-b436-73427bfa7863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:23:21.199901 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f43cf0-bbdc-4096-b436-73427bfa7863 service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:23:21.209404 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 640/1270] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:23:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:23:23.579272 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a35f27-061b-48bf-88f5-02c29e0d6125 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:23.579811 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a35f27-061b-48bf-88f5-02c29e0d6125 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:23.579811 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a35f27-061b-48bf-88f5-02c29e0d6125 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:23.581601 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 631/1271] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:23:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:23.587591 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517084d-72a1-4f6f-bc36-f2beeee89aa1 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:23.588203 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517084d-72a1-4f6f-bc36-f2beeee89aa1 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:23.588203 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517084d-72a1-4f6f-bc36-f2beeee89aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:23.601509 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68820177-6db2-4462-a954-7e27264ff79d None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:23.602362 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68820177-6db2-4462-a954-7e27264ff79d None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:23.602863 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68820177-6db2-4462-a954-7e27264ff79d None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:23.606059 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 632/1272] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:23:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:23.606497 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-9517084d-72a1-4f6f-bc36-f2beeee89aa1 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:23.607695 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-9517084d-72a1-4f6f-bc36-f2beeee89aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:23.611635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee7023-5e8e-4a1e-85a4-ce772eeb2b1c None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:23.612524 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee7023-5e8e-4a1e-85a4-ce772eeb2b1c None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:23.613056 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee7023-5e8e-4a1e-85a4-ce772eeb2b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:23.615580 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 641/1273] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:23:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:23.632998 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-d0ee7023-5e8e-4a1e-85a4-ce772eeb2b1c None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:23.634547 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d0ee7023-5e8e-4a1e-85a4-ce772eeb2b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:23.643610 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 633/1274] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:23:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:23.671711 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19d405-cec6-43a1-8878-cc156b335358 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:23.671913 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19d405-cec6-43a1-8878-cc156b335358 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:23.672358 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19d405-cec6-43a1-8878-cc156b335358 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:23.674178 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 642/1275] 10.222.0.25 () {54 vars in 966 bytes} [Fri Aug 27 01:23:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:23.680893 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289449e-3c82-4580-9c2f-ef380c768aae None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:23.680893 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289449e-3c82-4580-9c2f-ef380c768aae None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:23.680893 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289449e-3c82-4580-9c2f-ef380c768aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:23.689360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19d405-cec6-43a1-8878-cc156b335358 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:23:23.704329 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19d405-cec6-43a1-8878-cc156b335358 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:23:23.710024 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fcf9c-73e2-4131-938e-6370f111952d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:23:23.710875 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fcf9c-73e2-4131-938e-6370f111952d service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:23.711010 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fcf9c-73e2-4131-938e-6370f111952d service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:23.711246 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fcf9c-73e2-4131-938e-6370f111952d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:23.720747 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fcf9c-73e2-4131-938e-6370f111952d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:23:23.722422 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fcf9c-73e2-4131-938e-6370f111952d service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:23:23.734916 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 643/1276] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:23:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:23:23.738909 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-1289449e-3c82-4580-9c2f-ef380c768aae None None] MFA Rules not processed for user `686fb610b1ac47388bffbcfdf8f15907`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:23.740136 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1289449e-3c82-4580-9c2f-ef380c768aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:23.803266 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 634/1277] 10.222.0.25 () {58 vars in 1064 bytes} [Fri Aug 27 01:23:23 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:23:23.812769 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fcf9c-73e2-4131-938e-6370f111952d service nova] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:23:23.821877 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fcf9c-73e2-4131-938e-6370f111952d service nova] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:23:23.826302 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf704f00-da33-45b1-90ea-7ad567c50b23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:23:23.826936 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf704f00-da33-45b1-90ea-7ad567c50b23 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:23.827224 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf704f00-da33-45b1-90ea-7ad567c50b23 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:23.827503 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf704f00-da33-45b1-90ea-7ad567c50b23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:23.836742 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf704f00-da33-45b1-90ea-7ad567c50b23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:23:23.839408 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf704f00-da33-45b1-90ea-7ad567c50b23 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:23:23.850711 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 644/1278] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:23:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:23:26.069415 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d0386-1ef3-4e03-8e72-8b274b4cc1c1 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:26.069899 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d0386-1ef3-4e03-8e72-8b274b4cc1c1 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:26.069989 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d0386-1ef3-4e03-8e72-8b274b4cc1c1 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:26.071729 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 635/1279] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:23:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:26.078034 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bd7a5-0353-4b85-8ee9-e598bc14e88c None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:26.087246 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bd7a5-0353-4b85-8ee9-e598bc14e88c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:26.087246 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bd7a5-0353-4b85-8ee9-e598bc14e88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:26.097471 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-eb7bd7a5-0353-4b85-8ee9-e598bc14e88c None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:26.098677 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-eb7bd7a5-0353-4b85-8ee9-e598bc14e88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:26.109070 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 645/1280] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:23:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:26.155462 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d0386-1ef3-4e03-8e72-8b274b4cc1c1 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:23:26.170402 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d0386-1ef3-4e03-8e72-8b274b4cc1c1 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:23:26.176150 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b705aa4-b13a-47c9-af90-26eb3c94cae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:23:26.176768 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b705aa4-b13a-47c9-af90-26eb3c94cae5 service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:26.177070 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b705aa4-b13a-47c9-af90-26eb3c94cae5 service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:26.177513 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b705aa4-b13a-47c9-af90-26eb3c94cae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:26.185776 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b705aa4-b13a-47c9-af90-26eb3c94cae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:23:26.187347 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b705aa4-b13a-47c9-af90-26eb3c94cae5 service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:23:26.198292 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 636/1281] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:23:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:23:28.549145 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d39bb6-1dcd-4afa-bd05-fab1c5c832ec None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:28.559598 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d39bb6-1dcd-4afa-bd05-fab1c5c832ec None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:28.559598 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d39bb6-1dcd-4afa-bd05-fab1c5c832ec None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:28.559598 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 646/1282] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:23:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:23:28.559853 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95362-20cb-4c31-ba4f-75d0bdf686df None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:28.559853 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95362-20cb-4c31-ba4f-75d0bdf686df None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:28.559853 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95362-20cb-4c31-ba4f-75d0bdf686df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:28.577763 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-09b95362-20cb-4c31-ba4f-75d0bdf686df None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:28.578964 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-09b95362-20cb-4c31-ba4f-75d0bdf686df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:28.586992 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 637/1283] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:23:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:28.634260 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d39bb6-1dcd-4afa-bd05-fab1c5c832ec None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:23:28.650988 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d39bb6-1dcd-4afa-bd05-fab1c5c832ec None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:23:28.656989 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca098dd-bb61-4497-9d91-c3ebd4e59d64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:23:28.657641 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca098dd-bb61-4497-9d91-c3ebd4e59d64 service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:28.657926 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca098dd-bb61-4497-9d91-c3ebd4e59d64 service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:28.658200 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca098dd-bb61-4497-9d91-c3ebd4e59d64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:28.668659 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca098dd-bb61-4497-9d91-c3ebd4e59d64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:23:28.670220 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca098dd-bb61-4497-9d91-c3ebd4e59d64 service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:23:28.680327 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 647/1284] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:23:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:23:31.037580 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330428b4-5c17-47d0-aff0-6c91ab734186 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:31.037993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330428b4-5c17-47d0-aff0-6c91ab734186 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:31.038314 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330428b4-5c17-47d0-aff0-6c91ab734186 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:31.039875 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 638/1285] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:23:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:31.048368 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261c4ca-2f21-4935-b6d5-7cc0e3bc1612 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:31.048812 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261c4ca-2f21-4935-b6d5-7cc0e3bc1612 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:31.049575 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261c4ca-2f21-4935-b6d5-7cc0e3bc1612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:31.084252 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f261c4ca-2f21-4935-b6d5-7cc0e3bc1612 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:31.087351 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f261c4ca-2f21-4935-b6d5-7cc0e3bc1612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:31.105419 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 648/1286] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:23:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:31.147862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330428b4-5c17-47d0-aff0-6c91ab734186 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:23:31.162167 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330428b4-5c17-47d0-aff0-6c91ab734186 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:23:31.168392 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053dbc8-e6ff-4390-8197-aad64959346e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:23:31.169090 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053dbc8-e6ff-4390-8197-aad64959346e service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:31.169375 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053dbc8-e6ff-4390-8197-aad64959346e service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:31.169649 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053dbc8-e6ff-4390-8197-aad64959346e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:31.178006 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053dbc8-e6ff-4390-8197-aad64959346e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:23:31.179588 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053dbc8-e6ff-4390-8197-aad64959346e service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:23:31.190505 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 639/1287] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:23:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:23:33.886082 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1009c0-b959-43de-8235-b297460449c1 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:33.886606 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1009c0-b959-43de-8235-b297460449c1 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:33.886606 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1009c0-b959-43de-8235-b297460449c1 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:33.888438 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 649/1288] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:23:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:23:33.894841 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd97c1-287a-492c-bf63-034ad57b1843 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:33.895274 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd97c1-287a-492c-bf63-034ad57b1843 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:33.895406 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd97c1-287a-492c-bf63-034ad57b1843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:33.914507 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-9ebd97c1-287a-492c-bf63-034ad57b1843 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:33.917096 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-9ebd97c1-287a-492c-bf63-034ad57b1843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:33.925050 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 640/1289] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:23:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:23:33.973605 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1009c0-b959-43de-8235-b297460449c1 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:23:33.988919 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1009c0-b959-43de-8235-b297460449c1 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:23:33.995331 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235061c7-3e99-49e4-a0e7-b90822205d28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:23:33.996003 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235061c7-3e99-49e4-a0e7-b90822205d28 service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:33.996301 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235061c7-3e99-49e4-a0e7-b90822205d28 service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:33.996592 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235061c7-3e99-49e4-a0e7-b90822205d28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:34.005245 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235061c7-3e99-49e4-a0e7-b90822205d28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:23:34.006895 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235061c7-3e99-49e4-a0e7-b90822205d28 service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:23:34.017688 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 650/1290] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:23:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:23:36.628230 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafabe4-ad53-40eb-b204-74aa93f1c455 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:36.628776 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafabe4-ad53-40eb-b204-74aa93f1c455 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:36.628957 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafabe4-ad53-40eb-b204-74aa93f1c455 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:36.631297 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 641/1291] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:23:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:36.639016 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2aa7ce-00ac-4864-93c6-4784d1f3adb1 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:36.639448 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2aa7ce-00ac-4864-93c6-4784d1f3adb1 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:36.639663 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2aa7ce-00ac-4864-93c6-4784d1f3adb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:36.659986 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-ae2aa7ce-00ac-4864-93c6-4784d1f3adb1 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:36.661395 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-ae2aa7ce-00ac-4864-93c6-4784d1f3adb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:36.670392 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 651/1292] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:23:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:36.720109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafabe4-ad53-40eb-b204-74aa93f1c455 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:23:36.734848 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafabe4-ad53-40eb-b204-74aa93f1c455 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:23:36.740447 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d287a2-a146-4bbf-8f61-0b1da14b0143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:23:36.741157 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d287a2-a146-4bbf-8f61-0b1da14b0143 service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:36.741405 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d287a2-a146-4bbf-8f61-0b1da14b0143 service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:36.741683 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d287a2-a146-4bbf-8f61-0b1da14b0143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:36.750525 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d287a2-a146-4bbf-8f61-0b1da14b0143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:23:36.752107 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d287a2-a146-4bbf-8f61-0b1da14b0143 service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:23:36.762211 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 642/1293] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:23:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:23:38.918158 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0c3c8-3683-4ff9-b0c8-bd4036e3dac5 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:38.918692 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0c3c8-3683-4ff9-b0c8-bd4036e3dac5 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:38.918809 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0c3c8-3683-4ff9-b0c8-bd4036e3dac5 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:38.920535 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 652/1294] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:23:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:38.926467 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95748440-b817-4131-be90-f4d0168f0618 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:38.927226 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95748440-b817-4131-be90-f4d0168f0618 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:38.927509 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95748440-b817-4131-be90-f4d0168f0618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:38.945632 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-95748440-b817-4131-be90-f4d0168f0618 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:38.947439 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-95748440-b817-4131-be90-f4d0168f0618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:38.962345 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 643/1295] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:23:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:39.020467 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e8792-9cff-4246-b14d-363f191cb092 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:39.020894 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e8792-9cff-4246-b14d-363f191cb092 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:39.021235 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e8792-9cff-4246-b14d-363f191cb092 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:39.023067 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 653/1296] 10.222.0.25 () {54 vars in 966 bytes} [Fri Aug 27 01:23:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:39.029055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1f658-d827-4fb4-8941-25fd086197b1 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:39.029344 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1f658-d827-4fb4-8941-25fd086197b1 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:39.029623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1f658-d827-4fb4-8941-25fd086197b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:39.055312 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1135f0-78d4-4373-b795-ac8f6e467f62 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:39.055784 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1135f0-78d4-4373-b795-ac8f6e467f62 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:39.056078 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1135f0-78d4-4373-b795-ac8f6e467f62 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:39.057993 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 654/1297] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:23:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:23:39.063571 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ab400-6064-4a8a-8801-c56655eb4a52 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:39.063857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ab400-6064-4a8a-8801-c56655eb4a52 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:39.064136 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ab400-6064-4a8a-8801-c56655eb4a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:39.078866 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-c4c1f658-d827-4fb4-8941-25fd086197b1 None None] MFA Rules not processed for user `a59679a5d71249fc8cd65fbcf84e7bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:39.080065 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-c4c1f658-d827-4fb4-8941-25fd086197b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:39.081564 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-327ab400-6064-4a8a-8801-c56655eb4a52 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:39.082714 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-327ab400-6064-4a8a-8801-c56655eb4a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:39.091086 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 655/1298] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:23:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:23:39.135954 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ab400-6064-4a8a-8801-c56655eb4a52 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:23:39.137838 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 644/1299] 10.222.0.25 () {58 vars in 1064 bytes} [Fri Aug 27 01:23:39 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:39.145531 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1f658-d827-4fb4-8941-25fd086197b1 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:23:39.148009 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ab400-6064-4a8a-8801-c56655eb4a52 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:23:39.153435 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1f658-d827-4fb4-8941-25fd086197b1 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:23:39.154028 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e9306-7521-495b-9d68-5d05b51273dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:23:39.154665 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e9306-7521-495b-9d68-5d05b51273dc service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:39.154947 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e9306-7521-495b-9d68-5d05b51273dc service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:39.155220 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e9306-7521-495b-9d68-5d05b51273dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:39.157064 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f2d87-5c15-49e0-94c6-e2a41ad78fc6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59679a5d71249fc8cd65fbcf84e7bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:23:39.157686 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f2d87-5c15-49e0-94c6-e2a41ad78fc6 service glance] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:39.157965 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f2d87-5c15-49e0-94c6-e2a41ad78fc6 service glance] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:39.158239 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f2d87-5c15-49e0-94c6-e2a41ad78fc6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:39.163320 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e9306-7521-495b-9d68-5d05b51273dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:23:39.165005 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e9306-7521-495b-9d68-5d05b51273dc service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:23:39.167644 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f2d87-5c15-49e0-94c6-e2a41ad78fc6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:23:39.169082 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f2d87-5c15-49e0-94c6-e2a41ad78fc6 service glance] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:23:39.174932 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 656/1300] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:23:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:23:39.178452 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 645/1301] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:23:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:23:39.764801 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b11f7-4808-4c22-8d9b-60e30fcd214a None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:39.765194 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b11f7-4808-4c22-8d9b-60e30fcd214a None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:39.765541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b11f7-4808-4c22-8d9b-60e30fcd214a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:39.813707 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-440b11f7-4808-4c22-8d9b-60e30fcd214a None None] MFA Rules not processed for user `3f65fb7e73db469f8b171c3126005427`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:39.814830 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-440b11f7-4808-4c22-8d9b-60e30fcd214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:39.877804 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 657/1302] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 01:23:39 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:39.921011 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caae866-a956-45a4-bd19-5b31bca525b9 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:39.921474 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caae866-a956-45a4-bd19-5b31bca525b9 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:39.921854 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caae866-a956-45a4-bd19-5b31bca525b9 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:39.923746 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 646/1303] 10.222.0.25 () {54 vars in 942 bytes} [Fri Aug 27 01:23:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:39.930468 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7460ab-b8c3-4be7-8c10-d1656b8c9a35 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:39.930929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7460ab-b8c3-4be7-8c10-d1656b8c9a35 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:39.931653 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7460ab-b8c3-4be7-8c10-d1656b8c9a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:39.980534 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-1b7460ab-b8c3-4be7-8c10-d1656b8c9a35 None None] MFA Rules not processed for user `d48536f4437240b79cf10961de9cc108`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:39.981758 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-1b7460ab-b8c3-4be7-8c10-d1656b8c9a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:40.051693 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 658/1304] 10.222.0.25 () {58 vars in 1040 bytes} [Fri Aug 27 01:23:39 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:40.061406 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caae866-a956-45a4-bd19-5b31bca525b9 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:23:40.075346 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caae866-a956-45a4-bd19-5b31bca525b9 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:23:40.080157 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe6c8e-2060-4568-9a09-ed20f2b1f45b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48536f4437240b79cf10961de9cc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:23:40.080818 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe6c8e-2060-4568-9a09-ed20f2b1f45b service swift] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:40.081132 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe6c8e-2060-4568-9a09-ed20f2b1f45b service swift] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:40.081429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe6c8e-2060-4568-9a09-ed20f2b1f45b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:40.089766 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe6c8e-2060-4568-9a09-ed20f2b1f45b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:23:40.091330 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe6c8e-2060-4568-9a09-ed20f2b1f45b service swift] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:23:40.099662 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 647/1305] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 01:23:40 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 01:23:41.518131 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff538fb0-becd-4d06-802a-482242b19972 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:41.519111 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff538fb0-becd-4d06-802a-482242b19972 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:41.519462 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff538fb0-becd-4d06-802a-482242b19972 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:41.521500 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 659/1306] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:23:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:41.528892 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088a253-ec06-4278-a9fe-d4709e05b833 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:41.528892 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088a253-ec06-4278-a9fe-d4709e05b833 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:41.529410 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088a253-ec06-4278-a9fe-d4709e05b833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:41.549273 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b088a253-ec06-4278-a9fe-d4709e05b833 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:41.551277 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b088a253-ec06-4278-a9fe-d4709e05b833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:41.559555 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 648/1307] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:23:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:41.605578 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff538fb0-becd-4d06-802a-482242b19972 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:23:41.621853 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff538fb0-becd-4d06-802a-482242b19972 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:23:41.627271 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d6f87-e63e-4209-92c5-1c1a8b80dd5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:23:41.627909 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d6f87-e63e-4209-92c5-1c1a8b80dd5c service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:41.628194 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d6f87-e63e-4209-92c5-1c1a8b80dd5c service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:41.628739 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d6f87-e63e-4209-92c5-1c1a8b80dd5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:41.637083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d6f87-e63e-4209-92c5-1c1a8b80dd5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:23:41.638732 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d6f87-e63e-4209-92c5-1c1a8b80dd5c service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:23:41.649990 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 660/1308] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:23:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:23:44.010752 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574206f-839d-4a89-9ff2-0c177b66d76f None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:44.011349 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574206f-839d-4a89-9ff2-0c177b66d76f None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:44.011349 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574206f-839d-4a89-9ff2-0c177b66d76f None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:44.013360 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 649/1309] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:23:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:44.019406 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec74173-13a3-4406-b812-4281bc54af8e None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:44.019866 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec74173-13a3-4406-b812-4281bc54af8e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:44.019982 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec74173-13a3-4406-b812-4281bc54af8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:44.038303 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-6ec74173-13a3-4406-b812-4281bc54af8e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:44.039504 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-6ec74173-13a3-4406-b812-4281bc54af8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:44.056874 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 661/1310] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:23:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:44.093819 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574206f-839d-4a89-9ff2-0c177b66d76f None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:23:44.110620 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574206f-839d-4a89-9ff2-0c177b66d76f None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:23:44.116152 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a5888-358a-4e23-9823-413a365f3121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:23:44.116875 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a5888-358a-4e23-9823-413a365f3121 service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:44.117161 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a5888-358a-4e23-9823-413a365f3121 service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:44.117437 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a5888-358a-4e23-9823-413a365f3121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:44.127016 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a5888-358a-4e23-9823-413a365f3121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:23:44.128816 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a5888-358a-4e23-9823-413a365f3121 service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:23:44.138871 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 650/1311] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:23:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:23:58.180327 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b8480-57db-4b03-83c7-9080fcfaa301 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:58.180935 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b8480-57db-4b03-83c7-9080fcfaa301 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:58.181047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b8480-57db-4b03-83c7-9080fcfaa301 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:58.182833 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 662/1312] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:23:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:23:58.189466 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96bf8b-df80-4c9b-a899-302edcecc233 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:58.189894 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96bf8b-df80-4c9b-a899-302edcecc233 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:58.190017 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96bf8b-df80-4c9b-a899-302edcecc233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:58.207499 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-5e96bf8b-df80-4c9b-a899-302edcecc233 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:23:58.208679 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-5e96bf8b-df80-4c9b-a899-302edcecc233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:23:58.216432 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 651/1313] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:23:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:23:58.242385 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b8480-57db-4b03-83c7-9080fcfaa301 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:23:58.255053 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b8480-57db-4b03-83c7-9080fcfaa301 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:23:58.259650 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32510af8-6b5d-41f6-8013-05b768321050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:23:58.260288 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32510af8-6b5d-41f6-8013-05b768321050 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:23:58.260569 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32510af8-6b5d-41f6-8013-05b768321050 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:23:58.260862 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32510af8-6b5d-41f6-8013-05b768321050 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:23:58.261595 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32510af8-6b5d-41f6-8013-05b768321050 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:23:58.263439 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32510af8-6b5d-41f6-8013-05b768321050 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:23:58.282138 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 663/1314] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 01:23:58 2021] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:24:00.406761 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f184016-ffec-4bcd-bec2-eb0f82c4e3ce None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:00.407327 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f184016-ffec-4bcd-bec2-eb0f82c4e3ce None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:00.407327 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f184016-ffec-4bcd-bec2-eb0f82c4e3ce None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:00.409123 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 652/1315] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:24:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:00.415162 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d97a37-e6d1-40d1-a009-8f13aafc4c10 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:00.417277 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d97a37-e6d1-40d1-a009-8f13aafc4c10 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:00.417277 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d97a37-e6d1-40d1-a009-8f13aafc4c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:00.433889 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-a7d97a37-e6d1-40d1-a009-8f13aafc4c10 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:00.435096 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a7d97a37-e6d1-40d1-a009-8f13aafc4c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:00.443177 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 664/1316] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:24:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:00.469100 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f184016-ffec-4bcd-bec2-eb0f82c4e3ce None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:00.481571 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f184016-ffec-4bcd-bec2-eb0f82c4e3ce None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:00.485953 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a54c3e-0957-40a8-8b13-5e125a44ed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:00.486784 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a54c3e-0957-40a8-8b13-5e125a44ed0b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:00.487066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a54c3e-0957-40a8-8b13-5e125a44ed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:00.487341 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a54c3e-0957-40a8-8b13-5e125a44ed0b admin admin] PATH_INFO: `/v3/projects/2094d4b288d94b69a3989eda8c1f1660` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:00.497746 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a54c3e-0957-40a8-8b13-5e125a44ed0b admin admin] RBAC: Authorizing `identity:get_project(project_id=2094d4b288d94b69a3989eda8c1f1660)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:00.499823 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a54c3e-0957-40a8-8b13-5e125a44ed0b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:00.502571 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 653/1317] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:24:00 2021] GET /identity/v3/projects/2094d4b288d94b69a3989eda8c1f1660 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:24:00.508122 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d97a37-e6d1-40d1-a009-8f13aafc4c10 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:00.518249 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d97a37-e6d1-40d1-a009-8f13aafc4c10 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:00.523006 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc10be-b3a9-48cf-b620-02b09bd99975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:00.523639 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc10be-b3a9-48cf-b620-02b09bd99975 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:00.524588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc10be-b3a9-48cf-b620-02b09bd99975 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:00.524888 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc10be-b3a9-48cf-b620-02b09bd99975 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:00.525643 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc10be-b3a9-48cf-b620-02b09bd99975 admin admin] RBAC: Adding query filter params (scope.project.id=2094d4b288d94b69a3989eda8c1f1660) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:24:00.525945 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc10be-b3a9-48cf-b620-02b09bd99975 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:00.528273 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc10be-b3a9-48cf-b620-02b09bd99975 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:00.537145 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 665/1318] 10.222.0.25 () {56 vars in 1232 bytes} [Fri Aug 27 01:24:00 2021] GET /identity/v3/role_assignments?scope.project.id=2094d4b288d94b69a3989eda8c1f1660 => generated 1934 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:24:00.547398 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a54c3e-0957-40a8-8b13-5e125a44ed0b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:00.558191 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a54c3e-0957-40a8-8b13-5e125a44ed0b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:00.564507 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab29bf3-b46e-4bf6-9974-62045122e9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:00.565626 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab29bf3-b46e-4bf6-9974-62045122e9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:00.565911 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab29bf3-b46e-4bf6-9974-62045122e9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:00.566180 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab29bf3-b46e-4bf6-9974-62045122e9a7 admin admin] PATH_INFO: `/v3/users/2a86b090883647269b0da4a4ef5fc47b` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:00.582110 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab29bf3-b46e-4bf6-9974-62045122e9a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a86b090883647269b0da4a4ef5fc47b)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:00.584246 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab29bf3-b46e-4bf6-9974-62045122e9a7 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:00.585995 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 654/1319] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:24:00 2021] GET /identity/v3/users/2a86b090883647269b0da4a4ef5fc47b => generated 283 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:24:00.596167 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc10be-b3a9-48cf-b620-02b09bd99975 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:00.607533 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc10be-b3a9-48cf-b620-02b09bd99975 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:00.613932 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe51492-3aa1-400d-aec5-2c3817e5eef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:00.615403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe51492-3aa1-400d-aec5-2c3817e5eef9 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:00.615678 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe51492-3aa1-400d-aec5-2c3817e5eef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:00.615946 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe51492-3aa1-400d-aec5-2c3817e5eef9 admin admin] PATH_INFO: `/v3/users/d64df7fb530c43779ba7cb0d2f2adf99` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:00.617192 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe51492-3aa1-400d-aec5-2c3817e5eef9 admin admin] RBAC: Authorizing `identity:get_user(user_id=d64df7fb530c43779ba7cb0d2f2adf99)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:00.619638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe51492-3aa1-400d-aec5-2c3817e5eef9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:00.621678 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 666/1320] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:24:00 2021] GET /identity/v3/users/d64df7fb530c43779ba7cb0d2f2adf99 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:24:02.923722 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c74e97-5119-4f51-8590-ffc26b442153 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:02.924272 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c74e97-5119-4f51-8590-ffc26b442153 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:02.924272 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c74e97-5119-4f51-8590-ffc26b442153 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:02.926039 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 655/1321] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:24:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:02.932273 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422a6e5-a74a-4547-be05-bc67227d3efe None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:02.932711 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422a6e5-a74a-4547-be05-bc67227d3efe None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:02.932812 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422a6e5-a74a-4547-be05-bc67227d3efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:02.950388 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-3422a6e5-a74a-4547-be05-bc67227d3efe None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:02.951562 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-3422a6e5-a74a-4547-be05-bc67227d3efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:02.959152 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 667/1322] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:24:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:02.982653 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c74e97-5119-4f51-8590-ffc26b442153 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:02.995335 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c74e97-5119-4f51-8590-ffc26b442153 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:02.999684 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4684031-1ada-430a-98f5-8234490a4eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:03.000511 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4684031-1ada-430a-98f5-8234490a4eee admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:03.000789 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4684031-1ada-430a-98f5-8234490a4eee admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:03.001087 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4684031-1ada-430a-98f5-8234490a4eee admin admin] PATH_INFO: `/v3/projects/4d40529491f64b6885c9f369c5354d38` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:03.011865 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4684031-1ada-430a-98f5-8234490a4eee admin admin] RBAC: Authorizing `identity:get_project(project_id=4d40529491f64b6885c9f369c5354d38)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:03.013926 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4684031-1ada-430a-98f5-8234490a4eee admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:03.015572 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 656/1323] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:24:02 2021] GET /identity/v3/projects/4d40529491f64b6885c9f369c5354d38 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:24:03.022208 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422a6e5-a74a-4547-be05-bc67227d3efe None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:03.032780 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422a6e5-a74a-4547-be05-bc67227d3efe None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:03.038405 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be815f1b-3f26-46d9-b919-bdc0a344afa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:03.039113 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be815f1b-3f26-46d9-b919-bdc0a344afa5 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:03.039327 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be815f1b-3f26-46d9-b919-bdc0a344afa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:03.039790 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be815f1b-3f26-46d9-b919-bdc0a344afa5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:03.040664 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be815f1b-3f26-46d9-b919-bdc0a344afa5 admin admin] RBAC: Adding query filter params (scope.project.id=4d40529491f64b6885c9f369c5354d38) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:24:03.040998 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be815f1b-3f26-46d9-b919-bdc0a344afa5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:03.042842 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be815f1b-3f26-46d9-b919-bdc0a344afa5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:03.049198 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 668/1324] 10.222.0.25 () {56 vars in 1232 bytes} [Fri Aug 27 01:24:03 2021] GET /identity/v3/role_assignments?scope.project.id=4d40529491f64b6885c9f369c5354d38 => generated 526 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:24:03.056264 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4684031-1ada-430a-98f5-8234490a4eee admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:03.065857 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4684031-1ada-430a-98f5-8234490a4eee admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:03.070653 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b206d06-8930-4f1b-b9d5-bbfa1fca66dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:03.072063 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b206d06-8930-4f1b-b9d5-bbfa1fca66dc admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:03.072340 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b206d06-8930-4f1b-b9d5-bbfa1fca66dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:03.072608 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b206d06-8930-4f1b-b9d5-bbfa1fca66dc admin admin] PATH_INFO: `/v3/users/de5afdccf21c44b79c47bb7fe4609104` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:03.085582 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b206d06-8930-4f1b-b9d5-bbfa1fca66dc admin admin] RBAC: Authorizing `identity:get_user(user_id=de5afdccf21c44b79c47bb7fe4609104)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:03.088032 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b206d06-8930-4f1b-b9d5-bbfa1fca66dc admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:03.089675 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 657/1325] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:24:03 2021] GET /identity/v3/users/de5afdccf21c44b79c47bb7fe4609104 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:24:05.256434 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd951468-1ca5-41bc-88df-ba992e311af8 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:05.257005 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd951468-1ca5-41bc-88df-ba992e311af8 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:05.257005 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd951468-1ca5-41bc-88df-ba992e311af8 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:05.259547 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 669/1326] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:24:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:05.265867 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc19f1-e36d-4cd1-b581-6152b2b8c755 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:05.266348 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc19f1-e36d-4cd1-b581-6152b2b8c755 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:05.266659 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc19f1-e36d-4cd1-b581-6152b2b8c755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:05.283952 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-80cc19f1-e36d-4cd1-b581-6152b2b8c755 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:05.285178 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-80cc19f1-e36d-4cd1-b581-6152b2b8c755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:05.293203 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 658/1327] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:24:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:05.317269 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd951468-1ca5-41bc-88df-ba992e311af8 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:05.330001 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd951468-1ca5-41bc-88df-ba992e311af8 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:05.334326 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01507a47-7c80-4033-bb9c-120b36b6794e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:05.335153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01507a47-7c80-4033-bb9c-120b36b6794e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:05.335430 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01507a47-7c80-4033-bb9c-120b36b6794e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:05.335699 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01507a47-7c80-4033-bb9c-120b36b6794e admin admin] PATH_INFO: `/v3/projects/966196fad6e9467e93b5762e459a1d84` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:05.346071 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01507a47-7c80-4033-bb9c-120b36b6794e admin admin] RBAC: Authorizing `identity:get_project(project_id=966196fad6e9467e93b5762e459a1d84)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:05.348116 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01507a47-7c80-4033-bb9c-120b36b6794e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:05.349792 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 670/1328] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:24:05 2021] GET /identity/v3/projects/966196fad6e9467e93b5762e459a1d84 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:24:05.356461 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc19f1-e36d-4cd1-b581-6152b2b8c755 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:05.365321 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc19f1-e36d-4cd1-b581-6152b2b8c755 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:05.370542 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13c959-9746-491b-b608-9a5a36a3127e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:05.371176 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13c959-9746-491b-b608-9a5a36a3127e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:05.371458 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13c959-9746-491b-b608-9a5a36a3127e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:05.371734 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13c959-9746-491b-b608-9a5a36a3127e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:05.372486 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13c959-9746-491b-b608-9a5a36a3127e admin admin] RBAC: Adding query filter params (scope.project.id=966196fad6e9467e93b5762e459a1d84) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:24:05.372794 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13c959-9746-491b-b608-9a5a36a3127e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:05.374642 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13c959-9746-491b-b608-9a5a36a3127e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:05.382086 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 659/1329] 10.222.0.25 () {56 vars in 1232 bytes} [Fri Aug 27 01:24:05 2021] GET /identity/v3/role_assignments?scope.project.id=966196fad6e9467e93b5762e459a1d84 => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:24:05.389075 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01507a47-7c80-4033-bb9c-120b36b6794e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:05.398623 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01507a47-7c80-4033-bb9c-120b36b6794e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:05.403204 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac932383-0ce4-4eb1-8b65-5f23c4decdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:05.404074 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac932383-0ce4-4eb1-8b65-5f23c4decdee admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:05.404350 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac932383-0ce4-4eb1-8b65-5f23c4decdee admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:05.404623 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac932383-0ce4-4eb1-8b65-5f23c4decdee admin admin] PATH_INFO: `/v3/users/690677d9b18f42639d78f5d0dd911adc` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:05.423033 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac932383-0ce4-4eb1-8b65-5f23c4decdee admin admin] RBAC: Authorizing `identity:get_user(user_id=690677d9b18f42639d78f5d0dd911adc)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:05.423033 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac932383-0ce4-4eb1-8b65-5f23c4decdee admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:05.423638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 671/1330] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:24:05 2021] GET /identity/v3/users/690677d9b18f42639d78f5d0dd911adc => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:24:05.430640 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13c959-9746-491b-b608-9a5a36a3127e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:05.442218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13c959-9746-491b-b608-9a5a36a3127e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:05.449688 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce195833-6463-47d0-9e9f-2cd012b86236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:05.450560 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce195833-6463-47d0-9e9f-2cd012b86236 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:05.451690 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce195833-6463-47d0-9e9f-2cd012b86236 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:05.451690 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce195833-6463-47d0-9e9f-2cd012b86236 admin admin] PATH_INFO: `/v3/users/d64df7fb530c43779ba7cb0d2f2adf99` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:05.452312 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce195833-6463-47d0-9e9f-2cd012b86236 admin admin] RBAC: Authorizing `identity:get_user(user_id=d64df7fb530c43779ba7cb0d2f2adf99)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:05.454152 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce195833-6463-47d0-9e9f-2cd012b86236 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:05.455834 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 660/1331] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:24:05 2021] GET /identity/v3/users/d64df7fb530c43779ba7cb0d2f2adf99 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:24:07.655199 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c252f-a30b-4088-8905-68733ef1b656 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:07.655764 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c252f-a30b-4088-8905-68733ef1b656 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:07.655764 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c252f-a30b-4088-8905-68733ef1b656 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:07.657547 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 672/1332] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:24:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:07.663226 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa689891-5048-4f2d-a3cf-59261211cf58 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:07.663660 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa689891-5048-4f2d-a3cf-59261211cf58 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:07.663785 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa689891-5048-4f2d-a3cf-59261211cf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:07.681787 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-fa689891-5048-4f2d-a3cf-59261211cf58 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:07.682904 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-fa689891-5048-4f2d-a3cf-59261211cf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:07.690577 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 661/1333] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:24:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:07.715570 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c252f-a30b-4088-8905-68733ef1b656 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:07.727827 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c252f-a30b-4088-8905-68733ef1b656 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:07.732192 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045566c3-a7b2-4501-9da6-303d114095bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:07.733046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045566c3-a7b2-4501-9da6-303d114095bd admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:07.733326 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045566c3-a7b2-4501-9da6-303d114095bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:07.733599 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045566c3-a7b2-4501-9da6-303d114095bd admin admin] PATH_INFO: `/v3/projects/d00d6d9d61694b048193e6e899572083` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:07.744241 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045566c3-a7b2-4501-9da6-303d114095bd admin admin] RBAC: Authorizing `identity:get_project(project_id=d00d6d9d61694b048193e6e899572083)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:07.746302 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045566c3-a7b2-4501-9da6-303d114095bd admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:07.747949 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 673/1334] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:24:07 2021] GET /identity/v3/projects/d00d6d9d61694b048193e6e899572083 => generated 361 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:24:07.754324 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa689891-5048-4f2d-a3cf-59261211cf58 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:07.763721 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa689891-5048-4f2d-a3cf-59261211cf58 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:07.768241 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906b947-4ba6-493a-a0ae-e85db3f20638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:07.768917 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906b947-4ba6-493a-a0ae-e85db3f20638 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:07.769191 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906b947-4ba6-493a-a0ae-e85db3f20638 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:07.769464 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906b947-4ba6-493a-a0ae-e85db3f20638 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:07.770218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906b947-4ba6-493a-a0ae-e85db3f20638 admin admin] RBAC: Adding query filter params (scope.project.id=d00d6d9d61694b048193e6e899572083) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:24:07.770521 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906b947-4ba6-493a-a0ae-e85db3f20638 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:07.772337 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906b947-4ba6-493a-a0ae-e85db3f20638 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:07.778418 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 662/1335] 10.222.0.25 () {56 vars in 1232 bytes} [Fri Aug 27 01:24:07 2021] GET /identity/v3/role_assignments?scope.project.id=d00d6d9d61694b048193e6e899572083 => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:24:07.784455 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045566c3-a7b2-4501-9da6-303d114095bd admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:07.794073 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045566c3-a7b2-4501-9da6-303d114095bd admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:07.798697 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c4008-3f75-4e86-aefd-e7f429cd65a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:07.799535 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c4008-3f75-4e86-aefd-e7f429cd65a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:07.799813 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c4008-3f75-4e86-aefd-e7f429cd65a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:07.800088 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c4008-3f75-4e86-aefd-e7f429cd65a5 admin admin] PATH_INFO: `/v3/users/8bafb4448db34581ba42bfaebce2cec6` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:07.813688 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c4008-3f75-4e86-aefd-e7f429cd65a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=8bafb4448db34581ba42bfaebce2cec6)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:07.815794 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c4008-3f75-4e86-aefd-e7f429cd65a5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:07.817675 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 674/1336] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:24:07 2021] GET /identity/v3/users/8bafb4448db34581ba42bfaebce2cec6 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:24:09.964172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792eb57-e603-4816-ba7b-f2d6dc749605 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:09.964708 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792eb57-e603-4816-ba7b-f2d6dc749605 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:09.964708 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792eb57-e603-4816-ba7b-f2d6dc749605 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:09.966526 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 663/1337] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:24:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:09.972342 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e0180-ca1d-4a7f-82b6-c94f8f0701e5 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:09.973116 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e0180-ca1d-4a7f-82b6-c94f8f0701e5 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:09.973399 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e0180-ca1d-4a7f-82b6-c94f8f0701e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:09.990539 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-074e0180-ca1d-4a7f-82b6-c94f8f0701e5 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:09.991725 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-074e0180-ca1d-4a7f-82b6-c94f8f0701e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:09.999355 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 675/1338] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:24:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:10.023350 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792eb57-e603-4816-ba7b-f2d6dc749605 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:10.036232 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792eb57-e603-4816-ba7b-f2d6dc749605 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:10.040823 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96350a-a411-4238-9f5a-18c0a9623eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:10.041675 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96350a-a411-4238-9f5a-18c0a9623eff admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:10.041952 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96350a-a411-4238-9f5a-18c0a9623eff admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:10.042224 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96350a-a411-4238-9f5a-18c0a9623eff admin admin] PATH_INFO: `/v3/projects/e9904079a3e94900bd545a99cd672ff0` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:10.043407 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96350a-a411-4238-9f5a-18c0a9623eff admin admin] RBAC: Authorizing `identity:get_project(project_id=e9904079a3e94900bd545a99cd672ff0)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:10.045205 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96350a-a411-4238-9f5a-18c0a9623eff admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:10.046839 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 664/1339] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:24:10 2021] GET /identity/v3/projects/e9904079a3e94900bd545a99cd672ff0 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:24:10.053153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e0180-ca1d-4a7f-82b6-c94f8f0701e5 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:10.062024 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e0180-ca1d-4a7f-82b6-c94f8f0701e5 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:10.066500 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc51db0-e312-4a5e-a13b-2b1cd80398c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:10.067390 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc51db0-e312-4a5e-a13b-2b1cd80398c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:10.067670 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc51db0-e312-4a5e-a13b-2b1cd80398c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:10.067944 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc51db0-e312-4a5e-a13b-2b1cd80398c6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:10.068693 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc51db0-e312-4a5e-a13b-2b1cd80398c6 admin admin] RBAC: Adding query filter params (scope.project.id=e9904079a3e94900bd545a99cd672ff0) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:24:10.069036 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc51db0-e312-4a5e-a13b-2b1cd80398c6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:10.071399 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc51db0-e312-4a5e-a13b-2b1cd80398c6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:10.076941 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 676/1340] 10.222.0.25 () {56 vars in 1232 bytes} [Fri Aug 27 01:24:10 2021] GET /identity/v3/role_assignments?scope.project.id=e9904079a3e94900bd545a99cd672ff0 => generated 879 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:24:10.082757 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96350a-a411-4238-9f5a-18c0a9623eff admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:10.092522 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96350a-a411-4238-9f5a-18c0a9623eff admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:10.097135 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9a6a9-d8c5-4073-a074-cca12a4fd21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:10.097973 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9a6a9-d8c5-4073-a074-cca12a4fd21f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:10.098252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9a6a9-d8c5-4073-a074-cca12a4fd21f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:10.098525 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9a6a9-d8c5-4073-a074-cca12a4fd21f admin admin] PATH_INFO: `/v3/users/d64df7fb530c43779ba7cb0d2f2adf99` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:10.099699 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9a6a9-d8c5-4073-a074-cca12a4fd21f admin admin] RBAC: Authorizing `identity:get_user(user_id=d64df7fb530c43779ba7cb0d2f2adf99)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:10.101502 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9a6a9-d8c5-4073-a074-cca12a4fd21f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:10.103668 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 665/1341] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:24:10 2021] GET /identity/v3/users/d64df7fb530c43779ba7cb0d2f2adf99 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:24:12.237479 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfa3df-b52d-40b2-9dff-94cb5604c1e4 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:12.238121 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfa3df-b52d-40b2-9dff-94cb5604c1e4 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:12.238121 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfa3df-b52d-40b2-9dff-94cb5604c1e4 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:12.239778 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 677/1342] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:24:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:12.245723 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce49a18-4916-4e45-aab6-eaf48e5e0a59 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:12.246153 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce49a18-4916-4e45-aab6-eaf48e5e0a59 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:12.246282 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce49a18-4916-4e45-aab6-eaf48e5e0a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:12.264539 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-dce49a18-4916-4e45-aab6-eaf48e5e0a59 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:12.265768 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-dce49a18-4916-4e45-aab6-eaf48e5e0a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:12.274052 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 666/1343] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:24:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:24:12.297418 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfa3df-b52d-40b2-9dff-94cb5604c1e4 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:12.309673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfa3df-b52d-40b2-9dff-94cb5604c1e4 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:12.314321 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca0af4-c1de-4aab-8884-138d89a325ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:12.315176 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca0af4-c1de-4aab-8884-138d89a325ef admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:12.315453 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca0af4-c1de-4aab-8884-138d89a325ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:12.315725 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca0af4-c1de-4aab-8884-138d89a325ef admin admin] PATH_INFO: `/v3/projects/ef38c7434f314bc8a24b592fc7de21d5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:12.327159 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca0af4-c1de-4aab-8884-138d89a325ef admin admin] RBAC: Authorizing `identity:get_project(project_id=ef38c7434f314bc8a24b592fc7de21d5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:12.329232 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca0af4-c1de-4aab-8884-138d89a325ef admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:12.330938 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 678/1344] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:24:12 2021] GET /identity/v3/projects/ef38c7434f314bc8a24b592fc7de21d5 => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:24:12.338105 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce49a18-4916-4e45-aab6-eaf48e5e0a59 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:12.347129 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce49a18-4916-4e45-aab6-eaf48e5e0a59 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:12.353595 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff058a-979b-4f14-8f15-5fc8d81096cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:12.354237 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff058a-979b-4f14-8f15-5fc8d81096cc admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:12.354517 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff058a-979b-4f14-8f15-5fc8d81096cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:12.354790 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff058a-979b-4f14-8f15-5fc8d81096cc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:12.355570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff058a-979b-4f14-8f15-5fc8d81096cc admin admin] RBAC: Adding query filter params (scope.project.id=ef38c7434f314bc8a24b592fc7de21d5) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:24:12.355869 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff058a-979b-4f14-8f15-5fc8d81096cc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:12.357749 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff058a-979b-4f14-8f15-5fc8d81096cc admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:12.363062 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 667/1345] 10.222.0.25 () {56 vars in 1232 bytes} [Fri Aug 27 01:24:12 2021] GET /identity/v3/role_assignments?scope.project.id=ef38c7434f314bc8a24b592fc7de21d5 => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:24:12.369927 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca0af4-c1de-4aab-8884-138d89a325ef admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:12.379507 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca0af4-c1de-4aab-8884-138d89a325ef admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:12.384378 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5307e-d260-4178-baa7-d84d04fb57e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:12.385292 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5307e-d260-4178-baa7-d84d04fb57e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:12.385571 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5307e-d260-4178-baa7-d84d04fb57e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:12.385844 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5307e-d260-4178-baa7-d84d04fb57e5 admin admin] PATH_INFO: `/v3/users/690677d9b18f42639d78f5d0dd911adc` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:12.387047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5307e-d260-4178-baa7-d84d04fb57e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=690677d9b18f42639d78f5d0dd911adc)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:12.389168 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5307e-d260-4178-baa7-d84d04fb57e5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:12.390769 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 679/1346] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:24:12 2021] GET /identity/v3/users/690677d9b18f42639d78f5d0dd911adc => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:24:14.559831 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc50a4-4a4a-4ea9-a44b-55ffb1a0d797 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:14.560440 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc50a4-4a4a-4ea9-a44b-55ffb1a0d797 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:14.560440 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc50a4-4a4a-4ea9-a44b-55ffb1a0d797 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:14.562165 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 668/1347] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:24:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:14.568372 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25992fdb-3bf1-44f8-b41c-060934fd9d03 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:14.568849 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25992fdb-3bf1-44f8-b41c-060934fd9d03 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:14.575074 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25992fdb-3bf1-44f8-b41c-060934fd9d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:14.587232 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-25992fdb-3bf1-44f8-b41c-060934fd9d03 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:14.588430 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-25992fdb-3bf1-44f8-b41c-060934fd9d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:14.596184 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 680/1348] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:24:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:14.630971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc50a4-4a4a-4ea9-a44b-55ffb1a0d797 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:14.633388 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc50a4-4a4a-4ea9-a44b-55ffb1a0d797 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:14.637977 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc03d5b-fd16-4929-9eda-2a3a1f734659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:14.638815 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc03d5b-fd16-4929-9eda-2a3a1f734659 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:14.639096 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc03d5b-fd16-4929-9eda-2a3a1f734659 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:14.639371 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc03d5b-fd16-4929-9eda-2a3a1f734659 admin admin] PATH_INFO: `/v3/projects/feae8c164c6644db9ef9f226680b6513` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:14.649780 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc03d5b-fd16-4929-9eda-2a3a1f734659 admin admin] RBAC: Authorizing `identity:get_project(project_id=feae8c164c6644db9ef9f226680b6513)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:14.651818 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc03d5b-fd16-4929-9eda-2a3a1f734659 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:14.653566 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 669/1349] 10.222.0.25 () {56 vars in 1208 bytes} [Fri Aug 27 01:24:14 2021] GET /identity/v3/projects/feae8c164c6644db9ef9f226680b6513 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:24:14.660151 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25992fdb-3bf1-44f8-b41c-060934fd9d03 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:14.669892 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25992fdb-3bf1-44f8-b41c-060934fd9d03 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:14.674373 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8570e84-f617-45a9-bef1-7d8f01250bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:14.675016 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8570e84-f617-45a9-bef1-7d8f01250bce admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:14.675298 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8570e84-f617-45a9-bef1-7d8f01250bce admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:14.675573 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8570e84-f617-45a9-bef1-7d8f01250bce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:14.676359 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8570e84-f617-45a9-bef1-7d8f01250bce admin admin] RBAC: Adding query filter params (scope.project.id=feae8c164c6644db9ef9f226680b6513) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:24:14.676663 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8570e84-f617-45a9-bef1-7d8f01250bce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:14.678524 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8570e84-f617-45a9-bef1-7d8f01250bce admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:14.684782 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 681/1350] 10.222.0.25 () {56 vars in 1232 bytes} [Fri Aug 27 01:24:14 2021] GET /identity/v3/role_assignments?scope.project.id=feae8c164c6644db9ef9f226680b6513 => generated 877 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:24:14.690885 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc03d5b-fd16-4929-9eda-2a3a1f734659 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:14.700738 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc03d5b-fd16-4929-9eda-2a3a1f734659 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:14.705335 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddbc4c-713e-4ea9-99b8-552187cf31a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:14.706174 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddbc4c-713e-4ea9-99b8-552187cf31a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:14.706757 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddbc4c-713e-4ea9-99b8-552187cf31a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:14.707040 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddbc4c-713e-4ea9-99b8-552187cf31a5 admin admin] PATH_INFO: `/v3/users/8f68d76e853847848951f562e14f4d97` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:14.721039 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddbc4c-713e-4ea9-99b8-552187cf31a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=8f68d76e853847848951f562e14f4d97)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:14.723190 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddbc4c-713e-4ea9-99b8-552187cf31a5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:14.724809 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 670/1351] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:24:14 2021] GET /identity/v3/users/8f68d76e853847848951f562e14f4d97 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:24:14.731682 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8570e84-f617-45a9-bef1-7d8f01250bce admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:14.741300 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8570e84-f617-45a9-bef1-7d8f01250bce admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:14.746465 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a10df5-ac66-4ebc-b255-64e488a52023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:14.747312 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a10df5-ac66-4ebc-b255-64e488a52023 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:14.747593 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a10df5-ac66-4ebc-b255-64e488a52023 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:14.747865 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a10df5-ac66-4ebc-b255-64e488a52023 admin admin] PATH_INFO: `/v3/users/2466c96d515145a198dd22ea2b6d889c` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:14.761671 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a10df5-ac66-4ebc-b255-64e488a52023 admin admin] RBAC: Authorizing `identity:get_user(user_id=2466c96d515145a198dd22ea2b6d889c)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:14.763794 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a10df5-ac66-4ebc-b255-64e488a52023 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:14.765434 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 682/1352] 10.222.0.25 () {56 vars in 1199 bytes} [Fri Aug 27 01:24:14 2021] GET /identity/v3/users/2466c96d515145a198dd22ea2b6d889c => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:24:20.032890 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627a9e5-2160-4b51-850a-02244f83699c None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:20.033455 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627a9e5-2160-4b51-850a-02244f83699c None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:20.033455 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627a9e5-2160-4b51-850a-02244f83699c None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:20.035240 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 671/1353] 10.222.0.25 () {54 vars in 918 bytes} [Fri Aug 27 01:24:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:20.041420 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d80059-276f-477b-8f8d-55e4c914b5ab None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:20.041849 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d80059-276f-477b-8f8d-55e4c914b5ab None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:20.041951 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d80059-276f-477b-8f8d-55e4c914b5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:20.060453 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-07d80059-276f-477b-8f8d-55e4c914b5ab None None] MFA Rules not processed for user `d67c0b68ca7349399d9ea9f4a0b2b564`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:20.061719 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-07d80059-276f-477b-8f8d-55e4c914b5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:20.071113 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 683/1354] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Aug 27 01:24:20 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:20.086226 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62671866-75b5-45c7-b7ef-cb812f24f5c8 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:20.086523 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62671866-75b5-45c7-b7ef-cb812f24f5c8 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:20.086802 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62671866-75b5-45c7-b7ef-cb812f24f5c8 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:20.088582 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 672/1355] 10.222.0.25 () {54 vars in 918 bytes} [Fri Aug 27 01:24:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:20.093579 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98803839-cee0-48e2-b9a7-105b2dd05a82 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:20.093862 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98803839-cee0-48e2-b9a7-105b2dd05a82 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:20.094163 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98803839-cee0-48e2-b9a7-105b2dd05a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:20.111117 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-98803839-cee0-48e2-b9a7-105b2dd05a82 None None] MFA Rules not processed for user `249a7642a0284dde91a7719f732b2d70`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:20.112265 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-98803839-cee0-48e2-b9a7-105b2dd05a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:20.122100 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 684/1356] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Aug 27 01:24:20 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:24:22.934961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d81c4-7bb8-4dab-8766-25be08ddb639 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:22.935482 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d81c4-7bb8-4dab-8766-25be08ddb639 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:22.935482 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d81c4-7bb8-4dab-8766-25be08ddb639 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:22.937273 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 673/1357] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:24:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:22.943352 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4a0d-7f79-4244-a200-032fc0ae8e44 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:22.943792 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4a0d-7f79-4244-a200-032fc0ae8e44 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:22.943920 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4a0d-7f79-4244-a200-032fc0ae8e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:22.962628 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-6f1f4a0d-7f79-4244-a200-032fc0ae8e44 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:22.963808 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-6f1f4a0d-7f79-4244-a200-032fc0ae8e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:22.971321 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 685/1358] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:24:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:23.015450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d81c4-7bb8-4dab-8766-25be08ddb639 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:23.030360 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d81c4-7bb8-4dab-8766-25be08ddb639 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:23.035692 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0af2f-7561-4327-985e-7edb9f22ac6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:23.036327 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0af2f-7561-4327-985e-7edb9f22ac6f service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:23.036610 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0af2f-7561-4327-985e-7edb9f22ac6f service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:23.036914 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0af2f-7561-4327-985e-7edb9f22ac6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:23.044651 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0af2f-7561-4327-985e-7edb9f22ac6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:23.046237 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0af2f-7561-4327-985e-7edb9f22ac6f service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:23.055814 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 674/1359] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:24:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:24:24.517043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b2aec-5f4a-4f7f-9034-d4434960bdfd None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:24.517627 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b2aec-5f4a-4f7f-9034-d4434960bdfd None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:24.517627 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b2aec-5f4a-4f7f-9034-d4434960bdfd None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:24.519396 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 686/1360] 10.222.0.25 () {54 vars in 911 bytes} [Fri Aug 27 01:24:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:24.525549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa996f0-0586-4d00-a74c-2da820a2ca94 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:24.525971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa996f0-0586-4d00-a74c-2da820a2ca94 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:24.526101 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa996f0-0586-4d00-a74c-2da820a2ca94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:24.543198 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-8fa996f0-0586-4d00-a74c-2da820a2ca94 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:24.544382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8fa996f0-0586-4d00-a74c-2da820a2ca94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:24.552042 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 675/1361] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Aug 27 01:24:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:24.704155 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b2aec-5f4a-4f7f-9034-d4434960bdfd None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:24.718187 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b2aec-5f4a-4f7f-9034-d4434960bdfd None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:24.723530 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d6b4d-ac54-4935-8a06-7b5d8384484c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:24.724213 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d6b4d-ac54-4935-8a06-7b5d8384484c service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:24.724498 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d6b4d-ac54-4935-8a06-7b5d8384484c service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:24.724774 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d6b4d-ac54-4935-8a06-7b5d8384484c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:24.732770 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d6b4d-ac54-4935-8a06-7b5d8384484c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:24.734371 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d6b4d-ac54-4935-8a06-7b5d8384484c service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:24.743954 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 687/1362] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:24:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:24:26.148417 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edc2dc-1628-4617-8445-0f6188706469 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:26.149037 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edc2dc-1628-4617-8445-0f6188706469 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:26.149172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edc2dc-1628-4617-8445-0f6188706469 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:26.150910 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 676/1363] 10.222.0.25 () {54 vars in 911 bytes} [Fri Aug 27 01:24:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:26.156377 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fb55c-cbec-4a9b-b1b2-3408af3f7633 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:26.156820 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fb55c-cbec-4a9b-b1b2-3408af3f7633 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:26.156960 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fb55c-cbec-4a9b-b1b2-3408af3f7633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:26.175239 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-892fb55c-cbec-4a9b-b1b2-3408af3f7633 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:26.176421 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-892fb55c-cbec-4a9b-b1b2-3408af3f7633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:26.184164 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 688/1364] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Aug 27 01:24:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:26.337622 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edc2dc-1628-4617-8445-0f6188706469 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:26.351629 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edc2dc-1628-4617-8445-0f6188706469 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:26.357046 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de79fc9-5044-4a5a-83de-3abecfe9938c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:26.357678 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de79fc9-5044-4a5a-83de-3abecfe9938c service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:26.357960 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de79fc9-5044-4a5a-83de-3abecfe9938c service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:26.358231 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de79fc9-5044-4a5a-83de-3abecfe9938c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:26.366111 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de79fc9-5044-4a5a-83de-3abecfe9938c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:26.368225 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de79fc9-5044-4a5a-83de-3abecfe9938c service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:26.377276 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 677/1365] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:24:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:24:27.752042 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb50d4-e639-45de-9f27-ca378bf7ec6a None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:27.752588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb50d4-e639-45de-9f27-ca378bf7ec6a None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:27.752588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb50d4-e639-45de-9f27-ca378bf7ec6a None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:27.754316 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 689/1366] 10.222.0.25 () {54 vars in 911 bytes} [Fri Aug 27 01:24:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:27.760456 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e641f5-7c36-46c6-8774-044265869acc None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:27.760876 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e641f5-7c36-46c6-8774-044265869acc None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:27.761044 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e641f5-7c36-46c6-8774-044265869acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:27.778435 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-76e641f5-7c36-46c6-8774-044265869acc None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:27.779618 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-76e641f5-7c36-46c6-8774-044265869acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:27.787237 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 678/1367] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Aug 27 01:24:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:27.937818 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb50d4-e639-45de-9f27-ca378bf7ec6a None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:27.952308 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb50d4-e639-45de-9f27-ca378bf7ec6a None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:27.957508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8fd35-54ed-412e-944e-4656b4f9cd44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:27.958131 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8fd35-54ed-412e-944e-4656b4f9cd44 service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:27.958409 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8fd35-54ed-412e-944e-4656b4f9cd44 service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:27.958679 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8fd35-54ed-412e-944e-4656b4f9cd44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:27.967278 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8fd35-54ed-412e-944e-4656b4f9cd44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:27.968853 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8fd35-54ed-412e-944e-4656b4f9cd44 service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:27.977810 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 690/1368] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:24:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:24:29.371676 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051737af-22b2-4d9e-98d4-94c3b9af9cfc None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:29.372238 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051737af-22b2-4d9e-98d4-94c3b9af9cfc None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:29.372238 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051737af-22b2-4d9e-98d4-94c3b9af9cfc None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:29.374100 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 679/1369] 10.222.0.25 () {54 vars in 911 bytes} [Fri Aug 27 01:24:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:29.379629 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdaf077-5f1c-48ac-9376-3eef340a42ab None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:29.380022 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdaf077-5f1c-48ac-9376-3eef340a42ab None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:29.380256 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdaf077-5f1c-48ac-9376-3eef340a42ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:29.398609 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-5cdaf077-5f1c-48ac-9376-3eef340a42ab None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:29.399799 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-5cdaf077-5f1c-48ac-9376-3eef340a42ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:29.407608 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 691/1370] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Aug 27 01:24:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:29.559920 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051737af-22b2-4d9e-98d4-94c3b9af9cfc None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:29.574231 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051737af-22b2-4d9e-98d4-94c3b9af9cfc None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:29.579461 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8660fa-0265-43e6-b758-c6f48ff8edc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:29.580083 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8660fa-0265-43e6-b758-c6f48ff8edc4 service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:29.580361 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8660fa-0265-43e6-b758-c6f48ff8edc4 service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:29.580630 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8660fa-0265-43e6-b758-c6f48ff8edc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:29.589223 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8660fa-0265-43e6-b758-c6f48ff8edc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:29.590786 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8660fa-0265-43e6-b758-c6f48ff8edc4 service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:29.599837 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 680/1371] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:24:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:24:31.007998 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbced6b-4509-4a56-855f-583ec1f95531 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:31.008582 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbced6b-4509-4a56-855f-583ec1f95531 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:31.008582 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbced6b-4509-4a56-855f-583ec1f95531 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:31.010371 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 692/1372] 10.222.0.25 () {54 vars in 911 bytes} [Fri Aug 27 01:24:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:31.015757 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c2da6-adcd-48e9-8700-e5b6028ca62f None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:31.016191 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c2da6-adcd-48e9-8700-e5b6028ca62f None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:31.016315 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c2da6-adcd-48e9-8700-e5b6028ca62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:31.034044 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-cd3c2da6-adcd-48e9-8700-e5b6028ca62f None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:31.035228 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-cd3c2da6-adcd-48e9-8700-e5b6028ca62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:31.043128 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 681/1373] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Aug 27 01:24:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:31.199432 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbced6b-4509-4a56-855f-583ec1f95531 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:31.213244 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbced6b-4509-4a56-855f-583ec1f95531 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:31.218530 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bef699-0504-41c7-af25-94b23dd2680c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:31.219153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bef699-0504-41c7-af25-94b23dd2680c service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:31.219432 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bef699-0504-41c7-af25-94b23dd2680c service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:31.219704 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bef699-0504-41c7-af25-94b23dd2680c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:31.228011 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bef699-0504-41c7-af25-94b23dd2680c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:31.229608 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bef699-0504-41c7-af25-94b23dd2680c service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:31.238612 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 693/1374] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:24:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:24:32.625216 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8914146-cb65-4aaa-a0e4-595e448e44f1 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:32.625770 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8914146-cb65-4aaa-a0e4-595e448e44f1 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:32.625770 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8914146-cb65-4aaa-a0e4-595e448e44f1 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:32.627518 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 682/1375] 10.222.0.25 () {54 vars in 911 bytes} [Fri Aug 27 01:24:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:32.634078 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34b575-93ea-4e29-8a54-95dbd7bd51aa None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:32.634538 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34b575-93ea-4e29-8a54-95dbd7bd51aa None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:32.634641 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34b575-93ea-4e29-8a54-95dbd7bd51aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:32.652322 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-4a34b575-93ea-4e29-8a54-95dbd7bd51aa None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:32.653529 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-4a34b575-93ea-4e29-8a54-95dbd7bd51aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:32.661076 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 694/1376] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Aug 27 01:24:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:32.812937 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8914146-cb65-4aaa-a0e4-595e448e44f1 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:32.827731 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8914146-cb65-4aaa-a0e4-595e448e44f1 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:32.833121 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278961a-46ba-48ee-acef-b2baeb8aeddd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:32.833752 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278961a-46ba-48ee-acef-b2baeb8aeddd service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:32.834033 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278961a-46ba-48ee-acef-b2baeb8aeddd service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:32.834309 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278961a-46ba-48ee-acef-b2baeb8aeddd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:32.842352 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278961a-46ba-48ee-acef-b2baeb8aeddd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:32.843921 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278961a-46ba-48ee-acef-b2baeb8aeddd service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:32.853212 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 683/1377] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:24:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:24:34.222818 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ecec3-0e07-4613-99c9-f5f103ee9d90 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:34.223378 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ecec3-0e07-4613-99c9-f5f103ee9d90 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:34.223378 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ecec3-0e07-4613-99c9-f5f103ee9d90 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:34.225175 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 695/1378] 10.222.0.25 () {54 vars in 911 bytes} [Fri Aug 27 01:24:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:34.231266 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ba73d-630a-4efd-8463-7b0436b5ae24 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:34.231670 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ba73d-630a-4efd-8463-7b0436b5ae24 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:34.231821 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ba73d-630a-4efd-8463-7b0436b5ae24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:34.250417 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-9e8ba73d-630a-4efd-8463-7b0436b5ae24 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:34.251609 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-9e8ba73d-630a-4efd-8463-7b0436b5ae24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:34.259246 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 684/1379] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Aug 27 01:24:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:34.417132 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ecec3-0e07-4613-99c9-f5f103ee9d90 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:34.431260 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ecec3-0e07-4613-99c9-f5f103ee9d90 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:34.436607 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa024a3-ad97-442d-8210-f3495c6830af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:34.437275 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa024a3-ad97-442d-8210-f3495c6830af service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:34.437559 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa024a3-ad97-442d-8210-f3495c6830af service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:34.437835 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa024a3-ad97-442d-8210-f3495c6830af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:34.446070 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa024a3-ad97-442d-8210-f3495c6830af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:34.447646 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa024a3-ad97-442d-8210-f3495c6830af service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:34.456823 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 696/1380] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:24:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:24:35.866877 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713eca5-e7fc-412f-a782-39a69976ec81 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:35.867565 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713eca5-e7fc-412f-a782-39a69976ec81 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:35.867565 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713eca5-e7fc-412f-a782-39a69976ec81 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:35.869333 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 685/1381] 10.222.0.25 () {54 vars in 911 bytes} [Fri Aug 27 01:24:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:35.874820 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0dc08-fdf7-44e9-8813-f8755017867e None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:35.875220 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0dc08-fdf7-44e9-8813-f8755017867e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:35.875370 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0dc08-fdf7-44e9-8813-f8755017867e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:35.893546 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-19b0dc08-fdf7-44e9-8813-f8755017867e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:35.894729 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-19b0dc08-fdf7-44e9-8813-f8755017867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:35.902549 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 697/1382] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Aug 27 01:24:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:36.053294 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713eca5-e7fc-412f-a782-39a69976ec81 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:36.068007 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713eca5-e7fc-412f-a782-39a69976ec81 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:36.073997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b12682-1ffd-4959-90a3-95ec56ca48f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:36.074625 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b12682-1ffd-4959-90a3-95ec56ca48f1 service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:36.074903 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b12682-1ffd-4959-90a3-95ec56ca48f1 service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:36.075179 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b12682-1ffd-4959-90a3-95ec56ca48f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:36.082945 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b12682-1ffd-4959-90a3-95ec56ca48f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:36.084506 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b12682-1ffd-4959-90a3-95ec56ca48f1 service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:36.093537 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 686/1383] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:24:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:24:38.141953 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363551a6-79ce-4108-9b0e-c3a988f9f1b1 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:38.142501 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363551a6-79ce-4108-9b0e-c3a988f9f1b1 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:38.142626 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363551a6-79ce-4108-9b0e-c3a988f9f1b1 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:38.144327 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 698/1384] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:24:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:38.150791 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283abba-0771-4fea-a017-1a45149260ca None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:38.151198 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283abba-0771-4fea-a017-1a45149260ca None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:38.151337 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283abba-0771-4fea-a017-1a45149260ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:38.169128 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-d283abba-0771-4fea-a017-1a45149260ca None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:38.170299 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d283abba-0771-4fea-a017-1a45149260ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:38.177912 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 687/1385] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:24:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:24:38.217083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363551a6-79ce-4108-9b0e-c3a988f9f1b1 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:38.228339 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363551a6-79ce-4108-9b0e-c3a988f9f1b1 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:38.231830 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a8207-5b7d-4e78-b581-0a0358989606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:38.232462 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a8207-5b7d-4e78-b581-0a0358989606 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:38.232731 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a8207-5b7d-4e78-b581-0a0358989606 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:38.233029 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a8207-5b7d-4e78-b581-0a0358989606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:38.241775 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a8207-5b7d-4e78-b581-0a0358989606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:38.243200 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a8207-5b7d-4e78-b581-0a0358989606 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:38.252160 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 699/1386] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:24:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:24:40.543544 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0fb2b-92c9-424a-a7fd-132261eb52ad None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:40.544069 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0fb2b-92c9-424a-a7fd-132261eb52ad None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:40.544158 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0fb2b-92c9-424a-a7fd-132261eb52ad None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:40.545906 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 688/1387] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:24:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:40.551710 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156cb95-0911-491a-a842-abf2bbd5635b None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:40.552113 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156cb95-0911-491a-a842-abf2bbd5635b None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:40.552261 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156cb95-0911-491a-a842-abf2bbd5635b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:40.571736 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-4156cb95-0911-491a-a842-abf2bbd5635b None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:40.573562 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-4156cb95-0911-491a-a842-abf2bbd5635b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:40.582365 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 700/1388] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:24:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:40.621171 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0fb2b-92c9-424a-a7fd-132261eb52ad None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:40.631572 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0fb2b-92c9-424a-a7fd-132261eb52ad None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:40.635623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be72e72-2b4a-4d30-9e85-70dbd8b66cce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:40.636250 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be72e72-2b4a-4d30-9e85-70dbd8b66cce service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:40.636527 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be72e72-2b4a-4d30-9e85-70dbd8b66cce service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:40.636803 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be72e72-2b4a-4d30-9e85-70dbd8b66cce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:40.645222 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be72e72-2b4a-4d30-9e85-70dbd8b66cce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:40.646627 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be72e72-2b4a-4d30-9e85-70dbd8b66cce service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:40.655663 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 689/1389] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:24:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:24:43.205738 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b0555-daed-41ed-9431-9663e86dfffa None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:43.206292 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b0555-daed-41ed-9431-9663e86dfffa None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:43.206292 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b0555-daed-41ed-9431-9663e86dfffa None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:43.208055 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 701/1390] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:24:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:43.214708 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb395190-3368-4717-9140-ebe8b249d243 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:43.215113 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb395190-3368-4717-9140-ebe8b249d243 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:43.215258 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb395190-3368-4717-9140-ebe8b249d243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:43.234874 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-bb395190-3368-4717-9140-ebe8b249d243 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:43.236097 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-bb395190-3368-4717-9140-ebe8b249d243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:43.243842 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 690/1391] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:24:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:43.283056 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b0555-daed-41ed-9431-9663e86dfffa None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:43.293573 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b0555-daed-41ed-9431-9663e86dfffa None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:43.297044 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb3bd1-d1a4-4a55-a121-120eab5e448b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:43.297668 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb3bd1-d1a4-4a55-a121-120eab5e448b service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:43.297946 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb3bd1-d1a4-4a55-a121-120eab5e448b service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:43.298217 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb3bd1-d1a4-4a55-a121-120eab5e448b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:43.307424 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb3bd1-d1a4-4a55-a121-120eab5e448b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:43.308899 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb3bd1-d1a4-4a55-a121-120eab5e448b service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:43.318422 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 702/1392] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:24:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:24:45.569700 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3c92e-f2f9-4013-b259-e783ae61e0fe None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:45.570287 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3c92e-f2f9-4013-b259-e783ae61e0fe None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:45.570287 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3c92e-f2f9-4013-b259-e783ae61e0fe None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:45.572024 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 691/1393] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:24:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:45.577886 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a81618-a3f7-4f71-922d-78e3a84a510e None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:45.578407 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a81618-a3f7-4f71-922d-78e3a84a510e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:45.578407 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a81618-a3f7-4f71-922d-78e3a84a510e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:45.596084 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-52a81618-a3f7-4f71-922d-78e3a84a510e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:45.597324 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-52a81618-a3f7-4f71-922d-78e3a84a510e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:45.605645 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 703/1394] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:24:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:24:45.643469 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3c92e-f2f9-4013-b259-e783ae61e0fe None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:45.654490 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3c92e-f2f9-4013-b259-e783ae61e0fe None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:45.657962 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5dec8-d42f-454d-b09e-3ed394c8e2ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:45.658592 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5dec8-d42f-454d-b09e-3ed394c8e2ec service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:45.658872 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5dec8-d42f-454d-b09e-3ed394c8e2ec service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:45.659146 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5dec8-d42f-454d-b09e-3ed394c8e2ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:45.668410 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5dec8-d42f-454d-b09e-3ed394c8e2ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:45.669815 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5dec8-d42f-454d-b09e-3ed394c8e2ec service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:45.678891 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 692/1395] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:24:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:24:48.007445 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497ae04-53bb-4355-a581-b8f72f39f2a3 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:48.008019 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497ae04-53bb-4355-a581-b8f72f39f2a3 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:48.008019 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497ae04-53bb-4355-a581-b8f72f39f2a3 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:48.009833 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 704/1396] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:24:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:48.016348 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424f40f-2e8a-4398-9f3e-c29423a04929 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:48.016801 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424f40f-2e8a-4398-9f3e-c29423a04929 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:48.016916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424f40f-2e8a-4398-9f3e-c29423a04929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:48.036663 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b424f40f-2e8a-4398-9f3e-c29423a04929 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:48.038983 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b424f40f-2e8a-4398-9f3e-c29423a04929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:48.046349 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 693/1397] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:24:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:48.086608 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497ae04-53bb-4355-a581-b8f72f39f2a3 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:48.101848 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497ae04-53bb-4355-a581-b8f72f39f2a3 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:48.105634 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379ce15-52e3-4977-a64d-bbafdfff534a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:48.106273 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379ce15-52e3-4977-a64d-bbafdfff534a service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:48.106549 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379ce15-52e3-4977-a64d-bbafdfff534a service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:48.106817 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379ce15-52e3-4977-a64d-bbafdfff534a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:48.115556 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379ce15-52e3-4977-a64d-bbafdfff534a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:48.117683 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379ce15-52e3-4977-a64d-bbafdfff534a service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:48.126742 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 705/1398] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:24:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:24:50.328354 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec3bbe-08f6-479f-ab1b-9f73feeafc04 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:50.328909 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec3bbe-08f6-479f-ab1b-9f73feeafc04 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:50.328909 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec3bbe-08f6-479f-ab1b-9f73feeafc04 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:50.330710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 694/1399] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:24:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:50.336858 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc5459-a645-48fa-bac2-fd20cf29d5fb None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:50.337292 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc5459-a645-48fa-bac2-fd20cf29d5fb None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:50.337437 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc5459-a645-48fa-bac2-fd20cf29d5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:50.355211 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-9edc5459-a645-48fa-bac2-fd20cf29d5fb None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:50.356416 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-9edc5459-a645-48fa-bac2-fd20cf29d5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:50.364169 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 706/1400] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:24:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:50.403938 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec3bbe-08f6-479f-ab1b-9f73feeafc04 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:50.415176 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec3bbe-08f6-479f-ab1b-9f73feeafc04 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:50.423997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841136ce-8c65-4b05-8339-f8dfcbf36b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:50.423997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841136ce-8c65-4b05-8339-f8dfcbf36b4f service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:50.423997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841136ce-8c65-4b05-8339-f8dfcbf36b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:50.423997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841136ce-8c65-4b05-8339-f8dfcbf36b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:50.430096 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841136ce-8c65-4b05-8339-f8dfcbf36b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:50.431527 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841136ce-8c65-4b05-8339-f8dfcbf36b4f service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:50.440692 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 695/1401] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:24:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:24:52.648310 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8396a42-58fa-4b03-a6a9-663aaf049247 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:52.648902 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8396a42-58fa-4b03-a6a9-663aaf049247 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:52.648902 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8396a42-58fa-4b03-a6a9-663aaf049247 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:52.650669 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 707/1402] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:24:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:52.656624 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f8ff7-d1ff-495d-b67c-cb815522cf9c None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:52.657105 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f8ff7-d1ff-495d-b67c-cb815522cf9c None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:52.657211 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f8ff7-d1ff-495d-b67c-cb815522cf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:52.677247 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b60f8ff7-d1ff-495d-b67c-cb815522cf9c None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:52.679173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b60f8ff7-d1ff-495d-b67c-cb815522cf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:52.686914 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 696/1403] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:24:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:52.723894 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8396a42-58fa-4b03-a6a9-663aaf049247 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:52.734968 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8396a42-58fa-4b03-a6a9-663aaf049247 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:52.738514 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee857500-99b2-4345-a5f5-e0c6215a7e57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:52.739144 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee857500-99b2-4345-a5f5-e0c6215a7e57 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:52.739424 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee857500-99b2-4345-a5f5-e0c6215a7e57 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:52.739697 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee857500-99b2-4345-a5f5-e0c6215a7e57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:52.749093 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee857500-99b2-4345-a5f5-e0c6215a7e57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:52.750512 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee857500-99b2-4345-a5f5-e0c6215a7e57 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:52.759675 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 708/1404] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:24:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:24:55.003850 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160b924-dfdb-4449-963f-c8f23ea5992d None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:55.004377 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160b924-dfdb-4449-963f-c8f23ea5992d None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:55.004377 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160b924-dfdb-4449-963f-c8f23ea5992d None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:55.006737 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 697/1405] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:24:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:55.012484 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ca3e3-fa3d-403b-9437-b0a6f15d0eb1 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:55.012888 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ca3e3-fa3d-403b-9437-b0a6f15d0eb1 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:55.013069 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ca3e3-fa3d-403b-9437-b0a6f15d0eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:55.030919 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-d33ca3e3-fa3d-403b-9437-b0a6f15d0eb1 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:55.037014 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-d33ca3e3-fa3d-403b-9437-b0a6f15d0eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:55.040419 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 709/1406] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:24:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:55.088475 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160b924-dfdb-4449-963f-c8f23ea5992d None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:55.089652 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160b924-dfdb-4449-963f-c8f23ea5992d None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:55.093175 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda2aac-0ba2-470a-9089-ecdec5762073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:55.093806 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda2aac-0ba2-470a-9089-ecdec5762073 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:55.094103 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda2aac-0ba2-470a-9089-ecdec5762073 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:55.094357 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda2aac-0ba2-470a-9089-ecdec5762073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:55.103310 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda2aac-0ba2-470a-9089-ecdec5762073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:55.104788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda2aac-0ba2-470a-9089-ecdec5762073 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:55.114327 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 698/1407] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:24:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:24:57.276934 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0aea2-8cbb-4261-8ef3-781cc1445619 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:57.277585 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0aea2-8cbb-4261-8ef3-781cc1445619 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:57.277585 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0aea2-8cbb-4261-8ef3-781cc1445619 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:57.279249 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 710/1408] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:24:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:57.285623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bfbee-e7c0-4e69-9c36-7458fc4e6d66 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:57.286079 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bfbee-e7c0-4e69-9c36-7458fc4e6d66 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:57.286227 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bfbee-e7c0-4e69-9c36-7458fc4e6d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:57.306292 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-0a5bfbee-e7c0-4e69-9c36-7458fc4e6d66 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:57.307173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-0a5bfbee-e7c0-4e69-9c36-7458fc4e6d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:57.315892 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 699/1409] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:24:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:57.352891 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0aea2-8cbb-4261-8ef3-781cc1445619 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:57.363259 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0aea2-8cbb-4261-8ef3-781cc1445619 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:57.367357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da2160-fe5f-48ca-b476-bde4f0167d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:57.367993 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da2160-fe5f-48ca-b476-bde4f0167d35 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:57.368272 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da2160-fe5f-48ca-b476-bde4f0167d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:57.368546 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da2160-fe5f-48ca-b476-bde4f0167d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:57.377179 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da2160-fe5f-48ca-b476-bde4f0167d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:57.378606 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da2160-fe5f-48ca-b476-bde4f0167d35 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:57.388026 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 711/1410] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:24:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:24:59.530140 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fc2b1-2dd2-45d8-bbff-2ea876f3f9c9 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:59.530725 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fc2b1-2dd2-45d8-bbff-2ea876f3f9c9 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:59.530725 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fc2b1-2dd2-45d8-bbff-2ea876f3f9c9 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:59.532512 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 700/1411] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:24:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:24:59.539153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86040f09-f833-4048-a198-2088ee60f5e6 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:59.539578 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86040f09-f833-4048-a198-2088ee60f5e6 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:59.539680 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86040f09-f833-4048-a198-2088ee60f5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:59.564582 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-86040f09-f833-4048-a198-2088ee60f5e6 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:24:59.566063 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-86040f09-f833-4048-a198-2088ee60f5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:24:59.573771 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 712/1412] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:24:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:24:59.611133 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fc2b1-2dd2-45d8-bbff-2ea876f3f9c9 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:24:59.622050 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fc2b1-2dd2-45d8-bbff-2ea876f3f9c9 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:24:59.625471 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7054d2-b11a-42af-87db-186471ca032b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:24:59.626097 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7054d2-b11a-42af-87db-186471ca032b service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:24:59.626373 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7054d2-b11a-42af-87db-186471ca032b service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:24:59.626642 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7054d2-b11a-42af-87db-186471ca032b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:24:59.635575 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7054d2-b11a-42af-87db-186471ca032b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:24:59.637015 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7054d2-b11a-42af-87db-186471ca032b service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:24:59.645990 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 701/1413] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:24:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:25:16.509614 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99211b1c-a4d0-45d3-b922-b9e10db5e9cc None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:16.510213 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99211b1c-a4d0-45d3-b922-b9e10db5e9cc None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:16.510213 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99211b1c-a4d0-45d3-b922-b9e10db5e9cc None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:16.511929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 713/1414] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:25:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:25:16.517808 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b30fc2-0d26-40f3-aa03-6f9f1db40731 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:16.518209 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b30fc2-0d26-40f3-aa03-6f9f1db40731 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:16.518351 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b30fc2-0d26-40f3-aa03-6f9f1db40731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:16.536007 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-35b30fc2-0d26-40f3-aa03-6f9f1db40731 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:25:16.537869 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-35b30fc2-0d26-40f3-aa03-6f9f1db40731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:25:16.545425 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 702/1415] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:25:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:25:16.593066 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8951e4-fcff-43bc-86fa-f06ed4d19c03 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:16.593356 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8951e4-fcff-43bc-86fa-f06ed4d19c03 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:16.593638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8951e4-fcff-43bc-86fa-f06ed4d19c03 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:16.595435 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 714/1416] 10.222.0.25 () {54 vars in 966 bytes} [Fri Aug 27 01:25:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:25:16.600530 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385be18-2965-4bbf-b2e4-a59cd13dcae6 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:16.600816 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385be18-2965-4bbf-b2e4-a59cd13dcae6 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:16.601127 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385be18-2965-4bbf-b2e4-a59cd13dcae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:16.618980 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-c385be18-2965-4bbf-b2e4-a59cd13dcae6 None None] MFA Rules not processed for user `a59679a5d71249fc8cd65fbcf84e7bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:25:16.620146 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-c385be18-2965-4bbf-b2e4-a59cd13dcae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:25:16.626376 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 703/1417] 10.222.0.25 () {58 vars in 1064 bytes} [Fri Aug 27 01:25:16 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:25:16.634360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8951e4-fcff-43bc-86fa-f06ed4d19c03 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:25:16.644650 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8951e4-fcff-43bc-86fa-f06ed4d19c03 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:25:16.648132 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e97c9a-4a24-4922-80e0-73e9af851cb8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59679a5d71249fc8cd65fbcf84e7bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:25:16.648748 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e97c9a-4a24-4922-80e0-73e9af851cb8 service glance] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:16.649059 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e97c9a-4a24-4922-80e0-73e9af851cb8 service glance] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:16.649337 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e97c9a-4a24-4922-80e0-73e9af851cb8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:16.657875 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e97c9a-4a24-4922-80e0-73e9af851cb8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:25:16.659293 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e97c9a-4a24-4922-80e0-73e9af851cb8 service glance] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:25:16.669225 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 715/1418] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:25:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:25:18.888267 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcb474-dc60-445d-be06-b079748bd4c9 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:18.888821 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcb474-dc60-445d-be06-b079748bd4c9 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:18.888821 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcb474-dc60-445d-be06-b079748bd4c9 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:18.890602 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 704/1419] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:25:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:25:18.896473 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9208ec8-7248-4542-b73e-6f68013912fb None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:18.896926 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9208ec8-7248-4542-b73e-6f68013912fb None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:18.897084 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9208ec8-7248-4542-b73e-6f68013912fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:18.916043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-d9208ec8-7248-4542-b73e-6f68013912fb None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:25:18.917296 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-d9208ec8-7248-4542-b73e-6f68013912fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:25:18.925196 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 716/1420] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:25:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:25:18.949822 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcb474-dc60-445d-be06-b079748bd4c9 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:25:18.962342 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcb474-dc60-445d-be06-b079748bd4c9 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:25:18.966801 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b04117-4938-4f89-b380-df7f4a1a46c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:25:18.967444 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b04117-4938-4f89-b380-df7f4a1a46c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:18.967727 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b04117-4938-4f89-b380-df7f4a1a46c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:18.968005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b04117-4938-4f89-b380-df7f4a1a46c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:18.968727 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b04117-4938-4f89-b380-df7f4a1a46c8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:25:18.970624 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b04117-4938-4f89-b380-df7f4a1a46c8 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:25:18.984473 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 705/1421] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Aug 27 01:25:18 2021] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:25:21.164766 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57dddb-fd87-49f9-b2eb-f5ac1d8f4e5f None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:21.165337 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57dddb-fd87-49f9-b2eb-f5ac1d8f4e5f None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:21.165337 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57dddb-fd87-49f9-b2eb-f5ac1d8f4e5f None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:21.167083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 717/1422] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:25:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:25:21.172954 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1cb4a-91db-4599-a603-f78a7a2b9643 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:21.173374 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1cb4a-91db-4599-a603-f78a7a2b9643 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:21.173510 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1cb4a-91db-4599-a603-f78a7a2b9643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:21.191013 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-d6f1cb4a-91db-4599-a603-f78a7a2b9643 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:25:21.192200 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d6f1cb4a-91db-4599-a603-f78a7a2b9643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:25:21.201192 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 706/1423] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:25:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:25:21.246850 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57dddb-fd87-49f9-b2eb-f5ac1d8f4e5f None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:25:21.265047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57dddb-fd87-49f9-b2eb-f5ac1d8f4e5f None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:25:21.270434 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca25b3-1874-4235-b321-013bdd9b47a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:25:21.271682 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca25b3-1874-4235-b321-013bdd9b47a8 service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:21.271971 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca25b3-1874-4235-b321-013bdd9b47a8 service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:21.272248 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca25b3-1874-4235-b321-013bdd9b47a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:21.280504 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca25b3-1874-4235-b321-013bdd9b47a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:25:21.282127 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca25b3-1874-4235-b321-013bdd9b47a8 service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:25:21.291638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 718/1424] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:25:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:25:23.694141 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0fb0d-6298-4dc1-a7a9-5cca8b7ed674 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:23.694667 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0fb0d-6298-4dc1-a7a9-5cca8b7ed674 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:23.694667 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0fb0d-6298-4dc1-a7a9-5cca8b7ed674 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:23.696428 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 707/1425] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:25:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:25:23.702388 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef306df-2546-4e37-8da2-91c3eaa4dc49 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:23.702793 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef306df-2546-4e37-8da2-91c3eaa4dc49 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:23.702948 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef306df-2546-4e37-8da2-91c3eaa4dc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:23.720848 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-bef306df-2546-4e37-8da2-91c3eaa4dc49 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:25:23.722047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-bef306df-2546-4e37-8da2-91c3eaa4dc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:25:23.729766 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 719/1426] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:25:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:25:23.766297 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0fb0d-6298-4dc1-a7a9-5cca8b7ed674 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:25:23.777354 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0fb0d-6298-4dc1-a7a9-5cca8b7ed674 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:25:23.780857 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0898f-cf0d-4f3f-b2dd-98af8663d3c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:25:23.781506 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0898f-cf0d-4f3f-b2dd-98af8663d3c3 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:23.781785 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0898f-cf0d-4f3f-b2dd-98af8663d3c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:23.782058 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0898f-cf0d-4f3f-b2dd-98af8663d3c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:23.790814 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0898f-cf0d-4f3f-b2dd-98af8663d3c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:25:23.792228 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0898f-cf0d-4f3f-b2dd-98af8663d3c3 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:25:23.801495 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 708/1427] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:25:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:25:26.017482 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e386a2-5037-484c-a612-f2cfce472290 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:26.017897 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e386a2-5037-484c-a612-f2cfce472290 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:26.018044 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e386a2-5037-484c-a612-f2cfce472290 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:26.019826 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 720/1428] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:25:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:25:26.026306 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0897c9-b8ef-4c1c-89c9-0254470fe428 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:26.026713 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0897c9-b8ef-4c1c-89c9-0254470fe428 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:26.026848 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0897c9-b8ef-4c1c-89c9-0254470fe428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:26.044574 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-5b0897c9-b8ef-4c1c-89c9-0254470fe428 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:25:26.045796 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-5b0897c9-b8ef-4c1c-89c9-0254470fe428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:25:26.053450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 709/1429] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:25:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:25:26.092364 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e386a2-5037-484c-a612-f2cfce472290 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:25:26.103039 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e386a2-5037-484c-a612-f2cfce472290 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:25:26.106508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a485ba6-c326-43a5-b3c5-43d11c9e4e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:25:26.107148 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a485ba6-c326-43a5-b3c5-43d11c9e4e42 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:26.107421 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a485ba6-c326-43a5-b3c5-43d11c9e4e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:26.107697 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a485ba6-c326-43a5-b3c5-43d11c9e4e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:26.117261 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a485ba6-c326-43a5-b3c5-43d11c9e4e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:25:26.118687 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a485ba6-c326-43a5-b3c5-43d11c9e4e42 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:25:26.127857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 721/1430] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:25:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:25:28.434590 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75766fc0-8def-4126-9f88-61ace3659abf None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:28.435058 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75766fc0-8def-4126-9f88-61ace3659abf None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:28.435165 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75766fc0-8def-4126-9f88-61ace3659abf None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:28.436920 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 710/1431] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:25:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:25:28.443121 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7c13d-eaf6-43f3-89cb-f46b1ad93c03 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:28.443541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7c13d-eaf6-43f3-89cb-f46b1ad93c03 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:28.443674 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7c13d-eaf6-43f3-89cb-f46b1ad93c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:28.461633 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-18f7c13d-eaf6-43f3-89cb-f46b1ad93c03 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:25:28.462823 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-18f7c13d-eaf6-43f3-89cb-f46b1ad93c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:25:28.470772 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 722/1432] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:25:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:25:28.513740 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75766fc0-8def-4126-9f88-61ace3659abf None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:25:28.524108 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75766fc0-8def-4126-9f88-61ace3659abf None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:25:28.527600 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76897d-5599-4b5e-a2bc-30b0ad360ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:25:28.528222 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76897d-5599-4b5e-a2bc-30b0ad360ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:28.528498 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76897d-5599-4b5e-a2bc-30b0ad360ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:28.528770 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76897d-5599-4b5e-a2bc-30b0ad360ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:28.537341 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76897d-5599-4b5e-a2bc-30b0ad360ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:25:28.538754 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76897d-5599-4b5e-a2bc-30b0ad360ce4 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:25:28.547721 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 711/1433] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:25:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:25:31.099796 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3ca60-a33a-42e0-85c3-d72fbd4812e5 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:31.100352 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3ca60-a33a-42e0-85c3-d72fbd4812e5 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:31.100352 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3ca60-a33a-42e0-85c3-d72fbd4812e5 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:31.102259 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 723/1434] 10.222.0.25 () {54 vars in 926 bytes} [Fri Aug 27 01:25:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:25:31.108095 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92567c2-0ffd-44c7-b496-30535b20f93f None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:31.108549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92567c2-0ffd-44c7-b496-30535b20f93f None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:31.108667 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92567c2-0ffd-44c7-b496-30535b20f93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:31.126496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-f92567c2-0ffd-44c7-b496-30535b20f93f None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:25:31.127689 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-f92567c2-0ffd-44c7-b496-30535b20f93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:25:31.135426 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 712/1435] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Aug 27 01:25:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:25:31.175289 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3ca60-a33a-42e0-85c3-d72fbd4812e5 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:25:31.186019 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3ca60-a33a-42e0-85c3-d72fbd4812e5 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:25:31.189561 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1f969-1382-4346-89bc-52e657446ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:25:31.190474 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1f969-1382-4346-89bc-52e657446ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:25:31.190738 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1f969-1382-4346-89bc-52e657446ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:25:31.191013 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1f969-1382-4346-89bc-52e657446ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:25:31.200253 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1f969-1382-4346-89bc-52e657446ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:25:31.201708 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1f969-1382-4346-89bc-52e657446ea4 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:25:31.211379 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 724/1436] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:25:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:26:50.763287 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b21c6-9f8c-4f80-8762-524f5967f75c None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:26:50.763907 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b21c6-9f8c-4f80-8762-524f5967f75c None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:26:50.763907 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b21c6-9f8c-4f80-8762-524f5967f75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:26:50.781735 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-a34b21c6-9f8c-4f80-8762-524f5967f75c None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:26:50.782933 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a34b21c6-9f8c-4f80-8762-524f5967f75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:26:50.791228 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 713/1437] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:26:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:26:50.799055 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97247402-fdda-42ac-829e-fc9d0a61070c None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:26:50.800085 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97247402-fdda-42ac-829e-fc9d0a61070c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:26:50.800668 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97247402-fdda-42ac-829e-fc9d0a61070c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:26:50.818400 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-97247402-fdda-42ac-829e-fc9d0a61070c None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:26:50.819575 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-97247402-fdda-42ac-829e-fc9d0a61070c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:26:50.827176 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 725/1438] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:26:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:26:50.831780 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b21c6-9f8c-4f80-8762-524f5967f75c None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:26:50.841109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b21c6-9f8c-4f80-8762-524f5967f75c None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:26:50.845549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14693bde-dd5d-424e-b4ed-f84254c1bfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:26:50.846190 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693bde-dd5d-424e-b4ed-f84254c1bfbf admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:26:50.846674 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693bde-dd5d-424e-b4ed-f84254c1bfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:26:50.846955 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693bde-dd5d-424e-b4ed-f84254c1bfbf admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:26:50.847657 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14693bde-dd5d-424e-b4ed-f84254c1bfbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:26:50.847954 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14693bde-dd5d-424e-b4ed-f84254c1bfbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:26:50.849549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14693bde-dd5d-424e-b4ed-f84254c1bfbf admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:26:50.860417 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 714/1439] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:26:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:26:50.868673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97247402-fdda-42ac-829e-fc9d0a61070c None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:26:50.877522 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97247402-fdda-42ac-829e-fc9d0a61070c None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:26:50.882611 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78fd022-8f37-4ef1-b280-8fa532c5f997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:26:50.883252 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fd022-8f37-4ef1-b280-8fa532c5f997 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:26:50.883534 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fd022-8f37-4ef1-b280-8fa532c5f997 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:26:50.883818 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fd022-8f37-4ef1-b280-8fa532c5f997 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:26:50.884480 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78fd022-8f37-4ef1-b280-8fa532c5f997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:26:50.886418 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78fd022-8f37-4ef1-b280-8fa532c5f997 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:26:51.008515 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 726/1440] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:26:50 2021] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:26:51.012699 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14693bde-dd5d-424e-b4ed-f84254c1bfbf admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:26:51.022718 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14693bde-dd5d-424e-b4ed-f84254c1bfbf admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:26:51.076393 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d394b-f9ca-4b96-a8da-79078cb4fdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:26:51.077074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d394b-f9ca-4b96-a8da-79078cb4fdfa admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:26:51.077353 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d394b-f9ca-4b96-a8da-79078cb4fdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:26:51.077623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d394b-f9ca-4b96-a8da-79078cb4fdfa admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:26:51.078305 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d394b-f9ca-4b96-a8da-79078cb4fdfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:26:51.080196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d394b-f9ca-4b96-a8da-79078cb4fdfa admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:26:51.168905 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 715/1441] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:26:51 2021] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:26:51.173086 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78fd022-8f37-4ef1-b280-8fa532c5f997 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:26:51.183713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78fd022-8f37-4ef1-b280-8fa532c5f997 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:26:51.188427 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c7314-94ee-4516-ba38-6ad1fcdc9a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:26:51.189106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c7314-94ee-4516-ba38-6ad1fcdc9a07 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:26:51.189390 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c7314-94ee-4516-ba38-6ad1fcdc9a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:26:51.189664 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c7314-94ee-4516-ba38-6ad1fcdc9a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:26:51.190429 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c7314-94ee-4516-ba38-6ad1fcdc9a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:26:51.192111 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c7314-94ee-4516-ba38-6ad1fcdc9a07 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:26:51.204798 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 727/1442] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:26:51 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:26:51.208993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d394b-f9ca-4b96-a8da-79078cb4fdfa admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:26:51.218579 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d394b-f9ca-4b96-a8da-79078cb4fdfa admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:26:51.223607 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a98de-500f-4216-a40e-1753535ed1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:26:51.224254 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a98de-500f-4216-a40e-1753535ed1bb admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:26:51.224538 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a98de-500f-4216-a40e-1753535ed1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:26:51.224824 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a98de-500f-4216-a40e-1753535ed1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:26:51.225551 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a98de-500f-4216-a40e-1753535ed1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:26:51.227127 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a98de-500f-4216-a40e-1753535ed1bb admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:26:51.240630 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 716/1443] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:26:51 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:26:51.244555 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c7314-94ee-4516-ba38-6ad1fcdc9a07 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:26:51.254423 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c7314-94ee-4516-ba38-6ad1fcdc9a07 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:26:51.258985 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f60ec1-7dc3-4b82-b2f2-99579f5278c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:26:51.259877 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f60ec1-7dc3-4b82-b2f2-99579f5278c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:26:51.260184 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f60ec1-7dc3-4b82-b2f2-99579f5278c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:26:51.260461 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f60ec1-7dc3-4b82-b2f2-99579f5278c3 admin admin] PATH_INFO: `/v3/projects/5aae63e1806e471984cfd2444abb0f3d/users/99c5c4d20a894da884e2497dadcd2511/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:26:51.274585 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f60ec1-7dc3-4b82-b2f2-99579f5278c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aae63e1806e471984cfd2444abb0f3d, user_id=99c5c4d20a894da884e2497dadcd2511, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:26:51.277177 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f60ec1-7dc3-4b82-b2f2-99579f5278c3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:26:51.343153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 728/1444] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:26:51 2021] PUT /identity/v3/projects/5aae63e1806e471984cfd2444abb0f3d/users/99c5c4d20a894da884e2497dadcd2511/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:26:51.355985 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee70d50-faaa-4394-bcda-1bb1e0052d6e None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:26:51.356273 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee70d50-faaa-4394-bcda-1bb1e0052d6e None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:26:51.356590 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee70d50-faaa-4394-bcda-1bb1e0052d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:26:51.382277 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-5ee70d50-faaa-4394-bcda-1bb1e0052d6e None None] MFA Rules not processed for user `99c5c4d20a894da884e2497dadcd2511`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:26:51.383468 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-5ee70d50-faaa-4394-bcda-1bb1e0052d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:26:51.445220 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 717/1445] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:26:51 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:26:51.456852 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f60ec1-7dc3-4b82-b2f2-99579f5278c3 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:26:51.526284 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f60ec1-7dc3-4b82-b2f2-99579f5278c3 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:26:51.531802 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23f221-c094-4b87-b5a4-8ed67eda06fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:26:51.532440 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23f221-c094-4b87-b5a4-8ed67eda06fd service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:26:51.532773 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23f221-c094-4b87-b5a4-8ed67eda06fd service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:26:51.533118 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23f221-c094-4b87-b5a4-8ed67eda06fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:26:51.541724 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23f221-c094-4b87-b5a4-8ed67eda06fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:26:51.544378 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23f221-c094-4b87-b5a4-8ed67eda06fd service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:26:51.552533 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 729/1446] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:26:51 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:26:51.622350 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf35b7-4847-4830-97f7-5d13c8680f5e None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:26:51.622639 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf35b7-4847-4830-97f7-5d13c8680f5e None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:26:51.622918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf35b7-4847-4830-97f7-5d13c8680f5e None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:26:51.624603 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 718/1447] 10.222.0.25 () {52 vars in 829 bytes} [Fri Aug 27 01:26:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:26:51.628356 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23f221-c094-4b87-b5a4-8ed67eda06fd service nova] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:26:51.687453 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23f221-c094-4b87-b5a4-8ed67eda06fd service nova] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:26:51.692479 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3fb09-6dd1-454a-ad0e-da5366703504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:26:51.693362 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3fb09-6dd1-454a-ad0e-da5366703504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:26:51.693642 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3fb09-6dd1-454a-ad0e-da5366703504 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:26:51.693916 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3fb09-6dd1-454a-ad0e-da5366703504 admin admin] PATH_INFO: `/v3/users/99c5c4d20a894da884e2497dadcd2511` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:26:51.695092 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3fb09-6dd1-454a-ad0e-da5366703504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c5c4d20a894da884e2497dadcd2511)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:26:51.696097 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING py.warnings [None req-23a3fb09-6dd1-454a-ad0e-da5366703504 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:26:51.696097 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: warnings.warn(msg) Aug 27 01:26:51.696097 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: Aug 27 01:26:51.697333 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3fb09-6dd1-454a-ad0e-da5366703504 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:26:51.909640 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-23a3fb09-6dd1-454a-ad0e-da5366703504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c5c4d20a894da884e2497dadcd2511'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:26:51.929396 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-23a3fb09-6dd1-454a-ad0e-da5366703504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c5c4d20a894da884e2497dadcd2511'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:26:51.942603 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-23a3fb09-6dd1-454a-ad0e-da5366703504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c5c4d20a894da884e2497dadcd2511'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:26:51.943408 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-23a3fb09-6dd1-454a-ad0e-da5366703504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c5c4d20a894da884e2497dadcd2511'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:26:52.109707 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-23a3fb09-6dd1-454a-ad0e-da5366703504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c5c4d20a894da884e2497dadcd2511'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:26:52.116452 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 730/1448] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:26:51 2021] DELETE /identity/v3/users/99c5c4d20a894da884e2497dadcd2511 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:26:52.121474 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c7215-0434-476f-90e5-1ce73dbd28f8 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:26:52.121958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c7215-0434-476f-90e5-1ce73dbd28f8 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:26:52.122069 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c7215-0434-476f-90e5-1ce73dbd28f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:26:52.139599 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-412c7215-0434-476f-90e5-1ce73dbd28f8 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:26:52.140791 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-412c7215-0434-476f-90e5-1ce73dbd28f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:26:52.197126 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 719/1449] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:26:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:26:52.207747 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3fb09-6dd1-454a-ad0e-da5366703504 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:26:52.209183 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-23a3fb09-6dd1-454a-ad0e-da5366703504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:26:52.264523 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3fb09-6dd1-454a-ad0e-da5366703504 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:26:52.268096 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2d6db-b75e-4eae-a58b-5b7e920123de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:26:52.268761 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2d6db-b75e-4eae-a58b-5b7e920123de service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:26:52.269067 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2d6db-b75e-4eae-a58b-5b7e920123de service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:26:52.269339 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2d6db-b75e-4eae-a58b-5b7e920123de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:26:52.278030 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2d6db-b75e-4eae-a58b-5b7e920123de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:26:52.279570 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2d6db-b75e-4eae-a58b-5b7e920123de service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:26:52.288737 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 731/1450] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:26:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:26:52.739282 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c7215-0434-476f-90e5-1ce73dbd28f8 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:26:52.743173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-412c7215-0434-476f-90e5-1ce73dbd28f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:26:52.753674 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c7215-0434-476f-90e5-1ce73dbd28f8 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:26:52.758252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a9e54-b7e1-42f9-89e1-eb6582077ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:26:52.759158 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a9e54-b7e1-42f9-89e1-eb6582077ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:26:52.759448 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a9e54-b7e1-42f9-89e1-eb6582077ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:26:52.759722 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a9e54-b7e1-42f9-89e1-eb6582077ec9 admin admin] PATH_INFO: `/v3/projects/5aae63e1806e471984cfd2444abb0f3d` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:26:52.760958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a9e54-b7e1-42f9-89e1-eb6582077ec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aae63e1806e471984cfd2444abb0f3d)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:26:52.766265 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING py.warnings [None req-292a9e54-b7e1-42f9-89e1-eb6582077ec9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:26:52.766265 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: warnings.warn(msg) Aug 27 01:26:52.766265 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: Aug 27 01:26:52.766265 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a9e54-b7e1-42f9-89e1-eb6582077ec9 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:26:52.870170 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-292a9e54-b7e1-42f9-89e1-eb6582077ec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aae63e1806e471984cfd2444abb0f3d', 'request_id': 'req-292a9e54-b7e1-42f9-89e1-eb6582077ec9'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:26:52.883518 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-292a9e54-b7e1-42f9-89e1-eb6582077ec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aae63e1806e471984cfd2444abb0f3d', 'request_id': 'req-292a9e54-b7e1-42f9-89e1-eb6582077ec9'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:26:52.966108 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-292a9e54-b7e1-42f9-89e1-eb6582077ec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aae63e1806e471984cfd2444abb0f3d', 'request_id': 'req-292a9e54-b7e1-42f9-89e1-eb6582077ec9'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:26:52.976977 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-292a9e54-b7e1-42f9-89e1-eb6582077ec9 admin admin] The token cache is being invalidate because project 5aae63e1806e471984cfd2444abb0f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:26:52.977261 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-292a9e54-b7e1-42f9-89e1-eb6582077ec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:26:52.977886 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-292a9e54-b7e1-42f9-89e1-eb6582077ec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:26:52.979492 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 720/1451] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:26:52 2021] DELETE /identity/v3/projects/5aae63e1806e471984cfd2444abb0f3d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:28:17.993205 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6a602-9ddc-4028-8f59-74a23a585d11 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:17.994487 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6a602-9ddc-4028-8f59-74a23a585d11 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:17.994487 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6a602-9ddc-4028-8f59-74a23a585d11 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:17.995588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 732/1452] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 27 01:28:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:28:18.000944 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b214f6f-e12d-4b3f-98a2-94250b845356 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:18.001364 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b214f6f-e12d-4b3f-98a2-94250b845356 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:18.001496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b214f6f-e12d-4b3f-98a2-94250b845356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:18.021074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-5b214f6f-e12d-4b3f-98a2-94250b845356 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:28:18.022303 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-5b214f6f-e12d-4b3f-98a2-94250b845356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:28:18.077812 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 721/1453] 127.0.0.1 () {58 vars in 999 bytes} [Fri Aug 27 01:28:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:28:18.239497 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6a602-9ddc-4028-8f59-74a23a585d11 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:28:18.241220 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-ada6a602-9ddc-4028-8f59-74a23a585d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:28:18.311559 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6a602-9ddc-4028-8f59-74a23a585d11 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:28:18.318299 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e3f4e-6a9f-4b97-ac25-1e343cb775bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:28:18.318963 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e3f4e-6a9f-4b97-ac25-1e343cb775bd service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:18.319246 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e3f4e-6a9f-4b97-ac25-1e343cb775bd service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:18.319524 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e3f4e-6a9f-4b97-ac25-1e343cb775bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:18.327925 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e3f4e-6a9f-4b97-ac25-1e343cb775bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:28:18.329575 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e3f4e-6a9f-4b97-ac25-1e343cb775bd service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:28:18.338712 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 733/1454] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:28:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:28:18.672990 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b79ccb-d260-4775-b4f4-00b0478caebb None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:18.673285 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b79ccb-d260-4775-b4f4-00b0478caebb None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:18.673560 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b79ccb-d260-4775-b4f4-00b0478caebb None None] PATH_INFO: `/v3` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:18.674884 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 722/1455] 10.222.0.24 () {54 vars in 926 bytes} [Fri Aug 27 01:28:18 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:28:18.682074 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeda70-0707-470e-b3bd-441b236a94a2 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:18.682365 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeda70-0707-470e-b3bd-441b236a94a2 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:18.682643 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeda70-0707-470e-b3bd-441b236a94a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:18.701110 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-0daeda70-0707-470e-b3bd-441b236a94a2 None None] MFA Rules not processed for user `d67c0b68ca7349399d9ea9f4a0b2b564`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:28:18.702312 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-0daeda70-0707-470e-b3bd-441b236a94a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:28:18.761692 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 734/1456] 10.222.0.24 () {58 vars in 1016 bytes} [Fri Aug 27 01:28:18 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:28:19.688720 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca362111-dcca-4f6e-b87b-b2a520992b9a None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:19.689297 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca362111-dcca-4f6e-b87b-b2a520992b9a None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:19.689297 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca362111-dcca-4f6e-b87b-b2a520992b9a None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:19.691034 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 723/1457] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 27 01:28:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:28:19.696376 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b24224-4c1b-4061-9cf8-b417bec7a611 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:19.696772 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b24224-4c1b-4061-9cf8-b417bec7a611 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:19.696950 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b24224-4c1b-4061-9cf8-b417bec7a611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:19.714742 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-c3b24224-4c1b-4061-9cf8-b417bec7a611 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:28:19.715925 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c3b24224-4c1b-4061-9cf8-b417bec7a611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:28:19.724083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 735/1458] 127.0.0.1 () {58 vars in 999 bytes} [Fri Aug 27 01:28:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:28:19.874400 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca362111-dcca-4f6e-b87b-b2a520992b9a None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:28:19.888691 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca362111-dcca-4f6e-b87b-b2a520992b9a None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:28:19.894094 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f20090-712f-4406-9ac3-90dacf5cbe7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:28:19.894719 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f20090-712f-4406-9ac3-90dacf5cbe7f service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:19.894998 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f20090-712f-4406-9ac3-90dacf5cbe7f service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:19.895268 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f20090-712f-4406-9ac3-90dacf5cbe7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:19.902962 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f20090-712f-4406-9ac3-90dacf5cbe7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:28:19.904534 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f20090-712f-4406-9ac3-90dacf5cbe7f service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:28:19.913766 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 724/1459] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:28:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:28:28.626175 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c698e6-69bb-4ad9-9d6e-e128877d2ac3 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:28.626624 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c698e6-69bb-4ad9-9d6e-e128877d2ac3 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:28.626720 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c698e6-69bb-4ad9-9d6e-e128877d2ac3 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:28.628518 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 736/1460] 10.222.0.25 () {54 vars in 960 bytes} [Fri Aug 27 01:28:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:28:28.633846 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750325f-18ff-4ccb-99ca-7ec98d2b0936 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:28.634284 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750325f-18ff-4ccb-99ca-7ec98d2b0936 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:28.634385 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750325f-18ff-4ccb-99ca-7ec98d2b0936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:28.653128 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-1750325f-18ff-4ccb-99ca-7ec98d2b0936 None None] MFA Rules not processed for user `d67c0b68ca7349399d9ea9f4a0b2b564`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:28:28.654313 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1750325f-18ff-4ccb-99ca-7ec98d2b0936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:28:28.663186 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 725/1461] 10.222.0.25 () {58 vars in 1058 bytes} [Fri Aug 27 01:28:28 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:28:28.670729 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c698e6-69bb-4ad9-9d6e-e128877d2ac3 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:28:28.683733 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c698e6-69bb-4ad9-9d6e-e128877d2ac3 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:28:28.688886 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014e60f-3bcc-47e0-87fc-6628688e4d06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd67c0b68ca7349399d9ea9f4a0b2b564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:28:28.689507 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014e60f-3bcc-47e0-87fc-6628688e4d06 service placement] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:28.689788 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014e60f-3bcc-47e0-87fc-6628688e4d06 service placement] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:28.690146 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014e60f-3bcc-47e0-87fc-6628688e4d06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:28.698329 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014e60f-3bcc-47e0-87fc-6628688e4d06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:28:28.699904 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014e60f-3bcc-47e0-87fc-6628688e4d06 service placement] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:28:28.709881 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 737/1462] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:28:28 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:28:31.700683 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302733e8-aef8-4a3e-9d57-31f06965fad9 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:31.701249 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302733e8-aef8-4a3e-9d57-31f06965fad9 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:31.701249 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302733e8-aef8-4a3e-9d57-31f06965fad9 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:31.702963 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 726/1463] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 27 01:28:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:28:31.709405 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01717781-cc01-494e-890b-8393495cee50 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:31.709851 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01717781-cc01-494e-890b-8393495cee50 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:31.709959 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01717781-cc01-494e-890b-8393495cee50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:31.730293 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-01717781-cc01-494e-890b-8393495cee50 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:28:31.734367 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-01717781-cc01-494e-890b-8393495cee50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:28:31.739416 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 738/1464] 127.0.0.1 () {58 vars in 999 bytes} [Fri Aug 27 01:28:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:28:31.895567 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302733e8-aef8-4a3e-9d57-31f06965fad9 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:28:31.910540 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302733e8-aef8-4a3e-9d57-31f06965fad9 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:28:31.916003 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996055b-4b31-4e4d-b52c-99e4aa3a74cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:28:31.916640 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996055b-4b31-4e4d-b52c-99e4aa3a74cf service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:31.916950 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996055b-4b31-4e4d-b52c-99e4aa3a74cf service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:31.917224 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996055b-4b31-4e4d-b52c-99e4aa3a74cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:31.925135 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996055b-4b31-4e4d-b52c-99e4aa3a74cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:28:31.926889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996055b-4b31-4e4d-b52c-99e4aa3a74cf service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:28:31.936304 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 727/1465] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:28:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:28:33.277930 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211d430-cb6c-444e-9bb2-00d3249b366c None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:33.278469 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211d430-cb6c-444e-9bb2-00d3249b366c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:33.278469 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211d430-cb6c-444e-9bb2-00d3249b366c None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:33.280204 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 739/1466] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 27 01:28:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:28:33.285960 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe980ab-c65f-4cff-bb73-e5efaa9571b8 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:33.286437 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe980ab-c65f-4cff-bb73-e5efaa9571b8 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:33.286533 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe980ab-c65f-4cff-bb73-e5efaa9571b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:33.305509 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-abe980ab-c65f-4cff-bb73-e5efaa9571b8 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:28:33.306695 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-abe980ab-c65f-4cff-bb73-e5efaa9571b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:28:33.314735 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 728/1467] 127.0.0.1 () {58 vars in 999 bytes} [Fri Aug 27 01:28:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:28:33.467775 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211d430-cb6c-444e-9bb2-00d3249b366c None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:28:33.481800 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211d430-cb6c-444e-9bb2-00d3249b366c None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:28:33.487320 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a20e84-affd-4c10-85e2-b7e478393d50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:28:33.487946 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a20e84-affd-4c10-85e2-b7e478393d50 service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:33.488224 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a20e84-affd-4c10-85e2-b7e478393d50 service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:33.488496 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a20e84-affd-4c10-85e2-b7e478393d50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:33.496261 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a20e84-affd-4c10-85e2-b7e478393d50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:28:33.497868 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a20e84-affd-4c10-85e2-b7e478393d50 service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:28:33.507510 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 740/1468] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:28:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:28:37.463328 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967804e-0ab0-4444-abc3-fe622a6feb2c None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:37.528549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967804e-0ab0-4444-abc3-fe622a6feb2c None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:37.528549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967804e-0ab0-4444-abc3-fe622a6feb2c None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:37.528549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 729/1469] 127.0.0.1 () {54 vars in 916 bytes} [Fri Aug 27 01:28:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:28:37.528956 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d544873-9e99-4d53-886d-08172f0e7846 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:37.528956 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d544873-9e99-4d53-886d-08172f0e7846 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:37.528956 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d544873-9e99-4d53-886d-08172f0e7846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:37.528956 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-0d544873-9e99-4d53-886d-08172f0e7846 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:28:37.528956 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-0d544873-9e99-4d53-886d-08172f0e7846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:28:37.528956 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 741/1470] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 27 01:28:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:28:37.539340 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967804e-0ab0-4444-abc3-fe622a6feb2c None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:28:37.541295 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-6967804e-0ab0-4444-abc3-fe622a6feb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:28:37.596529 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967804e-0ab0-4444-abc3-fe622a6feb2c None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:28:37.600082 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf46b4b-4ebb-40b8-9989-468ad37fd6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:28:37.600711 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf46b4b-4ebb-40b8-9989-468ad37fd6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:37.601027 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf46b4b-4ebb-40b8-9989-468ad37fd6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:37.607288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf46b4b-4ebb-40b8-9989-468ad37fd6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:37.609971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf46b4b-4ebb-40b8-9989-468ad37fd6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:28:37.611449 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf46b4b-4ebb-40b8-9989-468ad37fd6b9 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:28:37.621096 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 730/1471] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:28:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:28:39.771499 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88740b2-4325-480d-be9b-174528934132 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:39.772040 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88740b2-4325-480d-be9b-174528934132 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:39.772040 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88740b2-4325-480d-be9b-174528934132 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:39.773805 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 742/1472] 127.0.0.1 () {54 vars in 916 bytes} [Fri Aug 27 01:28:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:28:39.779613 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc05bf-07ed-4bdd-9fc1-7be3d253771c None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:39.780038 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc05bf-07ed-4bdd-9fc1-7be3d253771c None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:39.780145 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc05bf-07ed-4bdd-9fc1-7be3d253771c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:39.797551 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-bbfc05bf-07ed-4bdd-9fc1-7be3d253771c None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:28:39.798734 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-bbfc05bf-07ed-4bdd-9fc1-7be3d253771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:28:39.807201 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 731/1473] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 27 01:28:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:28:39.844069 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88740b2-4325-480d-be9b-174528934132 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:28:39.854730 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88740b2-4325-480d-be9b-174528934132 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:28:39.858228 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f6a4e-c21c-4b27-b199-0493c882afe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:28:39.858851 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f6a4e-c21c-4b27-b199-0493c882afe1 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:39.859128 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f6a4e-c21c-4b27-b199-0493c882afe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:39.859398 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f6a4e-c21c-4b27-b199-0493c882afe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:39.868427 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f6a4e-c21c-4b27-b199-0493c882afe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:28:39.869953 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f6a4e-c21c-4b27-b199-0493c882afe1 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:28:39.879656 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 743/1474] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:28:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:28:43.600752 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40599a9-8129-46d8-a047-d46d78322d3b None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:43.601347 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40599a9-8129-46d8-a047-d46d78322d3b None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:43.601347 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40599a9-8129-46d8-a047-d46d78322d3b None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:43.603194 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 732/1475] 127.0.0.1 () {54 vars in 916 bytes} [Fri Aug 27 01:28:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:28:43.609280 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4053ca7-2f62-4784-b516-062d7d687b58 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:43.609724 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4053ca7-2f62-4784-b516-062d7d687b58 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:43.609830 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4053ca7-2f62-4784-b516-062d7d687b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:43.628635 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f4053ca7-2f62-4784-b516-062d7d687b58 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:28:43.629870 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f4053ca7-2f62-4784-b516-062d7d687b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:28:43.637486 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 744/1476] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 27 01:28:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:28:43.691523 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40599a9-8129-46d8-a047-d46d78322d3b None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:28:43.693180 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d40599a9-8129-46d8-a047-d46d78322d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:28:43.752468 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40599a9-8129-46d8-a047-d46d78322d3b None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:28:43.756187 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a043b-bd3f-4c69-8071-987adee19b05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:28:43.756825 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a043b-bd3f-4c69-8071-987adee19b05 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:43.757136 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a043b-bd3f-4c69-8071-987adee19b05 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:43.757412 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a043b-bd3f-4c69-8071-987adee19b05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:43.766072 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a043b-bd3f-4c69-8071-987adee19b05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:28:43.767524 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a043b-bd3f-4c69-8071-987adee19b05 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:28:43.776819 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 733/1477] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:28:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:28:45.931866 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8934049-7e3b-43ae-a34f-6d9d32cf35ea None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:45.932415 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8934049-7e3b-43ae-a34f-6d9d32cf35ea None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:45.932544 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8934049-7e3b-43ae-a34f-6d9d32cf35ea None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:45.934276 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 745/1478] 127.0.0.1 () {54 vars in 916 bytes} [Fri Aug 27 01:28:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:28:45.940761 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f217a2-97fc-489d-b29e-361c866a1cca None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:45.941242 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f217a2-97fc-489d-b29e-361c866a1cca None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:45.941345 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f217a2-97fc-489d-b29e-361c866a1cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:45.959171 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-23f217a2-97fc-489d-b29e-361c866a1cca None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:28:45.960357 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-23f217a2-97fc-489d-b29e-361c866a1cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:28:45.967952 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 734/1479] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 27 01:28:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:28:46.021059 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a79558-554e-496f-979d-f7ed9bdcdb82 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:46.021345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a79558-554e-496f-979d-f7ed9bdcdb82 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:46.021624 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a79558-554e-496f-979d-f7ed9bdcdb82 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:46.023375 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 746/1480] 10.222.0.25 () {54 vars in 966 bytes} [Fri Aug 27 01:28:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:28:46.028845 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d54cb9-6a2a-48f8-8205-cb91ed7245dc None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:46.029160 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d54cb9-6a2a-48f8-8205-cb91ed7245dc None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:46.029443 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d54cb9-6a2a-48f8-8205-cb91ed7245dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:46.047291 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-50d54cb9-6a2a-48f8-8205-cb91ed7245dc None None] MFA Rules not processed for user `686fb610b1ac47388bffbcfdf8f15907`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:28:46.048487 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-50d54cb9-6a2a-48f8-8205-cb91ed7245dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:28:46.055572 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 735/1481] 10.222.0.25 () {58 vars in 1064 bytes} [Fri Aug 27 01:28:46 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:28:46.063709 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a79558-554e-496f-979d-f7ed9bdcdb82 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:28:46.074833 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a79558-554e-496f-979d-f7ed9bdcdb82 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:28:46.078462 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d23cf1-eee6-469b-9795-510ca3f39dc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:28:46.079100 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d23cf1-eee6-469b-9795-510ca3f39dc1 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:28:46.079382 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d23cf1-eee6-469b-9795-510ca3f39dc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:28:46.079657 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d23cf1-eee6-469b-9795-510ca3f39dc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:28:46.088666 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d23cf1-eee6-469b-9795-510ca3f39dc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:28:46.090154 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d23cf1-eee6-469b-9795-510ca3f39dc1 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:28:46.099724 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 747/1482] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:28:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:30:05.312120 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8897cad-2918-4df7-99a9-751dcee1c0ae None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:05.314359 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8897cad-2918-4df7-99a9-751dcee1c0ae None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:05.314882 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8897cad-2918-4df7-99a9-751dcee1c0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:05.337644 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-a8897cad-2918-4df7-99a9-751dcee1c0ae None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:05.339202 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a8897cad-2918-4df7-99a9-751dcee1c0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:05.351489 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 736/1483] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:05.361092 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f23c8-56e1-49f3-9855-2649539c614b None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:05.361623 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f23c8-56e1-49f3-9855-2649539c614b None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:05.361623 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f23c8-56e1-49f3-9855-2649539c614b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:05.394909 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-5f0f23c8-56e1-49f3-9855-2649539c614b None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:05.394909 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-5f0f23c8-56e1-49f3-9855-2649539c614b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:05.407802 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 748/1484] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:05.416167 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8897cad-2918-4df7-99a9-751dcee1c0ae None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:05.432997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8897cad-2918-4df7-99a9-751dcee1c0ae None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:05.441451 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff1b1c-34bb-4a59-9395-8b617e94b6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:05.442404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff1b1c-34bb-4a59-9395-8b617e94b6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:05.442889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff1b1c-34bb-4a59-9395-8b617e94b6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:05.443360 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff1b1c-34bb-4a59-9395-8b617e94b6b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:05.444332 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff1b1c-34bb-4a59-9395-8b617e94b6b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:30:05.444869 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff1b1c-34bb-4a59-9395-8b617e94b6b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:05.446689 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff1b1c-34bb-4a59-9395-8b617e94b6b5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:05.461059 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 737/1485] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:30:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:30:05.470015 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f23c8-56e1-49f3-9855-2649539c614b None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:05.482819 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f23c8-56e1-49f3-9855-2649539c614b None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:05.491659 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a0a92-3e11-4b59-b197-b049752abc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:05.492810 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a0a92-3e11-4b59-b197-b049752abc6f admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:05.492810 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a0a92-3e11-4b59-b197-b049752abc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:05.493033 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a0a92-3e11-4b59-b197-b049752abc6f admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:05.493661 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a0a92-3e11-4b59-b197-b049752abc6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:05.495579 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a0a92-3e11-4b59-b197-b049752abc6f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:05.613271 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 749/1486] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:30:05 2021] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:05.617762 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff1b1c-34bb-4a59-9395-8b617e94b6b5 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:05.630446 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff1b1c-34bb-4a59-9395-8b617e94b6b5 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:05.699786 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce438f-39f9-4c3d-9e70-93b1444b15f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:05.700905 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce438f-39f9-4c3d-9e70-93b1444b15f8 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:05.701420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce438f-39f9-4c3d-9e70-93b1444b15f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:05.701914 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce438f-39f9-4c3d-9e70-93b1444b15f8 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:05.702820 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce438f-39f9-4c3d-9e70-93b1444b15f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:05.710122 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce438f-39f9-4c3d-9e70-93b1444b15f8 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:05.735541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c4467-a762-40bd-87e1-9a76090fff15 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:05.735899 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c4467-a762-40bd-87e1-9a76090fff15 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:05.736106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c4467-a762-40bd-87e1-9a76090fff15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:05.764289 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-6d9c4467-a762-40bd-87e1-9a76090fff15 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:05.765835 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-6d9c4467-a762-40bd-87e1-9a76090fff15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:05.777284 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 750/1487] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:30:05.787047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e4eda-5e52-45d2-a577-4de9739b183b None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:05.790882 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e4eda-5e52-45d2-a577-4de9739b183b None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:05.790882 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e4eda-5e52-45d2-a577-4de9739b183b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:05.815859 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-4b3e4eda-5e52-45d2-a577-4de9739b183b None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:05.815859 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-4b3e4eda-5e52-45d2-a577-4de9739b183b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:05.820279 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 738/1488] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:30:05 2021] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:05.824872 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce438f-39f9-4c3d-9e70-93b1444b15f8 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:05.832691 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 751/1489] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:30:05.837922 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e4eda-5e52-45d2-a577-4de9739b183b None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:05.839840 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce438f-39f9-4c3d-9e70-93b1444b15f8 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:05.849860 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e4eda-5e52-45d2-a577-4de9739b183b None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:05.850212 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7efaeb-29e7-4c42-a071-8d4a957b6c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:05.851245 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7efaeb-29e7-4c42-a071-8d4a957b6c38 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:05.851775 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7efaeb-29e7-4c42-a071-8d4a957b6c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:05.852239 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7efaeb-29e7-4c42-a071-8d4a957b6c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:05.853247 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7efaeb-29e7-4c42-a071-8d4a957b6c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:05.855343 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7efaeb-29e7-4c42-a071-8d4a957b6c38 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:05.864961 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e7e32-e0b6-4c92-a6a2-535f6d8a4e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:05.864961 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e7e32-e0b6-4c92-a6a2-535f6d8a4e2b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:05.864961 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e7e32-e0b6-4c92-a6a2-535f6d8a4e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:05.864961 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e7e32-e0b6-4c92-a6a2-535f6d8a4e2b admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:05.865393 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e7e32-e0b6-4c92-a6a2-535f6d8a4e2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:30:05.865393 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e7e32-e0b6-4c92-a6a2-535f6d8a4e2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:05.866807 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e7e32-e0b6-4c92-a6a2-535f6d8a4e2b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:05.877652 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 739/1490] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:05 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:05.879404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101cf7a-2318-4b9e-8ac4-20db8660d77d None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:05.879899 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101cf7a-2318-4b9e-8ac4-20db8660d77d None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:05.880378 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101cf7a-2318-4b9e-8ac4-20db8660d77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:05.892620 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 752/1491] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:30:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:30:05.893944 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f1f8e-fa57-4c8d-b941-32e56670215f None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:05.894240 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f1f8e-fa57-4c8d-b941-32e56670215f None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:05.894521 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f1f8e-fa57-4c8d-b941-32e56670215f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:05.904007 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-2101cf7a-2318-4b9e-8ac4-20db8660d77d None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:05.905521 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-2101cf7a-2318-4b9e-8ac4-20db8660d77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:05.923165 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 740/1492] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:05.924484 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101cf7a-2318-4b9e-8ac4-20db8660d77d None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:05.934268 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-335f1f8e-fa57-4c8d-b941-32e56670215f None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:05.935509 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-335f1f8e-fa57-4c8d-b941-32e56670215f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:05.940364 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101cf7a-2318-4b9e-8ac4-20db8660d77d None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:05.945251 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 753/1493] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:05.945716 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dff067-35e1-4968-962c-2ee2b50fb5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:05.946030 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f1f8e-fa57-4c8d-b941-32e56670215f None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:05.946898 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dff067-35e1-4968-962c-2ee2b50fb5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:05.947368 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dff067-35e1-4968-962c-2ee2b50fb5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:05.947836 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dff067-35e1-4968-962c-2ee2b50fb5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:05.948803 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dff067-35e1-4968-962c-2ee2b50fb5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:05.951030 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dff067-35e1-4968-962c-2ee2b50fb5d2 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:05.956411 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f1f8e-fa57-4c8d-b941-32e56670215f None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:05.961018 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c06fd-eca3-47d0-91da-d03395805cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:05.961858 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c06fd-eca3-47d0-91da-d03395805cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:05.962144 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c06fd-eca3-47d0-91da-d03395805cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:05.962417 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c06fd-eca3-47d0-91da-d03395805cd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:05.962965 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 741/1494] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:05 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:05.963088 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c06fd-eca3-47d0-91da-d03395805cd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:05.964396 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cfd05-1d5d-4446-a59e-6cefd7e22fda None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:05.964692 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cfd05-1d5d-4446-a59e-6cefd7e22fda None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:05.965005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cfd05-1d5d-4446-a59e-6cefd7e22fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:05.965104 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c06fd-eca3-47d0-91da-d03395805cd0 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:05.990073 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-ea3cfd05-1d5d-4446-a59e-6cefd7e22fda None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:05.991283 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ea3cfd05-1d5d-4446-a59e-6cefd7e22fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:05.999211 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 742/1495] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:06.000479 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99597d-7915-4b9e-afb1-d13f5fa8f20a None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.000735 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99597d-7915-4b9e-afb1-d13f5fa8f20a None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.001042 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99597d-7915-4b9e-afb1-d13f5fa8f20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.018223 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-fe99597d-7915-4b9e-afb1-d13f5fa8f20a None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:06.019393 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-fe99597d-7915-4b9e-afb1-d13f5fa8f20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:06.027074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 743/1496] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:06.028322 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63ceb7-95ea-4520-b4fb-0edc880d06c8 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.028606 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63ceb7-95ea-4520-b4fb-0edc880d06c8 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.028903 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63ceb7-95ea-4520-b4fb-0edc880d06c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.046162 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-7a63ceb7-95ea-4520-b4fb-0edc880d06c8 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:06.047918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-7a63ceb7-95ea-4520-b4fb-0edc880d06c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:06.055672 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 744/1497] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:06.056919 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffa8f3-89fb-402f-8093-3cc3627be1b8 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.057203 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffa8f3-89fb-402f-8093-3cc3627be1b8 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.057733 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffa8f3-89fb-402f-8093-3cc3627be1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.074745 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-0bffa8f3-89fb-402f-8093-3cc3627be1b8 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:06.076019 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-0bffa8f3-89fb-402f-8093-3cc3627be1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:06.081219 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 754/1498] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:30:05 2021] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:06.081429 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d137f-4bc8-4b18-bd31-f458cc3e7a13 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.084749 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d137f-4bc8-4b18-bd31-f458cc3e7a13 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.084749 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d137f-4bc8-4b18-bd31-f458cc3e7a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.087053 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 745/1499] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:06.087826 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffa8f3-89fb-402f-8093-3cc3627be1b8 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:06.098201 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffa8f3-89fb-402f-8093-3cc3627be1b8 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:06.101039 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-a43d137f-4bc8-4b18-bd31-f458cc3e7a13 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:06.102227 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a43d137f-4bc8-4b18-bd31-f458cc3e7a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:06.150844 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb5379-56fa-4129-9464-d17ee36787f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:06.151728 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb5379-56fa-4129-9464-d17ee36787f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.152012 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb5379-56fa-4129-9464-d17ee36787f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.152289 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb5379-56fa-4129-9464-d17ee36787f4 admin admin] PATH_INFO: `/v3/projects/1d392d1b39ee49d1b87211d5c447f9dc/users/fa605019ca5c40d897cb30c990710ff6/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.158852 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 755/1500] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:06.159938 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f466dbf-5072-4fc5-8caf-f17f1e3e4ed7 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.160225 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f466dbf-5072-4fc5-8caf-f17f1e3e4ed7 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.160503 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f466dbf-5072-4fc5-8caf-f17f1e3e4ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.167374 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb5379-56fa-4129-9464-d17ee36787f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d392d1b39ee49d1b87211d5c447f9dc, user_id=fa605019ca5c40d897cb30c990710ff6, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:06.170133 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb5379-56fa-4129-9464-d17ee36787f4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:06.178043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-5f466dbf-5072-4fc5-8caf-f17f1e3e4ed7 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:06.179228 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-5f466dbf-5072-4fc5-8caf-f17f1e3e4ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:06.187127 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 756/1501] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:06.192001 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fe328-bbd0-43a5-a3b0-8efba0b22b3b None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.192001 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fe328-bbd0-43a5-a3b0-8efba0b22b3b None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.192001 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fe328-bbd0-43a5-a3b0-8efba0b22b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.206972 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-c39fe328-bbd0-43a5-a3b0-8efba0b22b3b None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:06.208125 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c39fe328-bbd0-43a5-a3b0-8efba0b22b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:06.215752 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 757/1502] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:06.216487 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fe328-bbd0-43a5-a3b0-8efba0b22b3b None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:06.226205 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fe328-bbd0-43a5-a3b0-8efba0b22b3b None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:06.230588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77334d65-16ef-4e0a-af16-b15d613eeea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:06.231300 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77334d65-16ef-4e0a-af16-b15d613eeea6 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.231579 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77334d65-16ef-4e0a-af16-b15d613eeea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.231863 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77334d65-16ef-4e0a-af16-b15d613eeea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.232542 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77334d65-16ef-4e0a-af16-b15d613eeea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:30:06.232863 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77334d65-16ef-4e0a-af16-b15d613eeea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:06.234510 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77334d65-16ef-4e0a-af16-b15d613eeea6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:06.245308 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 758/1503] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:30:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:30:06.249068 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331397b-122e-46e3-beeb-07e501bbed11 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.249068 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331397b-122e-46e3-beeb-07e501bbed11 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.249068 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331397b-122e-46e3-beeb-07e501bbed11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.263382 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-4331397b-122e-46e3-beeb-07e501bbed11 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:06.264552 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-4331397b-122e-46e3-beeb-07e501bbed11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:06.276346 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 759/1504] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:06.277160 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331397b-122e-46e3-beeb-07e501bbed11 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:06.281125 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 746/1505] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:06 2021] PUT /identity/v3/projects/1d392d1b39ee49d1b87211d5c447f9dc/users/fa605019ca5c40d897cb30c990710ff6/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:06.283583 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762df9-9155-4f4b-ac76-e5b427214bf1 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.284282 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762df9-9155-4f4b-ac76-e5b427214bf1 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.284558 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762df9-9155-4f4b-ac76-e5b427214bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.292009 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331397b-122e-46e3-beeb-07e501bbed11 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:06.302721 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-25762df9-9155-4f4b-ac76-e5b427214bf1 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:06.303930 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-25762df9-9155-4f4b-ac76-e5b427214bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:06.346963 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2661924-c37f-4966-950f-6075d3ceaff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:06.347640 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2661924-c37f-4966-950f-6075d3ceaff9 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.347921 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2661924-c37f-4966-950f-6075d3ceaff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.348197 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2661924-c37f-4966-950f-6075d3ceaff9 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.348908 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2661924-c37f-4966-950f-6075d3ceaff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:06.350839 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2661924-c37f-4966-950f-6075d3ceaff9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:06.367388 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 747/1506] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:06.371110 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25762df9-9155-4f4b-ac76-e5b427214bf1 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:06.377360 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25762df9-9155-4f4b-ac76-e5b427214bf1 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:06.381783 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfdf2a-6ada-4627-a072-a366fe6f8c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:06.382406 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfdf2a-6ada-4627-a072-a366fe6f8c3d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.382685 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfdf2a-6ada-4627-a072-a366fe6f8c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.382957 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfdf2a-6ada-4627-a072-a366fe6f8c3d admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.383693 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfdf2a-6ada-4627-a072-a366fe6f8c3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:30:06.383998 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfdf2a-6ada-4627-a072-a366fe6f8c3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:06.385630 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfdf2a-6ada-4627-a072-a366fe6f8c3d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:06.397515 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 748/1507] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:30:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:30:06.398962 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde88094-1df9-4fc6-8291-3adf5d4b514a None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.399248 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde88094-1df9-4fc6-8291-3adf5d4b514a None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.399523 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde88094-1df9-4fc6-8291-3adf5d4b514a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.421933 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-dde88094-1df9-4fc6-8291-3adf5d4b514a None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:06.421933 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-dde88094-1df9-4fc6-8291-3adf5d4b514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:06.428506 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 749/1508] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:06.429356 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde88094-1df9-4fc6-8291-3adf5d4b514a None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:06.440617 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde88094-1df9-4fc6-8291-3adf5d4b514a None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:06.445726 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967c738-2601-4790-8540-1865c8e107ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:06.454493 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967c738-2601-4790-8540-1865c8e107ed admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.454493 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967c738-2601-4790-8540-1865c8e107ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.454493 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967c738-2601-4790-8540-1865c8e107ed admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.454493 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967c738-2601-4790-8540-1865c8e107ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:30:06.454493 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967c738-2601-4790-8540-1865c8e107ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:06.454961 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 760/1509] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:30:06 2021] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:06.454961 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2661924-c37f-4966-950f-6075d3ceaff9 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:06.455484 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967c738-2601-4790-8540-1865c8e107ed admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:06.459911 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2661924-c37f-4966-950f-6075d3ceaff9 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:06.463645 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 750/1510] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:30:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:30:06.465136 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5c1b6-f93e-44a1-a051-efc2da5761a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:06.475214 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5c1b6-f93e-44a1-a051-efc2da5761a4 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.475214 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5c1b6-f93e-44a1-a051-efc2da5761a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.475438 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49f502-9212-40cc-a3c0-7cecda3fc630 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.475536 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5c1b6-f93e-44a1-a051-efc2da5761a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.475630 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49f502-9212-40cc-a3c0-7cecda3fc630 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.475630 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49f502-9212-40cc-a3c0-7cecda3fc630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.475808 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5c1b6-f93e-44a1-a051-efc2da5761a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:06.475808 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5c1b6-f93e-44a1-a051-efc2da5761a4 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:06.485254 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-ad49f502-9212-40cc-a3c0-7cecda3fc630 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:06.486617 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ad49f502-9212-40cc-a3c0-7cecda3fc630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:06.494516 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 751/1511] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:06.497469 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49f502-9212-40cc-a3c0-7cecda3fc630 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:06.505148 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49f502-9212-40cc-a3c0-7cecda3fc630 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:06.509875 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf8c80-cb26-493e-8c48-c6370a0237c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:06.510514 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf8c80-cb26-493e-8c48-c6370a0237c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.510796 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf8c80-cb26-493e-8c48-c6370a0237c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.511066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf8c80-cb26-493e-8c48-c6370a0237c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.511769 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf8c80-cb26-493e-8c48-c6370a0237c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:30:06.512072 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf8c80-cb26-493e-8c48-c6370a0237c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:06.513684 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf8c80-cb26-493e-8c48-c6370a0237c1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:06.525884 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 752/1512] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:30:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:30:06.526720 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf8c80-cb26-493e-8c48-c6370a0237c1 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:06.538069 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf8c80-cb26-493e-8c48-c6370a0237c1 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:06.548252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80bea9-0b6c-4f84-839c-a325e4c4e0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:06.548252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80bea9-0b6c-4f84-839c-a325e4c4e0aa admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.548252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80bea9-0b6c-4f84-839c-a325e4c4e0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.548252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80bea9-0b6c-4f84-839c-a325e4c4e0aa admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.548927 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80bea9-0b6c-4f84-839c-a325e4c4e0aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:30:06.548927 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80bea9-0b6c-4f84-839c-a325e4c4e0aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:06.548927 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80bea9-0b6c-4f84-839c-a325e4c4e0aa admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:06.561422 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 753/1513] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:30:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:30:06.562977 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80bea9-0b6c-4f84-839c-a325e4c4e0aa admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:06.574076 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80bea9-0b6c-4f84-839c-a325e4c4e0aa admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:06.579907 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8493827-1562-4559-94f9-8b6cf8093979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:06.580555 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8493827-1562-4559-94f9-8b6cf8093979 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.580858 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8493827-1562-4559-94f9-8b6cf8093979 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.581129 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8493827-1562-4559-94f9-8b6cf8093979 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.581813 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8493827-1562-4559-94f9-8b6cf8093979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:06.583791 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8493827-1562-4559-94f9-8b6cf8093979 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:06.602273 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 761/1514] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:30:06 2021] POST /identity/v3/projects => generated 363 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:06.602273 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5c1b6-f93e-44a1-a051-efc2da5761a4 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:06.670650 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5c1b6-f93e-44a1-a051-efc2da5761a4 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:06.676525 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b0509-e7b7-4be8-9461-4a8020c54af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:06.677183 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b0509-e7b7-4be8-9461-4a8020c54af5 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.677467 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b0509-e7b7-4be8-9461-4a8020c54af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.677745 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b0509-e7b7-4be8-9461-4a8020c54af5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.678469 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b0509-e7b7-4be8-9461-4a8020c54af5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:30:06.678779 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b0509-e7b7-4be8-9461-4a8020c54af5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:06.680398 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b0509-e7b7-4be8-9461-4a8020c54af5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:06.689294 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 754/1515] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:30:06 2021] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:06.689294 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8493827-1562-4559-94f9-8b6cf8093979 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:06.703054 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 762/1516] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:30:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:30:06.703054 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b0509-e7b7-4be8-9461-4a8020c54af5 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:06.716469 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b0509-e7b7-4be8-9461-4a8020c54af5 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:06.754341 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8493827-1562-4559-94f9-8b6cf8093979 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:06.761448 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdae16-9d8e-47d0-988a-72180e7c419e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:06.762795 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdae16-9d8e-47d0-988a-72180e7c419e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.763085 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdae16-9d8e-47d0-988a-72180e7c419e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.763362 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdae16-9d8e-47d0-988a-72180e7c419e admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.764195 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdae16-9d8e-47d0-988a-72180e7c419e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:06.765923 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdae16-9d8e-47d0-988a-72180e7c419e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:06.782819 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 755/1517] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:06 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:06.783041 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360887c-a0f0-4261-b6d7-69452b8518bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:06.783146 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdae16-9d8e-47d0-988a-72180e7c419e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:06.783223 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360887c-a0f0-4261-b6d7-69452b8518bf admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.783223 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360887c-a0f0-4261-b6d7-69452b8518bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.783223 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360887c-a0f0-4261-b6d7-69452b8518bf admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.783223 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360887c-a0f0-4261-b6d7-69452b8518bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:06.785081 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360887c-a0f0-4261-b6d7-69452b8518bf admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:06.847175 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdae16-9d8e-47d0-988a-72180e7c419e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:06.850999 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc74d0-eb0d-4f93-8fb7-a24926526a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:06.851679 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc74d0-eb0d-4f93-8fb7-a24926526a58 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.851991 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc74d0-eb0d-4f93-8fb7-a24926526a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.852268 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc74d0-eb0d-4f93-8fb7-a24926526a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.862436 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc74d0-eb0d-4f93-8fb7-a24926526a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:06.863927 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc74d0-eb0d-4f93-8fb7-a24926526a58 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:06.872376 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 763/1518] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:30:06 2021] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:06.873089 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360887c-a0f0-4261-b6d7-69452b8518bf admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:06.875779 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 756/1519] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:06.876363 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc74d0-eb0d-4f93-8fb7-a24926526a58 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:06.887868 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc74d0-eb0d-4f93-8fb7-a24926526a58 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:06.946657 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281f729-9a70-436d-ad5f-79a673e48a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:06.947493 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281f729-9a70-436d-ad5f-79a673e48a74 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.947776 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281f729-9a70-436d-ad5f-79a673e48a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.948147 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281f729-9a70-436d-ad5f-79a673e48a74 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.949201 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281f729-9a70-436d-ad5f-79a673e48a74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:06.949911 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360887c-a0f0-4261-b6d7-69452b8518bf admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:06.951504 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281f729-9a70-436d-ad5f-79a673e48a74 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:06.955282 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5676697-ea89-4d7b-b734-2e1a59608c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:06.955953 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5676697-ea89-4d7b-b734-2e1a59608c73 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:06.956237 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5676697-ea89-4d7b-b734-2e1a59608c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:06.956519 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5676697-ea89-4d7b-b734-2e1a59608c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:06.957328 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5676697-ea89-4d7b-b734-2e1a59608c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:06.959779 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5676697-ea89-4d7b-b734-2e1a59608c73 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:07.037570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 757/1520] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:30:06 2021] POST /identity/v3/projects => generated 389 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:07.037570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281f729-9a70-436d-ad5f-79a673e48a74 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.058336 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 764/1521] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:30:06 2021] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:07.059578 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5676697-ea89-4d7b-b734-2e1a59608c73 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.115425 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281f729-9a70-436d-ad5f-79a673e48a74 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.135209 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5676697-ea89-4d7b-b734-2e1a59608c73 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.140113 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb137aa-f084-4622-b39b-ea307963fe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.141413 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb137aa-f084-4622-b39b-ea307963fe35 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.144457 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb137aa-f084-4622-b39b-ea307963fe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.144457 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb137aa-f084-4622-b39b-ea307963fe35 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.144457 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb137aa-f084-4622-b39b-ea307963fe35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:07.145204 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb137aa-f084-4622-b39b-ea307963fe35 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:07.177600 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e873f-f5f1-4e33-aee7-c6ceb0aa7dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.178349 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e873f-f5f1-4e33-aee7-c6ceb0aa7dea admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.178631 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e873f-f5f1-4e33-aee7-c6ceb0aa7dea admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.178905 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e873f-f5f1-4e33-aee7-c6ceb0aa7dea admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.179691 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e873f-f5f1-4e33-aee7-c6ceb0aa7dea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:07.182448 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e873f-f5f1-4e33-aee7-c6ceb0aa7dea admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:07.256490 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 765/1522] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:30:07 2021] POST /identity/v3/users => generated 295 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:07.258288 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb137aa-f084-4622-b39b-ea307963fe35 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.267069 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb137aa-f084-4622-b39b-ea307963fe35 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.271846 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dccaa-41ca-439f-af49-b360556c6f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.272499 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dccaa-41ca-439f-af49-b360556c6f5c admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.272777 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dccaa-41ca-439f-af49-b360556c6f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.273079 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dccaa-41ca-439f-af49-b360556c6f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.273758 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671dccaa-41ca-439f-af49-b360556c6f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:07.275645 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671dccaa-41ca-439f-af49-b360556c6f5c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:07.316730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 758/1523] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:30:07 2021] POST /identity/v3/users => generated 282 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:07.316730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e873f-f5f1-4e33-aee7-c6ceb0aa7dea admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.326481 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e873f-f5f1-4e33-aee7-c6ceb0aa7dea admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.331903 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2aad21-0bec-4708-98a6-4e48d46bf760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.332547 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2aad21-0bec-4708-98a6-4e48d46bf760 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.332872 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2aad21-0bec-4708-98a6-4e48d46bf760 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.333134 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2aad21-0bec-4708-98a6-4e48d46bf760 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.333843 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2aad21-0bec-4708-98a6-4e48d46bf760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:07.335420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2aad21-0bec-4708-98a6-4e48d46bf760 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:07.345104 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 759/1524] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:07.345867 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2aad21-0bec-4708-98a6-4e48d46bf760 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.355161 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2aad21-0bec-4708-98a6-4e48d46bf760 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.360099 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67761681-2bcd-4b60-9e45-b8ead82c5492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.360773 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67761681-2bcd-4b60-9e45-b8ead82c5492 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.361089 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67761681-2bcd-4b60-9e45-b8ead82c5492 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.361523 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67761681-2bcd-4b60-9e45-b8ead82c5492 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.367451 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67761681-2bcd-4b60-9e45-b8ead82c5492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:07.367451 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67761681-2bcd-4b60-9e45-b8ead82c5492 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:07.395657 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 766/1525] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:30:07 2021] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:07.396763 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dccaa-41ca-439f-af49-b360556c6f5c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.459696 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dccaa-41ca-439f-af49-b360556c6f5c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.469263 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3719a-4a6b-47c6-8410-235ef9edddd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.469263 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3719a-4a6b-47c6-8410-235ef9edddd4 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.469263 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3719a-4a6b-47c6-8410-235ef9edddd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.469263 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3719a-4a6b-47c6-8410-235ef9edddd4 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.469661 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3719a-4a6b-47c6-8410-235ef9edddd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:07.469661 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3719a-4a6b-47c6-8410-235ef9edddd4 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:07.476299 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 760/1526] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:30:07 2021] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:07.480145 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67761681-2bcd-4b60-9e45-b8ead82c5492 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.490324 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67761681-2bcd-4b60-9e45-b8ead82c5492 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.498584 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d930d-7996-4175-9bbb-60e69ca95715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.499316 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d930d-7996-4175-9bbb-60e69ca95715 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.499602 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d930d-7996-4175-9bbb-60e69ca95715 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.500443 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d930d-7996-4175-9bbb-60e69ca95715 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.501173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d930d-7996-4175-9bbb-60e69ca95715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:07.503094 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d930d-7996-4175-9bbb-60e69ca95715 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:07.609715 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 767/1527] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:30:07 2021] POST /identity/v3/users => generated 295 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:07.610538 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3719a-4a6b-47c6-8410-235ef9edddd4 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.619881 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3719a-4a6b-47c6-8410-235ef9edddd4 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.624482 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b656530-5cb1-4456-b86a-aa834aaf64f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.625435 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b656530-5cb1-4456-b86a-aa834aaf64f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.625435 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b656530-5cb1-4456-b86a-aa834aaf64f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.625693 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b656530-5cb1-4456-b86a-aa834aaf64f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.626407 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b656530-5cb1-4456-b86a-aa834aaf64f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:07.627985 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b656530-5cb1-4456-b86a-aa834aaf64f9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:07.638620 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 768/1528] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:07 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:07.639299 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b656530-5cb1-4456-b86a-aa834aaf64f9 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.645044 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 761/1529] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:30:07 2021] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:07.645044 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d930d-7996-4175-9bbb-60e69ca95715 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.650050 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b656530-5cb1-4456-b86a-aa834aaf64f9 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.654047 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d930d-7996-4175-9bbb-60e69ca95715 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.657111 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed597afd-8168-4669-84bc-1a774241b698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.657111 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed597afd-8168-4669-84bc-1a774241b698 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.657111 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed597afd-8168-4669-84bc-1a774241b698 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.657111 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed597afd-8168-4669-84bc-1a774241b698 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.657701 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed597afd-8168-4669-84bc-1a774241b698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:07.659153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed597afd-8168-4669-84bc-1a774241b698 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:07.660430 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406706e-4af9-4fe4-a962-61f75b85fef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.661410 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406706e-4af9-4fe4-a962-61f75b85fef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.661776 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406706e-4af9-4fe4-a962-61f75b85fef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.662166 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406706e-4af9-4fe4-a962-61f75b85fef0 admin admin] PATH_INFO: `/v3/projects/b8f4319d61634014a030eb7b9b741e92/users/63916350d84642b0b2606341d71651f8/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.669160 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 769/1530] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:07.669160 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed597afd-8168-4669-84bc-1a774241b698 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.680070 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406706e-4af9-4fe4-a962-61f75b85fef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8f4319d61634014a030eb7b9b741e92, user_id=63916350d84642b0b2606341d71651f8, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:07.682017 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed597afd-8168-4669-84bc-1a774241b698 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.683069 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406706e-4af9-4fe4-a962-61f75b85fef0 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:07.688748 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6a271-c14b-4e43-ba90-1acfd56c37c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.689476 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6a271-c14b-4e43-ba90-1acfd56c37c4 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.689756 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6a271-c14b-4e43-ba90-1acfd56c37c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.690027 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6a271-c14b-4e43-ba90-1acfd56c37c4 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.690708 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6a271-c14b-4e43-ba90-1acfd56c37c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:07.692767 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6a271-c14b-4e43-ba90-1acfd56c37c4 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:07.764752 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 762/1531] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:07 2021] PUT /identity/v3/projects/b8f4319d61634014a030eb7b9b741e92/users/63916350d84642b0b2606341d71651f8/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:07.766668 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406706e-4af9-4fe4-a962-61f75b85fef0 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.791682 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 770/1532] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:30:07 2021] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:07.794269 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6a271-c14b-4e43-ba90-1acfd56c37c4 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.803106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6a271-c14b-4e43-ba90-1acfd56c37c4 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.833486 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406706e-4af9-4fe4-a962-61f75b85fef0 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.838283 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5893ac-009e-4dcc-b959-4d739e293deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.838947 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5893ac-009e-4dcc-b959-4d739e293deb admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.839230 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5893ac-009e-4dcc-b959-4d739e293deb admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.839505 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5893ac-009e-4dcc-b959-4d739e293deb admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.840221 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5893ac-009e-4dcc-b959-4d739e293deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:07.841844 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5893ac-009e-4dcc-b959-4d739e293deb admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:07.852151 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 763/1533] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:07 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:07.853049 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5893ac-009e-4dcc-b959-4d739e293deb admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.860297 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751677f-7859-40e4-9b0f-f0fe80d286fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.861028 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751677f-7859-40e4-9b0f-f0fe80d286fb admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.861312 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751677f-7859-40e4-9b0f-f0fe80d286fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.861591 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751677f-7859-40e4-9b0f-f0fe80d286fb admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.862317 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751677f-7859-40e4-9b0f-f0fe80d286fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:07.863034 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5893ac-009e-4dcc-b959-4d739e293deb admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.863912 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751677f-7859-40e4-9b0f-f0fe80d286fb admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:07.867641 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c399d7-a43d-47a3-98f7-15a066cfa896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.868271 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c399d7-a43d-47a3-98f7-15a066cfa896 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.868555 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c399d7-a43d-47a3-98f7-15a066cfa896 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.868879 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c399d7-a43d-47a3-98f7-15a066cfa896 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.869579 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c399d7-a43d-47a3-98f7-15a066cfa896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:07.871118 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c399d7-a43d-47a3-98f7-15a066cfa896 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:07.876638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 771/1534] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:07 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:07.876638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751677f-7859-40e4-9b0f-f0fe80d286fb admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.882006 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 764/1535] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:07 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:07.882860 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c399d7-a43d-47a3-98f7-15a066cfa896 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.893605 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751677f-7859-40e4-9b0f-f0fe80d286fb admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.894954 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c399d7-a43d-47a3-98f7-15a066cfa896 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.898439 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1d6ad-4601-4f2d-9cff-4d87ecdf77cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.899196 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1d6ad-4601-4f2d-9cff-4d87ecdf77cb admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.899484 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1d6ad-4601-4f2d-9cff-4d87ecdf77cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.899775 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1d6ad-4601-4f2d-9cff-4d87ecdf77cb admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.899985 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743113a8-9ce3-4b47-94da-145aa3d9a13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.900493 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1d6ad-4601-4f2d-9cff-4d87ecdf77cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:07.900703 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743113a8-9ce3-4b47-94da-145aa3d9a13f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.901056 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743113a8-9ce3-4b47-94da-145aa3d9a13f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.901330 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743113a8-9ce3-4b47-94da-145aa3d9a13f admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.902209 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1d6ad-4601-4f2d-9cff-4d87ecdf77cb admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:07.902328 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743113a8-9ce3-4b47-94da-145aa3d9a13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:07.903896 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743113a8-9ce3-4b47-94da-145aa3d9a13f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:07.915087 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 765/1536] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:07 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:07.921169 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a3181-e3b8-40b2-b289-960eb6225776 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.921169 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a3181-e3b8-40b2-b289-960eb6225776 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.921518 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 772/1537] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:07 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:07.921655 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a3181-e3b8-40b2-b289-960eb6225776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.921742 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1d6ad-4601-4f2d-9cff-4d87ecdf77cb admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.931075 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1d6ad-4601-4f2d-9cff-4d87ecdf77cb admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.936105 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-959a3181-e3b8-40b2-b289-960eb6225776 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:07.936357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d1b74-b240-4f45-80b4-729d872d7429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.937015 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d1b74-b240-4f45-80b4-729d872d7429 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.937338 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d1b74-b240-4f45-80b4-729d872d7429 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.937506 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-959a3181-e3b8-40b2-b289-960eb6225776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:07.937746 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d1b74-b240-4f45-80b4-729d872d7429 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.938365 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d1b74-b240-4f45-80b4-729d872d7429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:07.939994 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d1b74-b240-4f45-80b4-729d872d7429 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:07.945837 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 766/1538] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:07.946559 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a3181-e3b8-40b2-b289-960eb6225776 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.950449 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 773/1539] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:07 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:07.951341 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d1b74-b240-4f45-80b4-729d872d7429 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.956992 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a3181-e3b8-40b2-b289-960eb6225776 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.961691 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d1b74-b240-4f45-80b4-729d872d7429 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.962235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13faeec8-c48f-438b-b82d-ac31698a6920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.962904 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faeec8-c48f-438b-b82d-ac31698a6920 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.963281 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faeec8-c48f-438b-b82d-ac31698a6920 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.963455 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faeec8-c48f-438b-b82d-ac31698a6920 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.964326 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13faeec8-c48f-438b-b82d-ac31698a6920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:07.965981 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13faeec8-c48f-438b-b82d-ac31698a6920 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:07.967545 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33781c6c-d1e8-47c3-97a8-12f8162d69ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.968209 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33781c6c-d1e8-47c3-97a8-12f8162d69ae admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.969114 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33781c6c-d1e8-47c3-97a8-12f8162d69ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.969405 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33781c6c-d1e8-47c3-97a8-12f8162d69ae admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.970144 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33781c6c-d1e8-47c3-97a8-12f8162d69ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:07.971755 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33781c6c-d1e8-47c3-97a8-12f8162d69ae admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:07.979053 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 767/1540] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:07 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:07.979053 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13faeec8-c48f-438b-b82d-ac31698a6920 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.986606 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 774/1541] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:07 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:07.986606 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33781c6c-d1e8-47c3-97a8-12f8162d69ae admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:07.991598 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13faeec8-c48f-438b-b82d-ac31698a6920 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.993617 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33781c6c-d1e8-47c3-97a8-12f8162d69ae admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:07.996540 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb2d3a-27f7-42a7-afda-d4698a143baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.997450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb2d3a-27f7-42a7-afda-d4698a143baa admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.997734 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb2d3a-27f7-42a7-afda-d4698a143baa admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.998039 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb2d3a-27f7-42a7-afda-d4698a143baa admin admin] PATH_INFO: `/v3/projects/9cbe428e1f9c456087aa6ec677fe0330/users/9032bdd7ffde4d3f9b500974a4c17c67/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:07.998309 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25411540-38c3-44af-811e-3f2bfac0b26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:07.998943 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25411540-38c3-44af-811e-3f2bfac0b26f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:07.999227 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25411540-38c3-44af-811e-3f2bfac0b26f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:07.999504 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25411540-38c3-44af-811e-3f2bfac0b26f admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:08.000776 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25411540-38c3-44af-811e-3f2bfac0b26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:08.002376 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25411540-38c3-44af-811e-3f2bfac0b26f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:08.011975 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 775/1542] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:07 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:08.012740 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25411540-38c3-44af-811e-3f2bfac0b26f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:08.013143 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb2d3a-27f7-42a7-afda-d4698a143baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbe428e1f9c456087aa6ec677fe0330, user_id=9032bdd7ffde4d3f9b500974a4c17c67, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:08.016862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb2d3a-27f7-42a7-afda-d4698a143baa admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:08.023174 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25411540-38c3-44af-811e-3f2bfac0b26f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:08.027991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d5f5b-8e15-4c41-b1a4-c3b8035b4464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:08.028888 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d5f5b-8e15-4c41-b1a4-c3b8035b4464 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:08.029171 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d5f5b-8e15-4c41-b1a4-c3b8035b4464 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:08.029444 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d5f5b-8e15-4c41-b1a4-c3b8035b4464 admin admin] PATH_INFO: `/v3/projects/4806e02507814baf9b517401f4aeacbb/users/d2e2b0973e5540e189afdf3971919e78/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:08.043466 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d5f5b-8e15-4c41-b1a4-c3b8035b4464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4806e02507814baf9b517401f4aeacbb, user_id=d2e2b0973e5540e189afdf3971919e78, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:08.046145 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d5f5b-8e15-4c41-b1a4-c3b8035b4464 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:08.082804 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 768/1543] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:07 2021] PUT /identity/v3/projects/9cbe428e1f9c456087aa6ec677fe0330/users/9032bdd7ffde4d3f9b500974a4c17c67/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:08.083714 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb2d3a-27f7-42a7-afda-d4698a143baa admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:08.112574 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 776/1544] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:08 2021] PUT /identity/v3/projects/4806e02507814baf9b517401f4aeacbb/users/d2e2b0973e5540e189afdf3971919e78/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:08.112574 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d5f5b-8e15-4c41-b1a4-c3b8035b4464 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:08.112574 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-629d5f5b-8e15-4c41-b1a4-c3b8035b4464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:08.149535 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb2d3a-27f7-42a7-afda-d4698a143baa admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:08.180335 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d5f5b-8e15-4c41-b1a4-c3b8035b4464 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:08.185441 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc6a8f-a42c-4d97-b497-f185481efb7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:08.189790 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6a8f-a42c-4d97-b497-f185481efb7c service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:08.190093 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6a8f-a42c-4d97-b497-f185481efb7c service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:08.190376 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6a8f-a42c-4d97-b497-f185481efb7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:08.211155 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345b1e5-8194-4974-bbc7-47229c31d828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:08.212018 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345b1e5-8194-4974-bbc7-47229c31d828 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:08.212307 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345b1e5-8194-4974-bbc7-47229c31d828 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:08.212591 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345b1e5-8194-4974-bbc7-47229c31d828 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:08.213359 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345b1e5-8194-4974-bbc7-47229c31d828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:08.215326 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345b1e5-8194-4974-bbc7-47229c31d828 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:08.227483 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 769/1545] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:08 2021] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:08.228334 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345b1e5-8194-4974-bbc7-47229c31d828 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:08.240026 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345b1e5-8194-4974-bbc7-47229c31d828 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:08.245166 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea7ad2-ef40-4ce8-96b5-6da05a205410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:08.246060 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea7ad2-ef40-4ce8-96b5-6da05a205410 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:08.246351 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea7ad2-ef40-4ce8-96b5-6da05a205410 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:08.246634 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea7ad2-ef40-4ce8-96b5-6da05a205410 admin admin] PATH_INFO: `/v3/projects/4a969fe3d4cd472b96337f88f0aa3bb8/users/a203f766122548f1a45a4867ce6660c7/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:08.262524 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea7ad2-ef40-4ce8-96b5-6da05a205410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a969fe3d4cd472b96337f88f0aa3bb8, user_id=a203f766122548f1a45a4867ce6660c7, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:08.267673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc6a8f-a42c-4d97-b497-f185481efb7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:08.267822 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea7ad2-ef40-4ce8-96b5-6da05a205410 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:08.267921 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc6a8f-a42c-4d97-b497-f185481efb7c service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:08.277099 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 777/1546] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:08.277701 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc6a8f-a42c-4d97-b497-f185481efb7c service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:08.288120 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc6a8f-a42c-4d97-b497-f185481efb7c service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:08.293403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecc062-d883-4806-8f75-91e6001ad289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:08.294413 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecc062-d883-4806-8f75-91e6001ad289 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:08.294628 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecc062-d883-4806-8f75-91e6001ad289 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:08.294913 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecc062-d883-4806-8f75-91e6001ad289 admin admin] PATH_INFO: `/v3/projects/cc3b4bb0756249d19606e34fca91d4d5/users/5952a90abc5042f48c9caecd82a0c74a/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:08.315021 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecc062-d883-4806-8f75-91e6001ad289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3b4bb0756249d19606e34fca91d4d5, user_id=5952a90abc5042f48c9caecd82a0c74a, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:08.317903 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecc062-d883-4806-8f75-91e6001ad289 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:08.366112 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 770/1547] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:08 2021] PUT /identity/v3/projects/4a969fe3d4cd472b96337f88f0aa3bb8/users/a203f766122548f1a45a4867ce6660c7/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:08.368860 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea7ad2-ef40-4ce8-96b5-6da05a205410 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:08.402066 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 778/1548] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:08 2021] PUT /identity/v3/projects/cc3b4bb0756249d19606e34fca91d4d5/users/5952a90abc5042f48c9caecd82a0c74a/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:08.405004 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8631ca-49cb-4e0d-bf1f-c31f033297d0 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:08.405004 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8631ca-49cb-4e0d-bf1f-c31f033297d0 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:08.405004 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8631ca-49cb-4e0d-bf1f-c31f033297d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:08.429024 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-3d8631ca-49cb-4e0d-bf1f-c31f033297d0 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:08.434393 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-3d8631ca-49cb-4e0d-bf1f-c31f033297d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:08.441403 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea7ad2-ef40-4ce8-96b5-6da05a205410 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:08.497478 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 779/1549] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:08.499434 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29515937-8389-4220-bf30-7bbf0679e7ec None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:08.500001 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29515937-8389-4220-bf30-7bbf0679e7ec None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:08.501456 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbed9f5-7c1c-4c18-b611-32ccc411098f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:08.502468 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbed9f5-7c1c-4c18-b611-32ccc411098f admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:08.502849 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbed9f5-7c1c-4c18-b611-32ccc411098f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:08.503276 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbed9f5-7c1c-4c18-b611-32ccc411098f admin admin] PATH_INFO: `/v3/projects/f9f6df5219a048199f4d84b595da4f43/users/88c50d7a2de940f6a19c53f1f51085a8/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:08.508148 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29515937-8389-4220-bf30-7bbf0679e7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:08.526230 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbed9f5-7c1c-4c18-b611-32ccc411098f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f6df5219a048199f4d84b595da4f43, user_id=88c50d7a2de940f6a19c53f1f51085a8, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:08.529870 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbed9f5-7c1c-4c18-b611-32ccc411098f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:08.540356 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-29515937-8389-4220-bf30-7bbf0679e7ec None None] MFA Rules not processed for user `d2e2b0973e5540e189afdf3971919e78`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:08.541738 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-29515937-8389-4220-bf30-7bbf0679e7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:08.609643 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 780/1550] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:08 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:08.609643 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29515937-8389-4220-bf30-7bbf0679e7ec None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:08.615946 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 771/1551] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:08 2021] PUT /identity/v3/projects/f9f6df5219a048199f4d84b595da4f43/users/88c50d7a2de940f6a19c53f1f51085a8/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:08.617849 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd399f-585a-4815-b246-776a4316a69a None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:08.618139 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd399f-585a-4815-b246-776a4316a69a None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:08.618414 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd399f-585a-4815-b246-776a4316a69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:08.638003 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29515937-8389-4220-bf30-7bbf0679e7ec None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:08.664060 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-8bcd399f-585a-4815-b246-776a4316a69a None None] MFA Rules not processed for user `a203f766122548f1a45a4867ce6660c7`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:08.665795 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8bcd399f-585a-4815-b246-776a4316a69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:08.717135 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2088fa-36e8-44ea-8115-d30509dbd8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:08.719285 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2088fa-36e8-44ea-8115-d30509dbd8bf admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:08.719695 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2088fa-36e8-44ea-8115-d30509dbd8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:08.719983 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2088fa-36e8-44ea-8115-d30509dbd8bf admin admin] PATH_INFO: `/v3/projects/8c9439f7236d4228aea4ccc73e5d6c08/users/589eca6a184e4505a0c0f97efe65892e/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:08.738031 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2088fa-36e8-44ea-8115-d30509dbd8bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9439f7236d4228aea4ccc73e5d6c08, user_id=589eca6a184e4505a0c0f97efe65892e, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:08.742080 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 772/1552] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:08 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:08.742080 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89cc05-55e7-4c19-bf59-60ecb7ac74de None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:08.742080 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89cc05-55e7-4c19-bf59-60ecb7ac74de None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:08.742445 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2088fa-36e8-44ea-8115-d30509dbd8bf admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:08.742535 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89cc05-55e7-4c19-bf59-60ecb7ac74de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:08.760529 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-0f89cc05-55e7-4c19-bf59-60ecb7ac74de None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:08.761788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-0f89cc05-55e7-4c19-bf59-60ecb7ac74de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:08.770835 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 773/1553] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:08.771905 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89cc05-55e7-4c19-bf59-60ecb7ac74de None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:08.820622 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 781/1554] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:08 2021] PUT /identity/v3/projects/8c9439f7236d4228aea4ccc73e5d6c08/users/589eca6a184e4505a0c0f97efe65892e/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:08.821833 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2088fa-36e8-44ea-8115-d30509dbd8bf admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:08.846683 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89cc05-55e7-4c19-bf59-60ecb7ac74de None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:08.914131 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79506df-7739-408d-b30e-16a94f74d574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:08.914870 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79506df-7739-408d-b30e-16a94f74d574 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:08.915225 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79506df-7739-408d-b30e-16a94f74d574 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:08.915502 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79506df-7739-408d-b30e-16a94f74d574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:08.920893 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2088fa-36e8-44ea-8115-d30509dbd8bf admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:08.926742 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79506df-7739-408d-b30e-16a94f74d574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:08.928254 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79506df-7739-408d-b30e-16a94f74d574 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:08.929000 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c1e40-8f08-4b98-91c6-4aa2b6af656e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:08.929999 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c1e40-8f08-4b98-91c6-4aa2b6af656e admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:08.930424 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c1e40-8f08-4b98-91c6-4aa2b6af656e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:08.930948 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c1e40-8f08-4b98-91c6-4aa2b6af656e admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:08.931836 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c1e40-8f08-4b98-91c6-4aa2b6af656e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:08.935154 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c1e40-8f08-4b98-91c6-4aa2b6af656e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:08.939896 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 774/1555] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:08.941776 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa09376-84b2-48c9-8f70-5584cc0b453d None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:08.941776 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa09376-84b2-48c9-8f70-5584cc0b453d None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:08.942570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa09376-84b2-48c9-8f70-5584cc0b453d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:08.976821 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-4fa09376-84b2-48c9-8f70-5584cc0b453d None None] MFA Rules not processed for user `88c50d7a2de940f6a19c53f1f51085a8`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:08.978154 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-4fa09376-84b2-48c9-8f70-5584cc0b453d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:09.053900 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 775/1556] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:08 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:09.059549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa09376-84b2-48c9-8f70-5584cc0b453d None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:09.061787 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 782/1557] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:30:08 2021] POST /identity/v3/projects => generated 365 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:09.063094 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c1e40-8f08-4b98-91c6-4aa2b6af656e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:09.065924 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa09376-84b2-48c9-8f70-5584cc0b453d None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:09.130899 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c1e40-8f08-4b98-91c6-4aa2b6af656e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:09.136530 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb4310-5d11-4520-a7bc-17a9338318e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:09.137689 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb4310-5d11-4520-a7bc-17a9338318e7 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:09.138129 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb4310-5d11-4520-a7bc-17a9338318e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:09.138662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb4310-5d11-4520-a7bc-17a9338318e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:09.145592 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d31e56-3395-4c6f-b1d8-9f6751b99a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:09.146283 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d31e56-3395-4c6f-b1d8-9f6751b99a22 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:09.146569 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d31e56-3395-4c6f-b1d8-9f6751b99a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:09.146900 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d31e56-3395-4c6f-b1d8-9f6751b99a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:09.147694 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d31e56-3395-4c6f-b1d8-9f6751b99a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:09.149864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d31e56-3395-4c6f-b1d8-9f6751b99a22 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:09.150755 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb4310-5d11-4520-a7bc-17a9338318e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:09.153867 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb4310-5d11-4520-a7bc-17a9338318e7 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:09.170084 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 783/1558] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:09.173178 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9fbdd-0cdf-4ec0-af24-8a5bd7a2c263 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:09.173664 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9fbdd-0cdf-4ec0-af24-8a5bd7a2c263 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:09.174092 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9fbdd-0cdf-4ec0-af24-8a5bd7a2c263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:09.198477 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-32e9fbdd-0cdf-4ec0-af24-8a5bd7a2c263 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:09.200026 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-32e9fbdd-0cdf-4ec0-af24-8a5bd7a2c263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:09.230538 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 784/1559] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:09.230849 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9fbdd-0cdf-4ec0-af24-8a5bd7a2c263 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:09.249249 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 776/1560] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:30:09 2021] POST /identity/v3/projects => generated 381 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:09.253474 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b73e7-c126-4f3b-8a8d-9b0ac0a19d95 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:09.253982 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b73e7-c126-4f3b-8a8d-9b0ac0a19d95 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:09.254276 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b73e7-c126-4f3b-8a8d-9b0ac0a19d95 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:09.257106 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 777/1561] 10.222.0.25 () {54 vars in 961 bytes} [Fri Aug 27 01:30:09 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:30:09.258010 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b73e7-c126-4f3b-8a8d-9b0ac0a19d95 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:09.271092 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9fbdd-0cdf-4ec0-af24-8a5bd7a2c263 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:09.401899 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ade376-4eae-4f1b-917f-f3605a5095af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:09.402732 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ade376-4eae-4f1b-917f-f3605a5095af admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:09.403123 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ade376-4eae-4f1b-917f-f3605a5095af admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:09.403494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ade376-4eae-4f1b-917f-f3605a5095af admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:09.404338 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ade376-4eae-4f1b-917f-f3605a5095af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:09.407210 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ade376-4eae-4f1b-917f-f3605a5095af admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:09.437225 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b73e7-c126-4f3b-8a8d-9b0ac0a19d95 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:09.445262 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38307e-a02b-4c76-9c26-fe8769fefaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:09.445961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38307e-a02b-4c76-9c26-fe8769fefaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:09.449793 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38307e-a02b-4c76-9c26-fe8769fefaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:09.450139 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38307e-a02b-4c76-9c26-fe8769fefaa9 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:09.450883 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38307e-a02b-4c76-9c26-fe8769fefaa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:09.453439 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38307e-a02b-4c76-9c26-fe8769fefaa9 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:09.486588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 785/1562] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:30:09 2021] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:09.486588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf494ad-c9a2-4df1-8f1a-4da65d8d75db None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:09.486588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf494ad-c9a2-4df1-8f1a-4da65d8d75db None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:09.486588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf494ad-c9a2-4df1-8f1a-4da65d8d75db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:09.551932 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-eaf494ad-c9a2-4df1-8f1a-4da65d8d75db None None] MFA Rules not processed for user `249a7642a0284dde91a7719f732b2d70`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:09.553531 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-eaf494ad-c9a2-4df1-8f1a-4da65d8d75db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:09.632152 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 778/1563] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:30:09 2021] POST /identity/v3/users => generated 297 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:09.633135 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38307e-a02b-4c76-9c26-fe8769fefaa9 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:09.710360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 786/1564] 10.222.0.25 () {58 vars in 1059 bytes} [Fri Aug 27 01:30:09 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:09.711540 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf494ad-c9a2-4df1-8f1a-4da65d8d75db None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:09.732476 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf494ad-c9a2-4df1-8f1a-4da65d8d75db None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:09.743399 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38307e-a02b-4c76-9c26-fe8769fefaa9 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:09.745470 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bce37-637e-47b8-89b5-98fda4e1b928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:09.750433 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bce37-637e-47b8-89b5-98fda4e1b928 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:09.750433 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bce37-637e-47b8-89b5-98fda4e1b928 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:09.750433 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bce37-637e-47b8-89b5-98fda4e1b928 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:09.750433 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bce37-637e-47b8-89b5-98fda4e1b928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:09.750954 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82f99f-50f3-43a7-8743-ca90f1397d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:09.750954 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82f99f-50f3-43a7-8743-ca90f1397d46 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:09.750954 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82f99f-50f3-43a7-8743-ca90f1397d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:09.751180 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bce37-637e-47b8-89b5-98fda4e1b928 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:09.751262 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82f99f-50f3-43a7-8743-ca90f1397d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:09.764876 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 787/1565] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:09 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:09.764876 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bce37-637e-47b8-89b5-98fda4e1b928 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:09.770774 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82f99f-50f3-43a7-8743-ca90f1397d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:09.774011 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82f99f-50f3-43a7-8743-ca90f1397d46 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:09.779696 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bce37-637e-47b8-89b5-98fda4e1b928 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:09.788871 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 779/1566] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:09.789758 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82f99f-50f3-43a7-8743-ca90f1397d46 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:09.790507 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961626fb-ebed-4984-abd1-33ed49d077cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:09.792077 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961626fb-ebed-4984-abd1-33ed49d077cf admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:09.792446 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961626fb-ebed-4984-abd1-33ed49d077cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:09.793676 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961626fb-ebed-4984-abd1-33ed49d077cf admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:09.794506 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961626fb-ebed-4984-abd1-33ed49d077cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:09.796254 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961626fb-ebed-4984-abd1-33ed49d077cf admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:09.808589 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82f99f-50f3-43a7-8743-ca90f1397d46 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:09.810574 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926a956-cf03-4792-b37d-ce772b139c29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:09.815184 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 788/1567] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:09 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:09.815371 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926a956-cf03-4792-b37d-ce772b139c29 service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:09.815371 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926a956-cf03-4792-b37d-ce772b139c29 service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:09.815371 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926a956-cf03-4792-b37d-ce772b139c29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:09.815608 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961626fb-ebed-4984-abd1-33ed49d077cf admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:09.826823 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961626fb-ebed-4984-abd1-33ed49d077cf admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:09.832479 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac266a-d30a-4447-90ef-8ec67b719855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:09.837877 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac266a-d30a-4447-90ef-8ec67b719855 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:09.837877 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac266a-d30a-4447-90ef-8ec67b719855 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:09.837877 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac266a-d30a-4447-90ef-8ec67b719855 admin admin] PATH_INFO: `/v3/projects/2c5ed0473a6b46bb9add0e4f5add1453/users/211666772b1042cdbcbad7183c474fd2/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:09.856169 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac266a-d30a-4447-90ef-8ec67b719855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5ed0473a6b46bb9add0e4f5add1453, user_id=211666772b1042cdbcbad7183c474fd2, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:09.858577 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac266a-d30a-4447-90ef-8ec67b719855 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:09.882929 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926a956-cf03-4792-b37d-ce772b139c29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:09.884801 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926a956-cf03-4792-b37d-ce772b139c29 service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:09.914459 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 780/1568] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:09 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:09.915117 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926a956-cf03-4792-b37d-ce772b139c29 service nova] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:09.937724 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 789/1569] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:09 2021] PUT /identity/v3/projects/2c5ed0473a6b46bb9add0e4f5add1453/users/211666772b1042cdbcbad7183c474fd2/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:09.939019 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926a956-cf03-4792-b37d-ce772b139c29 service nova] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:09.942586 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac266a-d30a-4447-90ef-8ec67b719855 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:10.041010 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95210c01-3378-459b-9284-5d79567b49ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:10.042720 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95210c01-3378-459b-9284-5d79567b49ed admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:10.043126 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95210c01-3378-459b-9284-5d79567b49ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:10.043392 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95210c01-3378-459b-9284-5d79567b49ed admin admin] PATH_INFO: `/v3/projects/f845c104f6a74062a17b5fb7d714f277/users/048a46ddbd6e498da61620b01552541d/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:10.053112 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac266a-d30a-4447-90ef-8ec67b719855 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:10.065008 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84ff7c-a6ee-48f3-b77a-6f8ccc6aa1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:10.065008 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84ff7c-a6ee-48f3-b77a-6f8ccc6aa1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:10.065008 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84ff7c-a6ee-48f3-b77a-6f8ccc6aa1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:10.065008 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84ff7c-a6ee-48f3-b77a-6f8ccc6aa1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:10.065664 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84ff7c-a6ee-48f3-b77a-6f8ccc6aa1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:10.065761 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95210c01-3378-459b-9284-5d79567b49ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f845c104f6a74062a17b5fb7d714f277, user_id=048a46ddbd6e498da61620b01552541d, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:10.065852 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84ff7c-a6ee-48f3-b77a-6f8ccc6aa1f3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:10.067109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95210c01-3378-459b-9284-5d79567b49ed admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:10.075875 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 790/1570] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:09 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:10.080463 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84ff7c-a6ee-48f3-b77a-6f8ccc6aa1f3 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:10.095894 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84ff7c-a6ee-48f3-b77a-6f8ccc6aa1f3 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:10.102726 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85074b3-9b8d-46f6-80fc-6fc91fc7d6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:10.103919 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85074b3-9b8d-46f6-80fc-6fc91fc7d6e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:10.104280 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85074b3-9b8d-46f6-80fc-6fc91fc7d6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:10.105175 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85074b3-9b8d-46f6-80fc-6fc91fc7d6e9 admin admin] PATH_INFO: `/v3/projects/2c5ed0473a6b46bb9add0e4f5add1453/users/211666772b1042cdbcbad7183c474fd2/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:10.107920 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85074b3-9b8d-46f6-80fc-6fc91fc7d6e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5ed0473a6b46bb9add0e4f5add1453, user_id=211666772b1042cdbcbad7183c474fd2, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:10.111941 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85074b3-9b8d-46f6-80fc-6fc91fc7d6e9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:10.136179 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 791/1571] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:10 2021] PUT /identity/v3/projects/2c5ed0473a6b46bb9add0e4f5add1453/users/211666772b1042cdbcbad7183c474fd2/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:30:10.149186 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f387c3-c83e-4a86-a430-f563ed54e265 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:10.149186 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f387c3-c83e-4a86-a430-f563ed54e265 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:10.149186 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f387c3-c83e-4a86-a430-f563ed54e265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:10.185187 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-52f387c3-c83e-4a86-a430-f563ed54e265 None None] MFA Rules not processed for user `211666772b1042cdbcbad7183c474fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:10.186454 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-52f387c3-c83e-4a86-a430-f563ed54e265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:10.207837 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 781/1572] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:09 2021] PUT /identity/v3/projects/f845c104f6a74062a17b5fb7d714f277/users/048a46ddbd6e498da61620b01552541d/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:10.210057 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff82c2-486e-4faa-ac4a-14ed7ee67cfa None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:10.210538 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff82c2-486e-4faa-ac4a-14ed7ee67cfa None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:10.212254 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff82c2-486e-4faa-ac4a-14ed7ee67cfa None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:10.216257 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 782/1573] 10.222.0.25 () {54 vars in 912 bytes} [Fri Aug 27 01:30:10 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:30:10.222010 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff82c2-486e-4faa-ac4a-14ed7ee67cfa None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:10.272581 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 792/1574] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:10 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:10.274219 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe449830-8abc-4f12-9d37-a2c4780ac4d6 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:10.274609 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe449830-8abc-4f12-9d37-a2c4780ac4d6 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:10.275000 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe449830-8abc-4f12-9d37-a2c4780ac4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:10.317302 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-fe449830-8abc-4f12-9d37-a2c4780ac4d6 None None] MFA Rules not processed for user `249a7642a0284dde91a7719f732b2d70`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:10.318632 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-fe449830-8abc-4f12-9d37-a2c4780ac4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:10.332579 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff82c2-486e-4faa-ac4a-14ed7ee67cfa None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:10.339820 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e62d48-c8ba-4c95-aa72-0ad41a80bd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:10.340916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e62d48-c8ba-4c95-aa72-0ad41a80bd7a admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:10.341251 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e62d48-c8ba-4c95-aa72-0ad41a80bd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:10.341532 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e62d48-c8ba-4c95-aa72-0ad41a80bd7a admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:10.342279 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e62d48-c8ba-4c95-aa72-0ad41a80bd7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:10.345280 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e62d48-c8ba-4c95-aa72-0ad41a80bd7a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:10.360476 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 783/1575] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:10 2021] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:10.360476 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e62d48-c8ba-4c95-aa72-0ad41a80bd7a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:10.440029 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e62d48-c8ba-4c95-aa72-0ad41a80bd7a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:10.445144 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14a921-6065-4547-89b0-a1c90a6d67d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:10.446267 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14a921-6065-4547-89b0-a1c90a6d67d1 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:10.446749 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14a921-6065-4547-89b0-a1c90a6d67d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:10.447292 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14a921-6065-4547-89b0-a1c90a6d67d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:10.455325 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 793/1576] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 01:30:10 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:10.456357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe449830-8abc-4f12-9d37-a2c4780ac4d6 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:10.467639 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe449830-8abc-4f12-9d37-a2c4780ac4d6 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:10.473492 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238084ef-c201-407d-9895-5f97c246032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:10.474442 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238084ef-c201-407d-9895-5f97c246032a admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:10.474711 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238084ef-c201-407d-9895-5f97c246032a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:10.474987 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238084ef-c201-407d-9895-5f97c246032a admin admin] PATH_INFO: `/v3/projects/f845c104f6a74062a17b5fb7d714f277/users/048a46ddbd6e498da61620b01552541d/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:10.477223 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238084ef-c201-407d-9895-5f97c246032a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f845c104f6a74062a17b5fb7d714f277, user_id=048a46ddbd6e498da61620b01552541d, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:10.480029 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238084ef-c201-407d-9895-5f97c246032a admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:10.502114 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 794/1577] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:10 2021] PUT /identity/v3/projects/f845c104f6a74062a17b5fb7d714f277/users/048a46ddbd6e498da61620b01552541d/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:10.503330 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238084ef-c201-407d-9895-5f97c246032a admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:10.521708 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14a921-6065-4547-89b0-a1c90a6d67d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:10.523373 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14a921-6065-4547-89b0-a1c90a6d67d1 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:10.539375 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 784/1578] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:10 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:10.541889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106abfa-be1c-44c7-8dde-f52ebfc0ac09 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:10.542490 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106abfa-be1c-44c7-8dde-f52ebfc0ac09 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:10.543027 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106abfa-be1c-44c7-8dde-f52ebfc0ac09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:10.579925 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-c106abfa-be1c-44c7-8dde-f52ebfc0ac09 None None] MFA Rules not processed for user `048a46ddbd6e498da61620b01552541d`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:10.581489 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-c106abfa-be1c-44c7-8dde-f52ebfc0ac09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:10.606698 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238084ef-c201-407d-9895-5f97c246032a admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:10.620416 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba72c7f-3454-4af9-bb18-1ee2900c1440 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:10.621475 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba72c7f-3454-4af9-bb18-1ee2900c1440 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:10.621988 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba72c7f-3454-4af9-bb18-1ee2900c1440 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:10.623127 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba72c7f-3454-4af9-bb18-1ee2900c1440 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:10.684450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 785/1579] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:10 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:10.751139 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba72c7f-3454-4af9-bb18-1ee2900c1440 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:10.753536 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba72c7f-3454-4af9-bb18-1ee2900c1440 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:10.770384 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 795/1580] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:10 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:10.852253 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106abfa-be1c-44c7-8dde-f52ebfc0ac09 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:10.871449 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106abfa-be1c-44c7-8dde-f52ebfc0ac09 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:10.876544 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7a344-e0ae-4056-93ff-38d214edad22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:10.877136 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7a344-e0ae-4056-93ff-38d214edad22 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:10.877429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7a344-e0ae-4056-93ff-38d214edad22 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:10.877706 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7a344-e0ae-4056-93ff-38d214edad22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:10.894325 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7a344-e0ae-4056-93ff-38d214edad22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:10.897761 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7a344-e0ae-4056-93ff-38d214edad22 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:10.916211 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 786/1581] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:10 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:11.046796 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba72c7f-3454-4af9-bb18-1ee2900c1440 service cinder] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:11.058176 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba72c7f-3454-4af9-bb18-1ee2900c1440 service cinder] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:11.063512 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371d6bb-a55b-4c74-981b-3a58094e8300 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:11.064090 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371d6bb-a55b-4c74-981b-3a58094e8300 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:11.064376 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371d6bb-a55b-4c74-981b-3a58094e8300 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:11.064646 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371d6bb-a55b-4c74-981b-3a58094e8300 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:11.156891 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371d6bb-a55b-4c74-981b-3a58094e8300 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:11.156891 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371d6bb-a55b-4c74-981b-3a58094e8300 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:11.166565 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 796/1582] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:11 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:30:11.704177 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e357bdf-29b2-4378-b52f-e8524d699e91 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:11.704730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e357bdf-29b2-4378-b52f-e8524d699e91 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:11.704730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e357bdf-29b2-4378-b52f-e8524d699e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:11.738434 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-6e357bdf-29b2-4378-b52f-e8524d699e91 None None] MFA Rules not processed for user `63916350d84642b0b2606341d71651f8`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:11.740183 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-6e357bdf-29b2-4378-b52f-e8524d699e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:11.865624 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 787/1583] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:11 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:11.867935 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b1514-cee1-4f85-ac86-7fee124cb1dd None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:11.868334 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b1514-cee1-4f85-ac86-7fee124cb1dd None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:11.868655 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b1514-cee1-4f85-ac86-7fee124cb1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:11.883821 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e357bdf-29b2-4378-b52f-e8524d699e91 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:11.898447 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e357bdf-29b2-4378-b52f-e8524d699e91 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:11.910879 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61a5df-4e54-4d30-880d-819343f183d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:11.912596 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61a5df-4e54-4d30-880d-819343f183d8 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:11.913643 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61a5df-4e54-4d30-880d-819343f183d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:11.913926 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61a5df-4e54-4d30-880d-819343f183d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:11.925956 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-843b1514-cee1-4f85-ac86-7fee124cb1dd None None] MFA Rules not processed for user `63916350d84642b0b2606341d71651f8`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:11.929157 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-843b1514-cee1-4f85-ac86-7fee124cb1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:11.950940 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 797/1584] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:11 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:11.976977 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91f2be-a4f0-4892-9f21-45f32649ccb5 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:11.977286 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91f2be-a4f0-4892-9f21-45f32649ccb5 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:11.977539 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91f2be-a4f0-4892-9f21-45f32649ccb5 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:11.980146 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 798/1585] 10.222.0.25 () {54 vars in 961 bytes} [Fri Aug 27 01:30:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:30:11.997168 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea5fd9-36cf-4e14-a96d-e3fabd3054e0 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:11.997452 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea5fd9-36cf-4e14-a96d-e3fabd3054e0 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:11.997732 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea5fd9-36cf-4e14-a96d-e3fabd3054e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:12.039357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-6bea5fd9-36cf-4e14-a96d-e3fabd3054e0 None None] MFA Rules not processed for user `249a7642a0284dde91a7719f732b2d70`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:12.042022 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-6bea5fd9-36cf-4e14-a96d-e3fabd3054e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:12.059401 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 799/1586] 10.222.0.25 () {58 vars in 1059 bytes} [Fri Aug 27 01:30:11 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:30:12.070294 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea5fd9-36cf-4e14-a96d-e3fabd3054e0 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:12.087487 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea5fd9-36cf-4e14-a96d-e3fabd3054e0 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:12.092092 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61a5df-4e54-4d30-880d-819343f183d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:12.110205 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61a5df-4e54-4d30-880d-819343f183d8 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:12.121675 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367062ac-ddde-4327-942d-38ccdfe6a6ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:12.122631 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367062ac-ddde-4327-942d-38ccdfe6a6ea service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:12.124610 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367062ac-ddde-4327-942d-38ccdfe6a6ea service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:12.125702 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367062ac-ddde-4327-942d-38ccdfe6a6ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:12.157579 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 788/1587] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:11 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:30:12.164333 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367062ac-ddde-4327-942d-38ccdfe6a6ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:12.168525 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367062ac-ddde-4327-942d-38ccdfe6a6ea service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:12.191039 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 800/1588] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:12 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:30:12.601151 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61a5df-4e54-4d30-880d-819343f183d8 service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:12.724579 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc1140-d999-424d-9c01-5298a3c4e30c None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:12.728717 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc1140-d999-424d-9c01-5298a3c4e30c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:12.728717 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc1140-d999-424d-9c01-5298a3c4e30c None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:12.731227 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 801/1589] 10.222.0.25 () {54 vars in 912 bytes} [Fri Aug 27 01:30:12 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:30:12.734071 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61a5df-4e54-4d30-880d-819343f183d8 service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:12.739820 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8cd67-f38c-42d7-bed4-d5a605c2a56b None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:12.740307 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8cd67-f38c-42d7-bed4-d5a605c2a56b None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:12.741259 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8cd67-f38c-42d7-bed4-d5a605c2a56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:12.745743 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343e7d3-7bb9-46b1-a885-e6382b4d4db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:12.746542 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343e7d3-7bb9-46b1-a885-e6382b4d4db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:12.746832 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343e7d3-7bb9-46b1-a885-e6382b4d4db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:12.747093 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343e7d3-7bb9-46b1-a885-e6382b4d4db4 admin admin] PATH_INFO: `/v3/users/a203f766122548f1a45a4867ce6660c7` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:12.752020 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343e7d3-7bb9-46b1-a885-e6382b4d4db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a203f766122548f1a45a4867ce6660c7)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:12.753097 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: WARNING py.warnings [None req-2343e7d3-7bb9-46b1-a885-e6382b4d4db4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:30:12.753097 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: warnings.warn(msg) Aug 27 01:30:12.753097 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: Aug 27 01:30:12.754323 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343e7d3-7bb9-46b1-a885-e6382b4d4db4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:12.776005 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f6b8cd67-f38c-42d7-bed4-d5a605c2a56b None None] MFA Rules not processed for user `249a7642a0284dde91a7719f732b2d70`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:12.778833 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f6b8cd67-f38c-42d7-bed4-d5a605c2a56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:12.824794 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 802/1590] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 01:30:12 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:30:12.834233 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8cd67-f38c-42d7-bed4-d5a605c2a56b None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:12.837047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f6b8cd67-f38c-42d7-bed4-d5a605c2a56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:12.927823 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8cd67-f38c-42d7-bed4-d5a605c2a56b None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:12.933440 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4ee7f-f9f9-4601-a9db-385fccdcccc5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59679a5d71249fc8cd65fbcf84e7bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:12.934261 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4ee7f-f9f9-4601-a9db-385fccdcccc5 service glance] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:12.934640 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4ee7f-f9f9-4601-a9db-385fccdcccc5 service glance] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:12.935013 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4ee7f-f9f9-4601-a9db-385fccdcccc5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:12.957004 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4ee7f-f9f9-4601-a9db-385fccdcccc5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:12.958904 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4ee7f-f9f9-4601-a9db-385fccdcccc5 service glance] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:12.974646 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 803/1591] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:12 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:13.064383 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2343e7d3-7bb9-46b1-a885-e6382b4d4db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a203f766122548f1a45a4867ce6660c7'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:13.066348 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2343e7d3-7bb9-46b1-a885-e6382b4d4db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a203f766122548f1a45a4867ce6660c7'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:13.101841 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2343e7d3-7bb9-46b1-a885-e6382b4d4db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a203f766122548f1a45a4867ce6660c7'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:13.105482 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2343e7d3-7bb9-46b1-a885-e6382b4d4db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a203f766122548f1a45a4867ce6660c7'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:13.189470 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2343e7d3-7bb9-46b1-a885-e6382b4d4db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a203f766122548f1a45a4867ce6660c7'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:13.302836 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 789/1592] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:30:12 2021] DELETE /identity/v3/users/a203f766122548f1a45a4867ce6660c7 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:13.305432 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4d9c1-1b68-403d-a141-60ec83a3ceae None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:13.308068 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4d9c1-1b68-403d-a141-60ec83a3ceae None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:13.308068 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4d9c1-1b68-403d-a141-60ec83a3ceae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:13.341128 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-1db4d9c1-1b68-403d-a141-60ec83a3ceae None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:13.342674 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-1db4d9c1-1b68-403d-a141-60ec83a3ceae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:13.537392 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 804/1593] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:13.603828 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343e7d3-7bb9-46b1-a885-e6382b4d4db4 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:13.611407 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-2343e7d3-7bb9-46b1-a885-e6382b4d4db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:13.650106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171a7ac-dac9-465a-9fbe-a63c16782573 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:13.650500 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171a7ac-dac9-465a-9fbe-a63c16782573 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:13.650882 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171a7ac-dac9-465a-9fbe-a63c16782573 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:13.652881 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 805/1594] 10.222.0.25 () {54 vars in 912 bytes} [Fri Aug 27 01:30:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:30:13.665541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e27505-80bc-434f-8fa2-56752c45a41d None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:13.665827 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e27505-80bc-434f-8fa2-56752c45a41d None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:13.666102 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e27505-80bc-434f-8fa2-56752c45a41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:13.754864 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-54e27505-80bc-434f-8fa2-56752c45a41d None None] MFA Rules not processed for user `2e2182e4d74047a399e7ffea63e7ce6e`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:13.756102 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-54e27505-80bc-434f-8fa2-56752c45a41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:13.797421 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343e7d3-7bb9-46b1-a885-e6382b4d4db4 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:13.811173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e75a7f-dfea-4a1c-b0c7-5ea8693c3e3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:13.812132 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e75a7f-dfea-4a1c-b0c7-5ea8693c3e3f service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:13.814019 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e75a7f-dfea-4a1c-b0c7-5ea8693c3e3f service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:13.814376 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e75a7f-dfea-4a1c-b0c7-5ea8693c3e3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:13.834948 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e75a7f-dfea-4a1c-b0c7-5ea8693c3e3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:13.847572 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e75a7f-dfea-4a1c-b0c7-5ea8693c3e3f service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:13.860892 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 790/1595] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:13.863049 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 806/1596] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 01:30:13 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:13.872709 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e75a7f-dfea-4a1c-b0c7-5ea8693c3e3f service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:13.875133 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-f8e75a7f-dfea-4a1c-b0c7-5ea8693c3e3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:13.903618 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e75a7f-dfea-4a1c-b0c7-5ea8693c3e3f service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:13.910938 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c8ae3-72e0-404a-8cb1-007e7882acb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:13.911946 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c8ae3-72e0-404a-8cb1-007e7882acb8 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:13.912558 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c8ae3-72e0-404a-8cb1-007e7882acb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:13.913034 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c8ae3-72e0-404a-8cb1-007e7882acb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:13.924130 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c8ae3-72e0-404a-8cb1-007e7882acb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:13.926734 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c8ae3-72e0-404a-8cb1-007e7882acb8 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:13.956616 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 791/1597] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:13 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:15.351533 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e27505-80bc-434f-8fa2-56752c45a41d None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:15.353029 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-54e27505-80bc-434f-8fa2-56752c45a41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:15.490005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22698fd-3330-49f8-853c-dcac1fcc6887 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:15.490875 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22698fd-3330-49f8-853c-dcac1fcc6887 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:15.491388 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22698fd-3330-49f8-853c-dcac1fcc6887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:15.567105 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e27505-80bc-434f-8fa2-56752c45a41d None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:15.590040 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b9e15-7345-4edb-bc96-60c71f3b5dfb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd67c0b68ca7349399d9ea9f4a0b2b564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:15.590774 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b9e15-7345-4edb-bc96-60c71f3b5dfb service placement] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:15.591064 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b9e15-7345-4edb-bc96-60c71f3b5dfb service placement] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:15.591348 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b9e15-7345-4edb-bc96-60c71f3b5dfb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:15.601781 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c87b9e15-7345-4edb-bc96-60c71f3b5dfb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:15.605573 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-e22698fd-3330-49f8-853c-dcac1fcc6887 None None] MFA Rules not processed for user `589eca6a184e4505a0c0f97efe65892e`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:15.611236 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e22698fd-3330-49f8-853c-dcac1fcc6887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:15.658608 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b9e15-7345-4edb-bc96-60c71f3b5dfb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:15.665473 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b9e15-7345-4edb-bc96-60c71f3b5dfb service placement] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:15.711694 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 807/1598] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:15 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:15.789372 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 792/1599] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:15 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:15.790203 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad40fd-7d3f-4f4b-be38-9fb14779da1e None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:15.792011 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad40fd-7d3f-4f4b-be38-9fb14779da1e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:15.792559 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad40fd-7d3f-4f4b-be38-9fb14779da1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:15.847485 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-59ad40fd-7d3f-4f4b-be38-9fb14779da1e None None] MFA Rules not processed for user `589eca6a184e4505a0c0f97efe65892e`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:15.848731 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-59ad40fd-7d3f-4f4b-be38-9fb14779da1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:15.870696 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 808/1600] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:15 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:30:15.879610 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22698fd-3330-49f8-853c-dcac1fcc6887 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:15.881615 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e22698fd-3330-49f8-853c-dcac1fcc6887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:15.889154 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad40fd-7d3f-4f4b-be38-9fb14779da1e None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:15.893108 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-59ad40fd-7d3f-4f4b-be38-9fb14779da1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:15.931860 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22698fd-3330-49f8-853c-dcac1fcc6887 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:15.941714 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125dea7-1e30-41da-940c-0829b0157092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:15.943069 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125dea7-1e30-41da-940c-0829b0157092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:15.944384 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125dea7-1e30-41da-940c-0829b0157092 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:15.944899 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125dea7-1e30-41da-940c-0829b0157092 admin admin] PATH_INFO: `/v3/users/d2e2b0973e5540e189afdf3971919e78` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:15.951163 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125dea7-1e30-41da-940c-0829b0157092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2e2b0973e5540e189afdf3971919e78)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:15.955969 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125dea7-1e30-41da-940c-0829b0157092 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:16.052379 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad40fd-7d3f-4f4b-be38-9fb14779da1e None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:16.062524 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2255f5e-1a41-4c6a-bca9-c8dc5c3a8545 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:16.063150 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2255f5e-1a41-4c6a-bca9-c8dc5c3a8545 service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:16.063433 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2255f5e-1a41-4c6a-bca9-c8dc5c3a8545 service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:16.063708 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2255f5e-1a41-4c6a-bca9-c8dc5c3a8545 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:16.078891 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2255f5e-1a41-4c6a-bca9-c8dc5c3a8545 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:16.080501 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2255f5e-1a41-4c6a-bca9-c8dc5c3a8545 service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:16.095965 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 809/1601] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:15 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:16.107079 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2255f5e-1a41-4c6a-bca9-c8dc5c3a8545 service nova] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:16.107079 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-b2255f5e-1a41-4c6a-bca9-c8dc5c3a8545 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:16.127703 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2255f5e-1a41-4c6a-bca9-c8dc5c3a8545 service nova] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:16.133624 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292602dd-daee-4218-9777-07991b7aae7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:16.134664 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292602dd-daee-4218-9777-07991b7aae7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:16.135125 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292602dd-daee-4218-9777-07991b7aae7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:16.135563 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292602dd-daee-4218-9777-07991b7aae7b admin admin] PATH_INFO: `/v3/projects/4a969fe3d4cd472b96337f88f0aa3bb8` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:16.138215 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292602dd-daee-4218-9777-07991b7aae7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a969fe3d4cd472b96337f88f0aa3bb8)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:16.139445 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: WARNING py.warnings [None req-292602dd-daee-4218-9777-07991b7aae7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:30:16.139445 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: warnings.warn(msg) Aug 27 01:30:16.139445 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: Aug 27 01:30:16.142524 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292602dd-daee-4218-9777-07991b7aae7b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:16.196924 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-9125dea7-1e30-41da-940c-0829b0157092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2e2b0973e5540e189afdf3971919e78'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:16.199742 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-9125dea7-1e30-41da-940c-0829b0157092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2e2b0973e5540e189afdf3971919e78'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:16.226612 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-9125dea7-1e30-41da-940c-0829b0157092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2e2b0973e5540e189afdf3971919e78'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:16.227959 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-9125dea7-1e30-41da-940c-0829b0157092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2e2b0973e5540e189afdf3971919e78'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:16.311227 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-292602dd-daee-4218-9777-07991b7aae7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a969fe3d4cd472b96337f88f0aa3bb8', 'request_id': 'req-292602dd-daee-4218-9777-07991b7aae7b'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:16.317750 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-9125dea7-1e30-41da-940c-0829b0157092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2e2b0973e5540e189afdf3971919e78'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:16.329630 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-292602dd-daee-4218-9777-07991b7aae7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a969fe3d4cd472b96337f88f0aa3bb8', 'request_id': 'req-292602dd-daee-4218-9777-07991b7aae7b'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:16.388549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 793/1602] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:30:15 2021] DELETE /identity/v3/users/d2e2b0973e5540e189afdf3971919e78 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:16.399365 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55921a0f-0a86-44a0-ba4a-21ec80d7eda8 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:16.399774 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55921a0f-0a86-44a0-ba4a-21ec80d7eda8 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:16.400309 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55921a0f-0a86-44a0-ba4a-21ec80d7eda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:16.436710 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-292602dd-daee-4218-9777-07991b7aae7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a969fe3d4cd472b96337f88f0aa3bb8', 'request_id': 'req-292602dd-daee-4218-9777-07991b7aae7b'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:16.445476 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-55921a0f-0a86-44a0-ba4a-21ec80d7eda8 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:16.446825 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-55921a0f-0a86-44a0-ba4a-21ec80d7eda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:16.457258 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-292602dd-daee-4218-9777-07991b7aae7b admin admin] The token cache is being invalidate because project 4a969fe3d4cd472b96337f88f0aa3bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:30:16.461340 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-292602dd-daee-4218-9777-07991b7aae7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:16.465753 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-292602dd-daee-4218-9777-07991b7aae7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:16.474163 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 810/1603] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:30:16 2021] DELETE /identity/v3/projects/4a969fe3d4cd472b96337f88f0aa3bb8 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:16.475287 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292602dd-daee-4218-9777-07991b7aae7b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:16.485773 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-292602dd-daee-4218-9777-07991b7aae7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:16.590991 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 794/1604] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:16.628044 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292602dd-daee-4218-9777-07991b7aae7b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:16.639018 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7247ff4-a5fb-4d47-bb48-a6b038ab72b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:16.640233 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7247ff4-a5fb-4d47-bb48-a6b038ab72b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:16.640593 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7247ff4-a5fb-4d47-bb48-a6b038ab72b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:16.641338 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7247ff4-a5fb-4d47-bb48-a6b038ab72b2 admin admin] PATH_INFO: `/v3/users/048a46ddbd6e498da61620b01552541d` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:16.645944 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7247ff4-a5fb-4d47-bb48-a6b038ab72b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=048a46ddbd6e498da61620b01552541d)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:16.648059 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7247ff4-a5fb-4d47-bb48-a6b038ab72b2 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:16.738061 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55921a0f-0a86-44a0-ba4a-21ec80d7eda8 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:16.742791 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-55921a0f-0a86-44a0-ba4a-21ec80d7eda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:16.854933 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55921a0f-0a86-44a0-ba4a-21ec80d7eda8 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:16.859863 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89257d79-8f68-4de5-a0d6-40a37b5e3064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:16.860533 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89257d79-8f68-4de5-a0d6-40a37b5e3064 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:16.860965 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89257d79-8f68-4de5-a0d6-40a37b5e3064 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:16.861252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89257d79-8f68-4de5-a0d6-40a37b5e3064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:16.878334 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89257d79-8f68-4de5-a0d6-40a37b5e3064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:16.880058 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89257d79-8f68-4de5-a0d6-40a37b5e3064 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:16.905391 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 795/1605] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:16.970910 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a7247ff4-a5fb-4d47-bb48-a6b038ab72b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048a46ddbd6e498da61620b01552541d'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:16.993284 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a7247ff4-a5fb-4d47-bb48-a6b038ab72b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048a46ddbd6e498da61620b01552541d'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:17.011074 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a7247ff4-a5fb-4d47-bb48-a6b038ab72b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048a46ddbd6e498da61620b01552541d'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:17.011992 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a7247ff4-a5fb-4d47-bb48-a6b038ab72b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048a46ddbd6e498da61620b01552541d'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:17.090211 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a7247ff4-a5fb-4d47-bb48-a6b038ab72b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048a46ddbd6e498da61620b01552541d'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:17.103272 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 811/1606] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:30:16 2021] DELETE /identity/v3/users/048a46ddbd6e498da61620b01552541d => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:17.559160 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368abcb-6820-4e94-960c-ed7754870615 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:17.559864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368abcb-6820-4e94-960c-ed7754870615 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:17.560212 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368abcb-6820-4e94-960c-ed7754870615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:17.652271 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-2368abcb-6820-4e94-960c-ed7754870615 None None] MFA Rules not processed for user `fa605019ca5c40d897cb30c990710ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:17.657854 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-2368abcb-6820-4e94-960c-ed7754870615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:17.793240 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 796/1607] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:17 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:17.811659 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7247ff4-a5fb-4d47-bb48-a6b038ab72b2 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:17.813363 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a7247ff4-a5fb-4d47-bb48-a6b038ab72b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:17.986700 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7247ff4-a5fb-4d47-bb48-a6b038ab72b2 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:17.997951 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b755d5-5139-4b05-b4b5-27a318b7a5d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:18.000752 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b755d5-5139-4b05-b4b5-27a318b7a5d3 service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:18.001316 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b755d5-5139-4b05-b4b5-27a318b7a5d3 service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:18.001824 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b755d5-5139-4b05-b4b5-27a318b7a5d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:18.023012 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b755d5-5139-4b05-b4b5-27a318b7a5d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:18.028966 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b755d5-5139-4b05-b4b5-27a318b7a5d3 service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:18.064063 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 812/1608] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:17 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:18.925451 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368abcb-6820-4e94-960c-ed7754870615 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:18.927496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-2368abcb-6820-4e94-960c-ed7754870615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:19.057257 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368abcb-6820-4e94-960c-ed7754870615 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:19.067212 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba5592-fd7b-4a9e-9378-7a7c4e12ee9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:19.068137 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba5592-fd7b-4a9e-9378-7a7c4e12ee9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:19.068680 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba5592-fd7b-4a9e-9378-7a7c4e12ee9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:19.069208 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba5592-fd7b-4a9e-9378-7a7c4e12ee9f admin admin] PATH_INFO: `/v3/projects/4806e02507814baf9b517401f4aeacbb` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:19.075045 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba5592-fd7b-4a9e-9378-7a7c4e12ee9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4806e02507814baf9b517401f4aeacbb)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:19.075045 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba5592-fd7b-4a9e-9378-7a7c4e12ee9f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:19.139177 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b755d5-5139-4b05-b4b5-27a318b7a5d3 service nova] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:19.141606 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-d1b755d5-5139-4b05-b4b5-27a318b7a5d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:19.175626 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b755d5-5139-4b05-b4b5-27a318b7a5d3 service nova] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:19.183008 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930fc6e-8082-4f24-9202-753b569f099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:19.184254 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930fc6e-8082-4f24-9202-753b569f099a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:19.184644 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930fc6e-8082-4f24-9202-753b569f099a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:19.186380 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930fc6e-8082-4f24-9202-753b569f099a admin admin] PATH_INFO: `/v3/projects/f845c104f6a74062a17b5fb7d714f277` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:19.189729 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930fc6e-8082-4f24-9202-753b569f099a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f845c104f6a74062a17b5fb7d714f277)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:19.192999 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930fc6e-8082-4f24-9202-753b569f099a admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:19.247092 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cdba5592-fd7b-4a9e-9378-7a7c4e12ee9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4806e02507814baf9b517401f4aeacbb', 'request_id': 'req-cdba5592-fd7b-4a9e-9378-7a7c4e12ee9f'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:19.259319 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cdba5592-fd7b-4a9e-9378-7a7c4e12ee9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4806e02507814baf9b517401f4aeacbb', 'request_id': 'req-cdba5592-fd7b-4a9e-9378-7a7c4e12ee9f'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:19.366253 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-8930fc6e-8082-4f24-9202-753b569f099a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f845c104f6a74062a17b5fb7d714f277', 'request_id': 'req-8930fc6e-8082-4f24-9202-753b569f099a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:19.379204 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-8930fc6e-8082-4f24-9202-753b569f099a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f845c104f6a74062a17b5fb7d714f277', 'request_id': 'req-8930fc6e-8082-4f24-9202-753b569f099a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:19.399202 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cdba5592-fd7b-4a9e-9378-7a7c4e12ee9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4806e02507814baf9b517401f4aeacbb', 'request_id': 'req-cdba5592-fd7b-4a9e-9378-7a7c4e12ee9f'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:19.416213 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cdba5592-fd7b-4a9e-9378-7a7c4e12ee9f admin admin] The token cache is being invalidate because project 4806e02507814baf9b517401f4aeacbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:30:19.416508 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cdba5592-fd7b-4a9e-9378-7a7c4e12ee9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:19.429016 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cdba5592-fd7b-4a9e-9378-7a7c4e12ee9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:19.441201 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 797/1609] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:30:18 2021] DELETE /identity/v3/projects/4806e02507814baf9b517401f4aeacbb => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:19.442595 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba5592-fd7b-4a9e-9378-7a7c4e12ee9f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:19.444233 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-cdba5592-fd7b-4a9e-9378-7a7c4e12ee9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:19.544951 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-8930fc6e-8082-4f24-9202-753b569f099a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f845c104f6a74062a17b5fb7d714f277', 'request_id': 'req-8930fc6e-8082-4f24-9202-753b569f099a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:19.570246 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-8930fc6e-8082-4f24-9202-753b569f099a admin admin] The token cache is being invalidate because project f845c104f6a74062a17b5fb7d714f277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:30:19.570537 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-8930fc6e-8082-4f24-9202-753b569f099a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:19.575739 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-8930fc6e-8082-4f24-9202-753b569f099a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:19.586727 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 813/1610] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:30:19 2021] DELETE /identity/v3/projects/f845c104f6a74062a17b5fb7d714f277 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:30:19.592631 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3e0a3-cb62-42a6-b60f-39e56d0b46fd None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:19.597600 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3e0a3-cb62-42a6-b60f-39e56d0b46fd None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:19.599174 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3e0a3-cb62-42a6-b60f-39e56d0b46fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:19.698410 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-44d3e0a3-cb62-42a6-b60f-39e56d0b46fd None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:19.702520 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-44d3e0a3-cb62-42a6-b60f-39e56d0b46fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:19.763343 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba5592-fd7b-4a9e-9378-7a7c4e12ee9f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:19.943871 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 814/1611] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:19.948388 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493820e-4276-496d-a31a-75d0032925d5 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:19.978390 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493820e-4276-496d-a31a-75d0032925d5 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:19.978768 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493820e-4276-496d-a31a-75d0032925d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:20.030203 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26adb9b-cfa5-4ec3-a3e8-849a048cc741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:20.031726 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26adb9b-cfa5-4ec3-a3e8-849a048cc741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:20.032006 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26adb9b-cfa5-4ec3-a3e8-849a048cc741 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:20.032278 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26adb9b-cfa5-4ec3-a3e8-849a048cc741 admin admin] PATH_INFO: `/v3/users/211666772b1042cdbcbad7183c474fd2` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:20.040541 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26adb9b-cfa5-4ec3-a3e8-849a048cc741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=211666772b1042cdbcbad7183c474fd2)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:20.058486 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26adb9b-cfa5-4ec3-a3e8-849a048cc741 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:20.085591 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-2493820e-4276-496d-a31a-75d0032925d5 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:20.086742 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-2493820e-4276-496d-a31a-75d0032925d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:20.128639 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 815/1612] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:20.133428 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493820e-4276-496d-a31a-75d0032925d5 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:20.151197 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493820e-4276-496d-a31a-75d0032925d5 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:20.170710 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a7a51-8d20-4c78-ab45-dbbca6b0d9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:20.171585 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a7a51-8d20-4c78-ab45-dbbca6b0d9ff admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:20.172145 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a7a51-8d20-4c78-ab45-dbbca6b0d9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:20.172252 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a7a51-8d20-4c78-ab45-dbbca6b0d9ff admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:20.172989 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a7a51-8d20-4c78-ab45-dbbca6b0d9ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:30:20.173737 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a7a51-8d20-4c78-ab45-dbbca6b0d9ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:20.178453 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a7a51-8d20-4c78-ab45-dbbca6b0d9ff admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:20.212327 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 816/1613] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:30:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:30:20.220578 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a7a51-8d20-4c78-ab45-dbbca6b0d9ff admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:20.245585 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a7a51-8d20-4c78-ab45-dbbca6b0d9ff admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:20.277490 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050530b6-ca79-454f-8490-9091c4bb4dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:20.277868 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050530b6-ca79-454f-8490-9091c4bb4dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:20.278146 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050530b6-ca79-454f-8490-9091c4bb4dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:20.278438 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050530b6-ca79-454f-8490-9091c4bb4dc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:20.283691 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050530b6-ca79-454f-8490-9091c4bb4dc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:20.287843 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050530b6-ca79-454f-8490-9091c4bb4dc9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:20.374998 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-a26adb9b-cfa5-4ec3-a3e8-849a048cc741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211666772b1042cdbcbad7183c474fd2'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:20.377005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-a26adb9b-cfa5-4ec3-a3e8-849a048cc741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211666772b1042cdbcbad7183c474fd2'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:20.410967 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-a26adb9b-cfa5-4ec3-a3e8-849a048cc741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211666772b1042cdbcbad7183c474fd2'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:20.412010 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-a26adb9b-cfa5-4ec3-a3e8-849a048cc741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211666772b1042cdbcbad7183c474fd2'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:20.475526 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 817/1614] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:30:20 2021] POST /identity/v3/projects => generated 385 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:20.481405 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050530b6-ca79-454f-8490-9091c4bb4dc9 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:20.487250 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-050530b6-ca79-454f-8490-9091c4bb4dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:20.493479 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-a26adb9b-cfa5-4ec3-a3e8-849a048cc741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211666772b1042cdbcbad7183c474fd2'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:20.562410 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 798/1615] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:30:19 2021] DELETE /identity/v3/users/211666772b1042cdbcbad7183c474fd2 => generated 0 bytes in 1120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:20.564019 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93051c12-592b-475f-b595-751ee3f2dc18 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:20.571603 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93051c12-592b-475f-b595-751ee3f2dc18 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:20.571603 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93051c12-592b-475f-b595-751ee3f2dc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:20.661173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-93051c12-592b-475f-b595-751ee3f2dc18 None None] MFA Rules not processed for user `9032bdd7ffde4d3f9b500974a4c17c67`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:20.661173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-93051c12-592b-475f-b595-751ee3f2dc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:20.787481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050530b6-ca79-454f-8490-9091c4bb4dc9 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:20.942508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7431c-f17c-4557-baab-4645ec38234c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:20.942508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7431c-f17c-4557-baab-4645ec38234c admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:20.942508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7431c-f17c-4557-baab-4645ec38234c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:20.942508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7431c-f17c-4557-baab-4645ec38234c admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:20.951883 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd7431c-f17c-4557-baab-4645ec38234c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:20.951883 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd7431c-f17c-4557-baab-4645ec38234c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:20.959966 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 799/1616] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:20 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:20.982282 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93051c12-592b-475f-b595-751ee3f2dc18 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:20.991882 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-93051c12-592b-475f-b595-751ee3f2dc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:21.146411 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 818/1617] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:30:20 2021] POST /identity/v3/users => generated 293 bytes in 663 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:30:21.150537 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7431c-f17c-4557-baab-4645ec38234c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:21.191977 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7431c-f17c-4557-baab-4645ec38234c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:21.213969 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93051c12-592b-475f-b595-751ee3f2dc18 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:21.236230 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d81bd-b8ad-41aa-a7f5-11876a994fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:21.237280 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d81bd-b8ad-41aa-a7f5-11876a994fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:21.245594 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d81bd-b8ad-41aa-a7f5-11876a994fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:21.246713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d81bd-b8ad-41aa-a7f5-11876a994fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:21.249529 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d81bd-b8ad-41aa-a7f5-11876a994fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:21.267281 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d81bd-b8ad-41aa-a7f5-11876a994fd5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:21.285429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf22be-9f1a-463d-9126-a2f2beef3364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:21.286414 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf22be-9f1a-463d-9126-a2f2beef3364 service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:21.286863 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf22be-9f1a-463d-9126-a2f2beef3364 service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:21.287313 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf22be-9f1a-463d-9126-a2f2beef3364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:21.298076 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf22be-9f1a-463d-9126-a2f2beef3364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:21.304622 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf22be-9f1a-463d-9126-a2f2beef3364 service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:21.316961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 800/1618] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:20 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:21.326624 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 819/1619] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:21 2021] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:21.333312 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf22be-9f1a-463d-9126-a2f2beef3364 service nova] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:21.365548 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf22be-9f1a-463d-9126-a2f2beef3364 service nova] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:21.474667 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564e49e-6229-4da1-8b42-beef36d24725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:21.475497 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564e49e-6229-4da1-8b42-beef36d24725 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:21.477304 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564e49e-6229-4da1-8b42-beef36d24725 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:21.483064 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564e49e-6229-4da1-8b42-beef36d24725 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:21.484230 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564e49e-6229-4da1-8b42-beef36d24725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:21.486635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564e49e-6229-4da1-8b42-beef36d24725 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:21.514617 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 801/1620] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:21 2021] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:21.515571 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d81bd-b8ad-41aa-a7f5-11876a994fd5 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:21.526271 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d81bd-b8ad-41aa-a7f5-11876a994fd5 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:21.548748 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5f407-816c-47aa-806e-5d0c05c9878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:21.552809 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5f407-816c-47aa-806e-5d0c05c9878e admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:21.556032 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5f407-816c-47aa-806e-5d0c05c9878e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:21.560290 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5f407-816c-47aa-806e-5d0c05c9878e admin admin] PATH_INFO: `/v3/projects/f7b952fa10d34e14bc38aae68ac00f63/users/0bc89c24516c402699ef813d789c04bd/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:21.647039 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5f407-816c-47aa-806e-5d0c05c9878e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7b952fa10d34e14bc38aae68ac00f63, user_id=0bc89c24516c402699ef813d789c04bd, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:21.661672 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5f407-816c-47aa-806e-5d0c05c9878e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:21.772541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 820/1621] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:21 2021] PUT /identity/v3/projects/f7b952fa10d34e14bc38aae68ac00f63/users/0bc89c24516c402699ef813d789c04bd/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:30:21.794322 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564e49e-6229-4da1-8b42-beef36d24725 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:21.814936 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8564e49e-6229-4da1-8b42-beef36d24725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:21.823900 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff1b55-787d-4adc-b4c5-6bdc7bd63dc7 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:21.824191 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff1b55-787d-4adc-b4c5-6bdc7bd63dc7 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:21.824471 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff1b55-787d-4adc-b4c5-6bdc7bd63dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:21.845806 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564e49e-6229-4da1-8b42-beef36d24725 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:21.925666 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-42ff1b55-787d-4adc-b4c5-6bdc7bd63dc7 None None] MFA Rules not processed for user `0bc89c24516c402699ef813d789c04bd`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:21.933743 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-42ff1b55-787d-4adc-b4c5-6bdc7bd63dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:21.987023 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17264e-cc05-4c4b-87e1-6ff13552970d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:21.988225 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17264e-cc05-4c4b-87e1-6ff13552970d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:21.990188 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17264e-cc05-4c4b-87e1-6ff13552970d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:21.991808 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17264e-cc05-4c4b-87e1-6ff13552970d admin admin] PATH_INFO: `/v3/projects/2c5ed0473a6b46bb9add0e4f5add1453` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:21.997993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17264e-cc05-4c4b-87e1-6ff13552970d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c5ed0473a6b46bb9add0e4f5add1453)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:22.011585 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17264e-cc05-4c4b-87e1-6ff13552970d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:22.248773 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4f17264e-cc05-4c4b-87e1-6ff13552970d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c5ed0473a6b46bb9add0e4f5add1453', 'request_id': 'req-4f17264e-cc05-4c4b-87e1-6ff13552970d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:22.265560 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4f17264e-cc05-4c4b-87e1-6ff13552970d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c5ed0473a6b46bb9add0e4f5add1453', 'request_id': 'req-4f17264e-cc05-4c4b-87e1-6ff13552970d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:22.367196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4f17264e-cc05-4c4b-87e1-6ff13552970d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c5ed0473a6b46bb9add0e4f5add1453', 'request_id': 'req-4f17264e-cc05-4c4b-87e1-6ff13552970d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:22.367322 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 821/1622] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:21 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 545 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:22.367832 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff1b55-787d-4adc-b4c5-6bdc7bd63dc7 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:22.406393 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff1b55-787d-4adc-b4c5-6bdc7bd63dc7 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:22.408914 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4f17264e-cc05-4c4b-87e1-6ff13552970d admin admin] The token cache is being invalidate because project 2c5ed0473a6b46bb9add0e4f5add1453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:30:22.409261 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4f17264e-cc05-4c4b-87e1-6ff13552970d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:22.411217 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4f17264e-cc05-4c4b-87e1-6ff13552970d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:22.414785 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 802/1623] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:30:21 2021] DELETE /identity/v3/projects/2c5ed0473a6b46bb9add0e4f5add1453 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:30:22.425773 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a868ce-6fe0-4cec-bfc2-42cc393ba596 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:22.427477 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a868ce-6fe0-4cec-bfc2-42cc393ba596 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:22.427990 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a868ce-6fe0-4cec-bfc2-42cc393ba596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:22.504407 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b1a868ce-6fe0-4cec-bfc2-42cc393ba596 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:22.506872 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b1a868ce-6fe0-4cec-bfc2-42cc393ba596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:22.602403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dc434-c426-499d-b813-ae81e8f4c9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:22.603099 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dc434-c426-499d-b813-ae81e8f4c9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:22.603385 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dc434-c426-499d-b813-ae81e8f4c9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:22.603666 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dc434-c426-499d-b813-ae81e8f4c9a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:22.604368 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64dc434-c426-499d-b813-ae81e8f4c9a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:22.611432 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64dc434-c426-499d-b813-ae81e8f4c9a9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:22.709233 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 803/1624] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:22.710303 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a868ce-6fe0-4cec-bfc2-42cc393ba596 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:22.714493 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b1a868ce-6fe0-4cec-bfc2-42cc393ba596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:22.740764 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a868ce-6fe0-4cec-bfc2-42cc393ba596 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:22.751475 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fc54e-d17c-44f8-b8c9-95245c64a3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:22.753594 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fc54e-d17c-44f8-b8c9-95245c64a3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:22.753994 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fc54e-d17c-44f8-b8c9-95245c64a3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:22.754375 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fc54e-d17c-44f8-b8c9-95245c64a3c1 admin admin] PATH_INFO: `/v3/users/88c50d7a2de940f6a19c53f1f51085a8` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:22.761625 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908fc54e-d17c-44f8-b8c9-95245c64a3c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c50d7a2de940f6a19c53f1f51085a8)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:22.765635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908fc54e-d17c-44f8-b8c9-95245c64a3c1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:22.770905 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 822/1625] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:30:22 2021] POST /identity/v3/projects => generated 385 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:22.770905 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f79b26-e281-4f7c-951a-e653435785de None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:22.770905 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f79b26-e281-4f7c-951a-e653435785de None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:22.770905 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f79b26-e281-4f7c-951a-e653435785de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:22.813109 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-79f79b26-e281-4f7c-951a-e653435785de None None] MFA Rules not processed for user `3f65fb7e73db469f8b171c3126005427`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:22.815523 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-79f79b26-e281-4f7c-951a-e653435785de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:22.961583 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 823/1626] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 01:30:22 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:22.965054 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefce71-5b2a-4cf6-934d-17e2558c2678 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:22.967361 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefce71-5b2a-4cf6-934d-17e2558c2678 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:22.967630 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefce71-5b2a-4cf6-934d-17e2558c2678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:22.973439 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-908fc54e-d17c-44f8-b8c9-95245c64a3c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c50d7a2de940f6a19c53f1f51085a8'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:22.974806 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-908fc54e-d17c-44f8-b8c9-95245c64a3c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c50d7a2de940f6a19c53f1f51085a8'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:23.009044 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-908fc54e-d17c-44f8-b8c9-95245c64a3c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c50d7a2de940f6a19c53f1f51085a8'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:23.012266 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-908fc54e-d17c-44f8-b8c9-95245c64a3c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c50d7a2de940f6a19c53f1f51085a8'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:23.024478 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-abefce71-5b2a-4cf6-934d-17e2558c2678 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:23.025794 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-abefce71-5b2a-4cf6-934d-17e2558c2678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:23.147468 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-908fc54e-d17c-44f8-b8c9-95245c64a3c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c50d7a2de940f6a19c53f1f51085a8'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:23.179106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 824/1627] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:23.180246 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefce71-5b2a-4cf6-934d-17e2558c2678 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:23.182115 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-abefce71-5b2a-4cf6-934d-17e2558c2678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:23.524990 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefce71-5b2a-4cf6-934d-17e2558c2678 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:23.524990 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2963919-7d7f-4a1a-ac78-bbb4307e61cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:23.524990 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2963919-7d7f-4a1a-ac78-bbb4307e61cc admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:23.524990 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2963919-7d7f-4a1a-ac78-bbb4307e61cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:23.540276 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2963919-7d7f-4a1a-ac78-bbb4307e61cc admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:23.540276 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2963919-7d7f-4a1a-ac78-bbb4307e61cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:23.540276 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2963919-7d7f-4a1a-ac78-bbb4307e61cc admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:23.546002 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 804/1628] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:30:22 2021] DELETE /identity/v3/users/88c50d7a2de940f6a19c53f1f51085a8 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:23.546002 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fc54e-d17c-44f8-b8c9-95245c64a3c1 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:23.546002 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fc54e-d17c-44f8-b8c9-95245c64a3c1 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:23.546002 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27facc49-a763-43e3-aa7f-4b48f21a45bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:23.549993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27facc49-a763-43e3-aa7f-4b48f21a45bf admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:23.549993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27facc49-a763-43e3-aa7f-4b48f21a45bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:23.549993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27facc49-a763-43e3-aa7f-4b48f21a45bf admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:23.549993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27facc49-a763-43e3-aa7f-4b48f21a45bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:30:23.549993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27facc49-a763-43e3-aa7f-4b48f21a45bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:23.549993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27facc49-a763-43e3-aa7f-4b48f21a45bf admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:23.554065 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 825/1629] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:30:23 2021] POST /identity/v3/users => generated 299 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:23.554065 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2908d2c-8482-4925-859d-1a3e3a3516d2 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:23.554065 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2908d2c-8482-4925-859d-1a3e3a3516d2 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:23.554065 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2908d2c-8482-4925-859d-1a3e3a3516d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:23.557339 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 805/1630] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:30:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:30:23.557339 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27facc49-a763-43e3-aa7f-4b48f21a45bf admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:23.557339 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27facc49-a763-43e3-aa7f-4b48f21a45bf admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:23.557339 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878994cb-3fab-456a-904a-7a0c5c54285f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:23.558660 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878994cb-3fab-456a-904a-7a0c5c54285f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:23.558660 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878994cb-3fab-456a-904a-7a0c5c54285f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:23.558660 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878994cb-3fab-456a-904a-7a0c5c54285f admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:23.558660 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878994cb-3fab-456a-904a-7a0c5c54285f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:23.558660 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878994cb-3fab-456a-904a-7a0c5c54285f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:23.559246 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-e2908d2c-8482-4925-859d-1a3e3a3516d2 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:23.559246 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-e2908d2c-8482-4925-859d-1a3e3a3516d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:23.559635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 806/1631] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:23 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:23.559635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878994cb-3fab-456a-904a-7a0c5c54285f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:23.559872 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 826/1632] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:23.559872 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2908d2c-8482-4925-859d-1a3e3a3516d2 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:23.560124 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878994cb-3fab-456a-904a-7a0c5c54285f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:23.560124 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd2094-ae37-46d6-a270-17fc98718826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:23.560124 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd2094-ae37-46d6-a270-17fc98718826 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:23.560124 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd2094-ae37-46d6-a270-17fc98718826 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:23.560619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd2094-ae37-46d6-a270-17fc98718826 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:23.560619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd2094-ae37-46d6-a270-17fc98718826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:23.561043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2908d2c-8482-4925-859d-1a3e3a3516d2 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:23.561175 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd2094-ae37-46d6-a270-17fc98718826 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:23.561433 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9682aae-1c97-4612-9fcb-4a205e9048d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:23.561433 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9682aae-1c97-4612-9fcb-4a205e9048d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:23.561433 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9682aae-1c97-4612-9fcb-4a205e9048d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:23.561433 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9682aae-1c97-4612-9fcb-4a205e9048d0 admin admin] PATH_INFO: `/v3/projects/b16c2d4a190441cf8fd416830904fb8e/users/e818665556df43c79ccce6d8d362174a/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:23.575530 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9682aae-1c97-4612-9fcb-4a205e9048d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16c2d4a190441cf8fd416830904fb8e, user_id=e818665556df43c79ccce6d8d362174a, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:23.578195 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9682aae-1c97-4612-9fcb-4a205e9048d0 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:23.634187 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 807/1633] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:30:23 2021] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:23.635463 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd2094-ae37-46d6-a270-17fc98718826 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:23.643459 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-6edd2094-ae37-46d6-a270-17fc98718826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:23.675016 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 827/1634] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:23 2021] PUT /identity/v3/projects/b16c2d4a190441cf8fd416830904fb8e/users/e818665556df43c79ccce6d8d362174a/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:23.675738 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9682aae-1c97-4612-9fcb-4a205e9048d0 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:23.683599 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f9682aae-1c97-4612-9fcb-4a205e9048d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:23.747179 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd2094-ae37-46d6-a270-17fc98718826 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:23.820378 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c62ccb-212e-4d1a-8af8-163cc5618768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:23.821076 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c62ccb-212e-4d1a-8af8-163cc5618768 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:23.821436 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c62ccb-212e-4d1a-8af8-163cc5618768 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:23.821786 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c62ccb-212e-4d1a-8af8-163cc5618768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:23.837734 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9682aae-1c97-4612-9fcb-4a205e9048d0 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:23.854256 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc455587-34eb-4335-af4c-06fa31ffebbe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48536f4437240b79cf10961de9cc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:23.855836 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455587-34eb-4335-af4c-06fa31ffebbe service swift] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:23.855836 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455587-34eb-4335-af4c-06fa31ffebbe service swift] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:23.855836 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455587-34eb-4335-af4c-06fa31ffebbe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:23.862704 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-dc455587-34eb-4335-af4c-06fa31ffebbe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:23.932882 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc455587-34eb-4335-af4c-06fa31ffebbe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:23.937457 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc455587-34eb-4335-af4c-06fa31ffebbe service swift] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:23.966267 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c62ccb-212e-4d1a-8af8-163cc5618768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:23.974064 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c62ccb-212e-4d1a-8af8-163cc5618768 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:23.975169 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 828/1635] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 01:30:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 01:30:23.981382 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc455587-34eb-4335-af4c-06fa31ffebbe service swift] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:24.008941 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 808/1636] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:24.009569 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc455587-34eb-4335-af4c-06fa31ffebbe service swift] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:24.011426 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c62ccb-212e-4d1a-8af8-163cc5618768 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:24.023926 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee624d2-0c22-4f44-9da5-22fda64f1cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:24.026058 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee624d2-0c22-4f44-9da5-22fda64f1cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:24.026717 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee624d2-0c22-4f44-9da5-22fda64f1cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:24.027185 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee624d2-0c22-4f44-9da5-22fda64f1cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:24.028095 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee624d2-0c22-4f44-9da5-22fda64f1cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:24.034293 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee624d2-0c22-4f44-9da5-22fda64f1cf2 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:24.035914 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c62ccb-212e-4d1a-8af8-163cc5618768 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:24.050249 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ab429-ecac-4da4-914e-ca1151ea8b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:24.051576 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ab429-ecac-4da4-914e-ca1151ea8b46 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:24.052074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ab429-ecac-4da4-914e-ca1151ea8b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:24.052935 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ab429-ecac-4da4-914e-ca1151ea8b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:24.054039 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ab429-ecac-4da4-914e-ca1151ea8b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:24.055862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ab429-ecac-4da4-914e-ca1151ea8b46 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:24.102792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 809/1637] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:24 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:24.118541 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ab429-ecac-4da4-914e-ca1151ea8b46 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:24.162837 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ab429-ecac-4da4-914e-ca1151ea8b46 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:24.177798 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4f91c-0ab9-41bf-b6bc-7c08bfcf7d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:24.179526 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4f91c-0ab9-41bf-b6bc-7c08bfcf7d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:24.181199 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4f91c-0ab9-41bf-b6bc-7c08bfcf7d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:24.181654 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4f91c-0ab9-41bf-b6bc-7c08bfcf7d3a admin admin] PATH_INFO: `/v3/projects/b16c2d4a190441cf8fd416830904fb8e/users/e818665556df43c79ccce6d8d362174a/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:24.184707 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4f91c-0ab9-41bf-b6bc-7c08bfcf7d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16c2d4a190441cf8fd416830904fb8e, user_id=e818665556df43c79ccce6d8d362174a, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:24.188697 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4f91c-0ab9-41bf-b6bc-7c08bfcf7d3a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:24.208885 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 810/1638] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:24 2021] PUT /identity/v3/projects/b16c2d4a190441cf8fd416830904fb8e/users/e818665556df43c79ccce6d8d362174a/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:24.220537 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a5cc2-a576-46b1-8e2b-643ad38722d9 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:24.221556 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a5cc2-a576-46b1-8e2b-643ad38722d9 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:24.222155 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a5cc2-a576-46b1-8e2b-643ad38722d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:24.272557 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 829/1639] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:30:23 2021] POST /identity/v3/users => generated 292 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:24.278257 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee624d2-0c22-4f44-9da5-22fda64f1cf2 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:24.313642 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee624d2-0c22-4f44-9da5-22fda64f1cf2 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:24.364142 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-087a5cc2-a576-46b1-8e2b-643ad38722d9 None None] MFA Rules not processed for user `e818665556df43c79ccce6d8d362174a`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:24.365369 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-087a5cc2-a576-46b1-8e2b-643ad38722d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:24.480111 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5e6ef-759b-4cb2-b261-1f4a2623023c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:24.481261 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5e6ef-759b-4cb2-b261-1f4a2623023c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:24.482886 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5e6ef-759b-4cb2-b261-1f4a2623023c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:24.484113 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5e6ef-759b-4cb2-b261-1f4a2623023c admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:24.486652 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5e6ef-759b-4cb2-b261-1f4a2623023c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:24.490032 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5e6ef-759b-4cb2-b261-1f4a2623023c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:24.521041 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 830/1640] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:24 2021] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:24.525067 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5e6ef-759b-4cb2-b261-1f4a2623023c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:24.551150 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5e6ef-759b-4cb2-b261-1f4a2623023c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:24.564869 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabb639-11ca-4d80-95a3-cc11e72a941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:24.566282 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabb639-11ca-4d80-95a3-cc11e72a941c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:24.566724 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabb639-11ca-4d80-95a3-cc11e72a941c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:24.567182 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabb639-11ca-4d80-95a3-cc11e72a941c admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:24.568275 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabb639-11ca-4d80-95a3-cc11e72a941c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:24.570668 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabb639-11ca-4d80-95a3-cc11e72a941c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:24.586106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 831/1641] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:24 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:24.590951 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabb639-11ca-4d80-95a3-cc11e72a941c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:24.606846 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabb639-11ca-4d80-95a3-cc11e72a941c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:24.631374 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 811/1642] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:24 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:24.641523 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45f522-7cb5-4703-992e-24584f3e2cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:24.643298 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a5cc2-a576-46b1-8e2b-643ad38722d9 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:24.644185 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45f522-7cb5-4703-992e-24584f3e2cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:24.644681 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45f522-7cb5-4703-992e-24584f3e2cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:24.645231 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45f522-7cb5-4703-992e-24584f3e2cf6 admin admin] PATH_INFO: `/v3/projects/b443af47525a4bfebdbdbc64f2f53fd3/users/07ad44e944e843c1ad0432d38ace7651/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:24.648159 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-087a5cc2-a576-46b1-8e2b-643ad38722d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:24.670816 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45f522-7cb5-4703-992e-24584f3e2cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b443af47525a4bfebdbdbc64f2f53fd3, user_id=07ad44e944e843c1ad0432d38ace7651, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:24.675187 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45f522-7cb5-4703-992e-24584f3e2cf6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:24.752058 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 832/1643] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:24 2021] PUT /identity/v3/projects/b443af47525a4bfebdbdbc64f2f53fd3/users/07ad44e944e843c1ad0432d38ace7651/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:24.818681 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5d799-fa05-4054-99f8-c29f0ce1a36d None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:24.819852 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5d799-fa05-4054-99f8-c29f0ce1a36d None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:24.820373 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5d799-fa05-4054-99f8-c29f0ce1a36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:24.868988 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a5cc2-a576-46b1-8e2b-643ad38722d9 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:24.925886 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-98f5d799-fa05-4054-99f8-c29f0ce1a36d None None] MFA Rules not processed for user `07ad44e944e843c1ad0432d38ace7651`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:24.932690 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-98f5d799-fa05-4054-99f8-c29f0ce1a36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:25.024502 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b84597-ded0-401c-a07d-98f500d6b1f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:25.025170 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b84597-ded0-401c-a07d-98f500d6b1f3 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:25.025472 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b84597-ded0-401c-a07d-98f500d6b1f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:25.025733 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b84597-ded0-401c-a07d-98f500d6b1f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:25.034869 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-66b84597-ded0-401c-a07d-98f500d6b1f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:25.121135 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 833/1644] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:24 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:30:25.138614 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5d799-fa05-4054-99f8-c29f0ce1a36d None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:25.141604 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-98f5d799-fa05-4054-99f8-c29f0ce1a36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:25.188128 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5d799-fa05-4054-99f8-c29f0ce1a36d None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:25.204071 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86d3c1-be21-4a4a-ac0e-05fb612a3f59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:25.204746 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86d3c1-be21-4a4a-ac0e-05fb612a3f59 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:25.206571 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86d3c1-be21-4a4a-ac0e-05fb612a3f59 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:25.206856 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86d3c1-be21-4a4a-ac0e-05fb612a3f59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:25.237822 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86d3c1-be21-4a4a-ac0e-05fb612a3f59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:25.239280 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86d3c1-be21-4a4a-ac0e-05fb612a3f59 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:25.256953 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b84597-ded0-401c-a07d-98f500d6b1f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:25.258293 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b84597-ded0-401c-a07d-98f500d6b1f3 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:25.279824 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 834/1645] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:25 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:25.291579 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 812/1646] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:24 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:25.315943 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86d3c1-be21-4a4a-ac0e-05fb612a3f59 service cinder] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:25.452466 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86d3c1-be21-4a4a-ac0e-05fb612a3f59 service cinder] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:25.461754 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f0c76-9fd0-47fe-9a21-19028dc0a4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:25.462950 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f0c76-9fd0-47fe-9a21-19028dc0a4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:25.463461 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f0c76-9fd0-47fe-9a21-19028dc0a4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:25.463969 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f0c76-9fd0-47fe-9a21-19028dc0a4f3 admin admin] PATH_INFO: `/v3/users/07ad44e944e843c1ad0432d38ace7651` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:25.465681 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f0c76-9fd0-47fe-9a21-19028dc0a4f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ad44e944e843c1ad0432d38ace7651)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:25.468723 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f0c76-9fd0-47fe-9a21-19028dc0a4f3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:25.779934 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4a2f0c76-9fd0-47fe-9a21-19028dc0a4f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ad44e944e843c1ad0432d38ace7651'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:25.836078 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4a2f0c76-9fd0-47fe-9a21-19028dc0a4f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ad44e944e843c1ad0432d38ace7651'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:25.859008 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4a2f0c76-9fd0-47fe-9a21-19028dc0a4f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ad44e944e843c1ad0432d38ace7651'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:25.863436 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4a2f0c76-9fd0-47fe-9a21-19028dc0a4f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ad44e944e843c1ad0432d38ace7651'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:25.936127 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4a2f0c76-9fd0-47fe-9a21-19028dc0a4f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ad44e944e843c1ad0432d38ace7651'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:25.953343 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 835/1647] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:30:25 2021] DELETE /identity/v3/users/07ad44e944e843c1ad0432d38ace7651 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:25.954517 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27df757-46de-4e5b-901c-15bf1e5462ca None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:25.954980 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27df757-46de-4e5b-901c-15bf1e5462ca None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:25.955121 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27df757-46de-4e5b-901c-15bf1e5462ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:26.001522 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-c27df757-46de-4e5b-901c-15bf1e5462ca None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:26.004451 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-c27df757-46de-4e5b-901c-15bf1e5462ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:26.166177 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f0c76-9fd0-47fe-9a21-19028dc0a4f3 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:26.168053 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-4a2f0c76-9fd0-47fe-9a21-19028dc0a4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:26.247163 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 813/1648] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:26.292697 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27df757-46de-4e5b-901c-15bf1e5462ca None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:26.294821 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-c27df757-46de-4e5b-901c-15bf1e5462ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:26.409106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f0c76-9fd0-47fe-9a21-19028dc0a4f3 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:26.426957 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba050ad0-3422-4d34-8cb4-e0692829018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:26.428142 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba050ad0-3422-4d34-8cb4-e0692829018e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:26.429585 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba050ad0-3422-4d34-8cb4-e0692829018e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:26.430029 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba050ad0-3422-4d34-8cb4-e0692829018e admin admin] PATH_INFO: `/v3/projects/f9f6df5219a048199f4d84b595da4f43` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:26.432067 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba050ad0-3422-4d34-8cb4-e0692829018e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9f6df5219a048199f4d84b595da4f43)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:26.434356 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba050ad0-3422-4d34-8cb4-e0692829018e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:26.562198 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27df757-46de-4e5b-901c-15bf1e5462ca None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:26.602274 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b184d2-6457-4ce4-b99a-9a268319d044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:26.603489 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b184d2-6457-4ce4-b99a-9a268319d044 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:26.606182 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b184d2-6457-4ce4-b99a-9a268319d044 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:26.609930 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b184d2-6457-4ce4-b99a-9a268319d044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:26.649579 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ba050ad0-3422-4d34-8cb4-e0692829018e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9f6df5219a048199f4d84b595da4f43', 'request_id': 'req-ba050ad0-3422-4d34-8cb4-e0692829018e'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:26.663703 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b184d2-6457-4ce4-b99a-9a268319d044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:26.675184 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b184d2-6457-4ce4-b99a-9a268319d044 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:26.679108 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ba050ad0-3422-4d34-8cb4-e0692829018e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9f6df5219a048199f4d84b595da4f43', 'request_id': 'req-ba050ad0-3422-4d34-8cb4-e0692829018e'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:26.725081 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 814/1649] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:30:26.770825 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ba050ad0-3422-4d34-8cb4-e0692829018e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9f6df5219a048199f4d84b595da4f43', 'request_id': 'req-ba050ad0-3422-4d34-8cb4-e0692829018e'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:26.791939 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ba050ad0-3422-4d34-8cb4-e0692829018e admin admin] The token cache is being invalidate because project f9f6df5219a048199f4d84b595da4f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:30:26.793035 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ba050ad0-3422-4d34-8cb4-e0692829018e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:26.796340 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ba050ad0-3422-4d34-8cb4-e0692829018e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:26.800988 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 836/1650] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:30:26 2021] DELETE /identity/v3/projects/f9f6df5219a048199f4d84b595da4f43 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:26.809381 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fa5f4-2c0d-494b-bf0d-b07f96f3e67e None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:26.809820 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fa5f4-2c0d-494b-bf0d-b07f96f3e67e None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:26.810162 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fa5f4-2c0d-494b-bf0d-b07f96f3e67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:26.862765 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-a80fa5f4-2c0d-494b-bf0d-b07f96f3e67e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:26.867001 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a80fa5f4-2c0d-494b-bf0d-b07f96f3e67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:27.039167 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 815/1651] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:27.048994 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30b4f9-b40e-4fa0-b85f-4ad688ee3ec7 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:27.049448 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30b4f9-b40e-4fa0-b85f-4ad688ee3ec7 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:27.049737 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30b4f9-b40e-4fa0-b85f-4ad688ee3ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:27.090883 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-5e30b4f9-b40e-4fa0-b85f-4ad688ee3ec7 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:27.092157 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-5e30b4f9-b40e-4fa0-b85f-4ad688ee3ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:27.121823 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 837/1652] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:27.123401 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fa5f4-2c0d-494b-bf0d-b07f96f3e67e None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:27.141055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fa5f4-2c0d-494b-bf0d-b07f96f3e67e None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:27.153032 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9d5f3-fd86-428e-a55c-22f018375b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:27.155085 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9d5f3-fd86-428e-a55c-22f018375b8b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:27.162079 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9d5f3-fd86-428e-a55c-22f018375b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:27.162079 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9d5f3-fd86-428e-a55c-22f018375b8b admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:27.162079 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9d5f3-fd86-428e-a55c-22f018375b8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:30:27.162079 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9d5f3-fd86-428e-a55c-22f018375b8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:27.163470 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9d5f3-fd86-428e-a55c-22f018375b8b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:27.197218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 816/1653] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:30:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:30:27.202054 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30b4f9-b40e-4fa0-b85f-4ad688ee3ec7 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:27.218236 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30b4f9-b40e-4fa0-b85f-4ad688ee3ec7 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:27.236740 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e5a3a-9cbb-4204-a785-12a069e4e6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:27.238450 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e5a3a-9cbb-4204-a785-12a069e4e6dd admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:27.241573 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e5a3a-9cbb-4204-a785-12a069e4e6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:27.241998 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e5a3a-9cbb-4204-a785-12a069e4e6dd admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:27.242894 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e5a3a-9cbb-4204-a785-12a069e4e6dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:27.248504 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e5a3a-9cbb-4204-a785-12a069e4e6dd admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:27.359427 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 838/1654] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:30:27 2021] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:27.365499 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9d5f3-fd86-428e-a55c-22f018375b8b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:27.379426 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9d5f3-fd86-428e-a55c-22f018375b8b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:27.542019 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1190d92-0c3e-4530-899f-405a42f33302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:27.544214 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1190d92-0c3e-4530-899f-405a42f33302 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:27.544922 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1190d92-0c3e-4530-899f-405a42f33302 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:27.559071 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1190d92-0c3e-4530-899f-405a42f33302 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:27.560504 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1190d92-0c3e-4530-899f-405a42f33302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:27.563178 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1190d92-0c3e-4530-899f-405a42f33302 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:27.673447 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 817/1655] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:30:27 2021] POST /identity/v3/users => generated 285 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:27.674308 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e5a3a-9cbb-4204-a785-12a069e4e6dd admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:27.694874 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e5a3a-9cbb-4204-a785-12a069e4e6dd admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:27.699770 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d07d46-9794-4455-b9b3-ce27b603b5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:27.700461 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d07d46-9794-4455-b9b3-ce27b603b5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:27.700751 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d07d46-9794-4455-b9b3-ce27b603b5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:27.701131 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d07d46-9794-4455-b9b3-ce27b603b5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:27.701919 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d07d46-9794-4455-b9b3-ce27b603b5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:27.705351 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d07d46-9794-4455-b9b3-ce27b603b5b1 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:27.726614 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 839/1656] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:27 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:30:27.728597 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1190d92-0c3e-4530-899f-405a42f33302 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:27.755587 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1190d92-0c3e-4530-899f-405a42f33302 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:27.777269 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08601a2-2aa6-4682-a012-ce9e49554967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:27.778676 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08601a2-2aa6-4682-a012-ce9e49554967 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:27.778676 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08601a2-2aa6-4682-a012-ce9e49554967 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:27.781502 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08601a2-2aa6-4682-a012-ce9e49554967 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:27.783035 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08601a2-2aa6-4682-a012-ce9e49554967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:27.786944 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08601a2-2aa6-4682-a012-ce9e49554967 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:27.825116 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d07d46-9794-4455-b9b3-ce27b603b5b1 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:27.826509 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 818/1657] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:27 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:27.847080 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d07d46-9794-4455-b9b3-ce27b603b5b1 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:27.861429 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840876c-012a-49cd-b088-0b5cfe610921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:27.862511 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840876c-012a-49cd-b088-0b5cfe610921 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:27.862887 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840876c-012a-49cd-b088-0b5cfe610921 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:27.863173 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840876c-012a-49cd-b088-0b5cfe610921 admin admin] PATH_INFO: `/v3/projects/db4c1f91f5874a8f86ff9dec65c89726/users/87a38641f1364c9d8b89439caa66f14a/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:27.901865 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840876c-012a-49cd-b088-0b5cfe610921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db4c1f91f5874a8f86ff9dec65c89726, user_id=87a38641f1364c9d8b89439caa66f14a, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:27.910053 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840876c-012a-49cd-b088-0b5cfe610921 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:28.022900 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 840/1658] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:27 2021] PUT /identity/v3/projects/db4c1f91f5874a8f86ff9dec65c89726/users/87a38641f1364c9d8b89439caa66f14a/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:30:28.033563 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68226e39-3377-4056-a738-3cb8687415ec None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:28.034176 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68226e39-3377-4056-a738-3cb8687415ec None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:28.034747 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68226e39-3377-4056-a738-3cb8687415ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:28.118956 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-68226e39-3377-4056-a738-3cb8687415ec None None] MFA Rules not processed for user `87a38641f1364c9d8b89439caa66f14a`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:28.121902 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-68226e39-3377-4056-a738-3cb8687415ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:28.390450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 819/1659] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:28 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:28.395028 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840876c-012a-49cd-b088-0b5cfe610921 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:28.579335 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840876c-012a-49cd-b088-0b5cfe610921 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:28.600814 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead34972-2179-435d-b5f7-ef6a77e63654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:28.601917 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead34972-2179-435d-b5f7-ef6a77e63654 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:28.602543 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead34972-2179-435d-b5f7-ef6a77e63654 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:28.603036 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead34972-2179-435d-b5f7-ef6a77e63654 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:28.603957 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead34972-2179-435d-b5f7-ef6a77e63654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:28.606424 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead34972-2179-435d-b5f7-ef6a77e63654 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:28.805919 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68226e39-3377-4056-a738-3cb8687415ec None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:28.806456 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 841/1660] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:30:28 2021] POST /identity/v3/projects => generated 367 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:30:28.831005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68226e39-3377-4056-a738-3cb8687415ec None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:28.925025 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbb2b3-38a6-42ae-a2b3-26a5fd80d994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:28.926046 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbb2b3-38a6-42ae-a2b3-26a5fd80d994 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:28.926534 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbb2b3-38a6-42ae-a2b3-26a5fd80d994 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:28.927112 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbb2b3-38a6-42ae-a2b3-26a5fd80d994 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:28.928235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbb2b3-38a6-42ae-a2b3-26a5fd80d994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:28.930487 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbb2b3-38a6-42ae-a2b3-26a5fd80d994 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:28.971144 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7475ddd-a677-4656-a314-9ca46372cd62 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:28.971144 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7475ddd-a677-4656-a314-9ca46372cd62 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:28.971689 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7475ddd-a677-4656-a314-9ca46372cd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:29.028174 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-d7475ddd-a677-4656-a314-9ca46372cd62 None None] MFA Rules not processed for user `fa605019ca5c40d897cb30c990710ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:29.046634 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-d7475ddd-a677-4656-a314-9ca46372cd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:29.057613 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 820/1661] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:30:28 2021] POST /identity/v3/users => generated 290 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:29.060771 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbb2b3-38a6-42ae-a2b3-26a5fd80d994 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:29.074398 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbb2b3-38a6-42ae-a2b3-26a5fd80d994 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:29.084220 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef4398-df95-4bf1-8e55-72db20e0d060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:29.085404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef4398-df95-4bf1-8e55-72db20e0d060 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:29.085620 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef4398-df95-4bf1-8e55-72db20e0d060 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:29.085901 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef4398-df95-4bf1-8e55-72db20e0d060 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:29.086625 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef4398-df95-4bf1-8e55-72db20e0d060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:29.088735 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef4398-df95-4bf1-8e55-72db20e0d060 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:29.145067 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 821/1662] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:29 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:29.147667 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e9a0b-b9e3-464d-bbf4-126d2468171e None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:29.149588 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e9a0b-b9e3-464d-bbf4-126d2468171e None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:29.150019 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e9a0b-b9e3-464d-bbf4-126d2468171e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:29.203747 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-8c2e9a0b-b9e3-464d-bbf4-126d2468171e None None] MFA Rules not processed for user `2e2182e4d74047a399e7ffea63e7ce6e`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:29.205881 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8c2e9a0b-b9e3-464d-bbf4-126d2468171e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:29.211188 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 842/1663] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:28 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:29.212610 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7475ddd-a677-4656-a314-9ca46372cd62 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:29.246875 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7475ddd-a677-4656-a314-9ca46372cd62 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:29.263836 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08757597-4a6a-449b-8a7b-691a0d307c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:29.269235 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08757597-4a6a-449b-8a7b-691a0d307c95 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:29.269638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08757597-4a6a-449b-8a7b-691a0d307c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:29.270039 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08757597-4a6a-449b-8a7b-691a0d307c95 admin admin] PATH_INFO: `/v3/projects/5852ac2c0f564066be36957e6db7bc9d/users/d2bd487eda81432c9cb93e3dfb82b389/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:29.307156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08757597-4a6a-449b-8a7b-691a0d307c95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5852ac2c0f564066be36957e6db7bc9d, user_id=d2bd487eda81432c9cb93e3dfb82b389, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:29.316379 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08757597-4a6a-449b-8a7b-691a0d307c95 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:29.376535 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 822/1664] 10.222.0.24 () {58 vars in 1016 bytes} [Fri Aug 27 01:30:29 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:29.622103 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e9a0b-b9e3-464d-bbf4-126d2468171e None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:29.630262 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8c2e9a0b-b9e3-464d-bbf4-126d2468171e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:29.655126 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 843/1665] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:29 2021] PUT /identity/v3/projects/5852ac2c0f564066be36957e6db7bc9d/users/d2bd487eda81432c9cb93e3dfb82b389/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:29.852066 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08757597-4a6a-449b-8a7b-691a0d307c95 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:29.853253 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e9a0b-b9e3-464d-bbf4-126d2468171e None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:29.853253 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3eae07-048a-416e-bbb7-5a62d2a28396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:29.853253 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3eae07-048a-416e-bbb7-5a62d2a28396 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:29.853253 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3eae07-048a-416e-bbb7-5a62d2a28396 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:29.854208 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3eae07-048a-416e-bbb7-5a62d2a28396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:29.854475 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08757597-4a6a-449b-8a7b-691a0d307c95 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:29.854475 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26428d00-c897-44b8-a3dd-92a47d662874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:29.854475 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26428d00-c897-44b8-a3dd-92a47d662874 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:29.854475 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26428d00-c897-44b8-a3dd-92a47d662874 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:29.854882 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26428d00-c897-44b8-a3dd-92a47d662874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:29.855387 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3eae07-048a-416e-bbb7-5a62d2a28396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:29.855387 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3eae07-048a-416e-bbb7-5a62d2a28396 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:29.855594 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26428d00-c897-44b8-a3dd-92a47d662874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:29.855594 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26428d00-c897-44b8-a3dd-92a47d662874 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:29.855856 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 823/1666] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:29 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:29.856015 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 844/1667] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:29 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:29.860114 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3eae07-048a-416e-bbb7-5a62d2a28396 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:29.862375 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b4409-cb95-4ac1-9fe6-5e1e1f018b6a None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:29.862765 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b4409-cb95-4ac1-9fe6-5e1e1f018b6a None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:29.863141 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b4409-cb95-4ac1-9fe6-5e1e1f018b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:29.925688 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-595b4409-cb95-4ac1-9fe6-5e1e1f018b6a None None] MFA Rules not processed for user `5952a90abc5042f48c9caecd82a0c74a`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:29.927141 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-595b4409-cb95-4ac1-9fe6-5e1e1f018b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:30.062836 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3eae07-048a-416e-bbb7-5a62d2a28396 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:30.073069 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72346b3-aa69-4254-b962-234b7913bd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:30.076152 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72346b3-aa69-4254-b962-234b7913bd2b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:30.077650 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72346b3-aa69-4254-b962-234b7913bd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:30.078365 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72346b3-aa69-4254-b962-234b7913bd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:30.079510 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72346b3-aa69-4254-b962-234b7913bd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:30.081579 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72346b3-aa69-4254-b962-234b7913bd2b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:30.111957 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 824/1668] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:29 2021] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:30.114572 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689c898-6778-41e5-87b8-4a913cd31977 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:30.115590 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689c898-6778-41e5-87b8-4a913cd31977 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:30.117685 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 845/1669] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:29 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:30.119171 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b4409-cb95-4ac1-9fe6-5e1e1f018b6a None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:30.119707 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689c898-6778-41e5-87b8-4a913cd31977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:30.123243 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-595b4409-cb95-4ac1-9fe6-5e1e1f018b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:30.160029 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b4409-cb95-4ac1-9fe6-5e1e1f018b6a None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:30.161779 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-1689c898-6778-41e5-87b8-4a913cd31977 None None] MFA Rules not processed for user `9032bdd7ffde4d3f9b500974a4c17c67`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:30.163797 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1689c898-6778-41e5-87b8-4a913cd31977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:30.173442 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7391d5-9b2f-4b01-adb1-780c7c501bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:30.174424 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7391d5-9b2f-4b01-adb1-780c7c501bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:30.174816 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7391d5-9b2f-4b01-adb1-780c7c501bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:30.175190 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7391d5-9b2f-4b01-adb1-780c7c501bd9 admin admin] PATH_INFO: `/v3/projects/b443af47525a4bfebdbdbc64f2f53fd3` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:30.177237 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7391d5-9b2f-4b01-adb1-780c7c501bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b443af47525a4bfebdbdbc64f2f53fd3)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:30.181947 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7391d5-9b2f-4b01-adb1-780c7c501bd9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:30.282974 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 825/1670] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:30 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:30.282974 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689c898-6778-41e5-87b8-4a913cd31977 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:30.300220 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689c898-6778-41e5-87b8-4a913cd31977 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:30.308450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ea2e1-34d6-4423-bca3-b9fbcee76b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:30.310505 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ea2e1-34d6-4423-bca3-b9fbcee76b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:30.311491 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ea2e1-34d6-4423-bca3-b9fbcee76b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:30.312204 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ea2e1-34d6-4423-bca3-b9fbcee76b1e admin admin] PATH_INFO: `/v3/projects/5852ac2c0f564066be36957e6db7bc9d/users/d2bd487eda81432c9cb93e3dfb82b389/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:30.315371 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ea2e1-34d6-4423-bca3-b9fbcee76b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5852ac2c0f564066be36957e6db7bc9d, user_id=d2bd487eda81432c9cb93e3dfb82b389, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:30.320029 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ea2e1-34d6-4423-bca3-b9fbcee76b1e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:30.334616 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 826/1671] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:30 2021] PUT /identity/v3/projects/5852ac2c0f564066be36957e6db7bc9d/users/d2bd487eda81432c9cb93e3dfb82b389/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:30.336517 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4c978-e490-48e1-88f5-50b47efda48d None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:30.337054 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4c978-e490-48e1-88f5-50b47efda48d None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:30.337547 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4c978-e490-48e1-88f5-50b47efda48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:30.373772 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-cac4c978-e490-48e1-88f5-50b47efda48d None None] MFA Rules not processed for user `5952a90abc5042f48c9caecd82a0c74a`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:30.375794 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-cac4c978-e490-48e1-88f5-50b47efda48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:30.455044 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 827/1672] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:30 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:30.455044 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256e510-fb96-4248-bc66-037a4bec87b5 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:30.455044 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256e510-fb96-4248-bc66-037a4bec87b5 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:30.455044 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256e510-fb96-4248-bc66-037a4bec87b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:30.508150 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b256e510-fb96-4248-bc66-037a4bec87b5 None None] MFA Rules not processed for user `d2bd487eda81432c9cb93e3dfb82b389`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:30.512254 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b256e510-fb96-4248-bc66-037a4bec87b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:30.636479 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 828/1673] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:30 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:30.647041 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256e510-fb96-4248-bc66-037a4bec87b5 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:30.648986 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b256e510-fb96-4248-bc66-037a4bec87b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:30.725819 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256e510-fb96-4248-bc66-037a4bec87b5 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:30.730850 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952fd2d-649f-4664-84e2-b8bc4bb71d66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:30.731550 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952fd2d-649f-4664-84e2-b8bc4bb71d66 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:30.731972 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952fd2d-649f-4664-84e2-b8bc4bb71d66 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:30.732350 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952fd2d-649f-4664-84e2-b8bc4bb71d66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:30.744646 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952fd2d-649f-4664-84e2-b8bc4bb71d66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:30.747258 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952fd2d-649f-4664-84e2-b8bc4bb71d66 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:30.759200 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 829/1674] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:30 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:30:30.912343 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952fd2d-649f-4664-84e2-b8bc4bb71d66 service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:30.914349 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-7952fd2d-649f-4664-84e2-b8bc4bb71d66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:30.925708 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-df7391d5-9b2f-4b01-adb1-780c7c501bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b443af47525a4bfebdbdbc64f2f53fd3', 'request_id': 'req-df7391d5-9b2f-4b01-adb1-780c7c501bd9'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:30.940520 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-df7391d5-9b2f-4b01-adb1-780c7c501bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b443af47525a4bfebdbdbc64f2f53fd3', 'request_id': 'req-df7391d5-9b2f-4b01-adb1-780c7c501bd9'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:31.038323 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-df7391d5-9b2f-4b01-adb1-780c7c501bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b443af47525a4bfebdbdbc64f2f53fd3', 'request_id': 'req-df7391d5-9b2f-4b01-adb1-780c7c501bd9'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:31.058851 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-df7391d5-9b2f-4b01-adb1-780c7c501bd9 admin admin] The token cache is being invalidate because project b443af47525a4bfebdbdbc64f2f53fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:30:31.063349 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-df7391d5-9b2f-4b01-adb1-780c7c501bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:31.063349 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-df7391d5-9b2f-4b01-adb1-780c7c501bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:31.063349 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 846/1675] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:30:30 2021] DELETE /identity/v3/projects/b443af47525a4bfebdbdbc64f2f53fd3 => generated 0 bytes in 943 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:31.072074 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b451e-8d3d-417a-bc05-eee193124dc0 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:31.072347 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b451e-8d3d-417a-bc05-eee193124dc0 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:31.072761 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b451e-8d3d-417a-bc05-eee193124dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:31.130098 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-305b451e-8d3d-417a-bc05-eee193124dc0 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:31.134767 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-305b451e-8d3d-417a-bc05-eee193124dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:31.165574 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952fd2d-649f-4664-84e2-b8bc4bb71d66 service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:31.328124 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 847/1676] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:30:31.338279 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d203e7-c55b-4ad3-bbdc-ef8280e8d58b None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:31.338279 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d203e7-c55b-4ad3-bbdc-ef8280e8d58b None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:31.338611 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d203e7-c55b-4ad3-bbdc-ef8280e8d58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:31.422649 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-48d203e7-c55b-4ad3-bbdc-ef8280e8d58b None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:31.423460 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-48d203e7-c55b-4ad3-bbdc-ef8280e8d58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:31.433434 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb0410-187b-47e7-af33-2e6f34a3cb40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:31.434171 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb0410-187b-47e7-af33-2e6f34a3cb40 service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:31.434463 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb0410-187b-47e7-af33-2e6f34a3cb40 service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:31.434792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb0410-187b-47e7-af33-2e6f34a3cb40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:31.439487 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a7bb0410-187b-47e7-af33-2e6f34a3cb40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:31.474863 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 848/1677] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:31.476289 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d203e7-c55b-4ad3-bbdc-ef8280e8d58b None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:31.501482 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d203e7-c55b-4ad3-bbdc-ef8280e8d58b None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:31.536561 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64906bc5-48e2-4fbc-ad3c-b0dc472b0b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:31.536561 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64906bc5-48e2-4fbc-ad3c-b0dc472b0b2a admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:31.536561 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64906bc5-48e2-4fbc-ad3c-b0dc472b0b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:31.536561 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64906bc5-48e2-4fbc-ad3c-b0dc472b0b2a admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:31.536933 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64906bc5-48e2-4fbc-ad3c-b0dc472b0b2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:30:31.536933 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64906bc5-48e2-4fbc-ad3c-b0dc472b0b2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:31.537225 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64906bc5-48e2-4fbc-ad3c-b0dc472b0b2a admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:31.576634 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 849/1678] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:30:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:30:31.596745 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64906bc5-48e2-4fbc-ad3c-b0dc472b0b2a admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:31.606701 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64906bc5-48e2-4fbc-ad3c-b0dc472b0b2a admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:31.625351 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ac393-c723-4b38-9f34-0463519b1909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:31.626033 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ac393-c723-4b38-9f34-0463519b1909 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:31.626501 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ac393-c723-4b38-9f34-0463519b1909 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:31.626807 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ac393-c723-4b38-9f34-0463519b1909 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:31.627693 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ac393-c723-4b38-9f34-0463519b1909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:31.630481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ac393-c723-4b38-9f34-0463519b1909 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:31.634387 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb0410-187b-47e7-af33-2e6f34a3cb40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:31.636006 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb0410-187b-47e7-af33-2e6f34a3cb40 service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:31.669261 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 830/1679] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:30 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 758 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:31.812800 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 850/1680] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:30:31 2021] POST /identity/v3/projects => generated 373 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:31.816167 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb0410-187b-47e7-af33-2e6f34a3cb40 service nova] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:31.832202 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb0410-187b-47e7-af33-2e6f34a3cb40 service nova] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:32.010158 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112802e4-c190-4627-96b0-4a2ebdd21e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:32.010995 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112802e4-c190-4627-96b0-4a2ebdd21e92 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:32.012661 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112802e4-c190-4627-96b0-4a2ebdd21e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:32.013537 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112802e4-c190-4627-96b0-4a2ebdd21e92 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:32.015087 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112802e4-c190-4627-96b0-4a2ebdd21e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:32.019604 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112802e4-c190-4627-96b0-4a2ebdd21e92 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:32.187934 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 831/1681] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:30:31 2021] POST /identity/v3/users => generated 287 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:32.190978 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ac393-c723-4b38-9f34-0463519b1909 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:32.218736 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ac393-c723-4b38-9f34-0463519b1909 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:32.234444 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e438ba4-2912-47ef-9e5e-cc9efd606b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:32.235336 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e438ba4-2912-47ef-9e5e-cc9efd606b49 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:32.235720 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e438ba4-2912-47ef-9e5e-cc9efd606b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:32.236619 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e438ba4-2912-47ef-9e5e-cc9efd606b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:32.238810 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e438ba4-2912-47ef-9e5e-cc9efd606b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:32.241260 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e438ba4-2912-47ef-9e5e-cc9efd606b49 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:32.255625 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 851/1682] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:32 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:32.260592 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112802e4-c190-4627-96b0-4a2ebdd21e92 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:32.287431 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112802e4-c190-4627-96b0-4a2ebdd21e92 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:32.294126 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0451c-4833-4c66-a1c0-89ac70c4c020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:32.303401 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0451c-4833-4c66-a1c0-89ac70c4c020 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:32.304156 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0451c-4833-4c66-a1c0-89ac70c4c020 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:32.304785 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0451c-4833-4c66-a1c0-89ac70c4c020 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:32.306035 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0451c-4833-4c66-a1c0-89ac70c4c020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:32.308146 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0451c-4833-4c66-a1c0-89ac70c4c020 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:32.325495 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 832/1683] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:32 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:32.331152 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e438ba4-2912-47ef-9e5e-cc9efd606b49 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:32.346616 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e438ba4-2912-47ef-9e5e-cc9efd606b49 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:32.359609 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a95ae2-30bf-446e-8df5-d794792b08ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:32.360654 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a95ae2-30bf-446e-8df5-d794792b08ed admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:32.364496 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a95ae2-30bf-446e-8df5-d794792b08ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:32.364798 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a95ae2-30bf-446e-8df5-d794792b08ed admin admin] PATH_INFO: `/v3/projects/dec49ef3b9684d7fae88965d478e705a/users/be3935380e714596b15587da7428a556/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:32.391455 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a95ae2-30bf-446e-8df5-d794792b08ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec49ef3b9684d7fae88965d478e705a, user_id=be3935380e714596b15587da7428a556, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:32.399375 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a95ae2-30bf-446e-8df5-d794792b08ed admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:32.516480 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 852/1684] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:32 2021] PUT /identity/v3/projects/dec49ef3b9684d7fae88965d478e705a/users/be3935380e714596b15587da7428a556/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:32.526506 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032aa7db-4bbd-4318-8204-c69c778641dd None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:32.527040 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032aa7db-4bbd-4318-8204-c69c778641dd None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:32.527487 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032aa7db-4bbd-4318-8204-c69c778641dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:32.545323 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658025ae-4686-4132-b0d0-eddba0e274a7 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:32.545652 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658025ae-4686-4132-b0d0-eddba0e274a7 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:32.546081 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658025ae-4686-4132-b0d0-eddba0e274a7 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:32.548605 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 853/1685] 10.222.0.25 () {54 vars in 912 bytes} [Fri Aug 27 01:30:32 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:30:32.591180 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-032aa7db-4bbd-4318-8204-c69c778641dd None None] MFA Rules not processed for user `be3935380e714596b15587da7428a556`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:32.595121 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-032aa7db-4bbd-4318-8204-c69c778641dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:32.611112 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8a995-d427-4787-b628-caaba13bd933 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:32.611397 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8a995-d427-4787-b628-caaba13bd933 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:32.611878 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8a995-d427-4787-b628-caaba13bd933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:32.642560 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-6cf8a995-d427-4787-b628-caaba13bd933 None None] MFA Rules not processed for user `2e2182e4d74047a399e7ffea63e7ce6e`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:32.644197 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-6cf8a995-d427-4787-b628-caaba13bd933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:32.766749 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 833/1686] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:32 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:32.773938 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 854/1687] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 01:30:32 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:30:32.789999 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032aa7db-4bbd-4318-8204-c69c778641dd None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:32.791604 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-032aa7db-4bbd-4318-8204-c69c778641dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:32.832190 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8a995-d427-4787-b628-caaba13bd933 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:32.834986 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-6cf8a995-d427-4787-b628-caaba13bd933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:32.853578 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8a995-d427-4787-b628-caaba13bd933 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:32.865975 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6375d9-4cb5-4b91-af52-1a3dce221f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:32.877837 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6375d9-4cb5-4b91-af52-1a3dce221f40 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:32.877837 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6375d9-4cb5-4b91-af52-1a3dce221f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:32.877837 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6375d9-4cb5-4b91-af52-1a3dce221f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:32.887827 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6375d9-4cb5-4b91-af52-1a3dce221f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:32.891156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6375d9-4cb5-4b91-af52-1a3dce221f40 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:32.911820 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 855/1688] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:32 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:30:33.026866 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032aa7db-4bbd-4318-8204-c69c778641dd None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:33.032721 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c0554-ff08-472c-b1a0-f769c969b4ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:33.033652 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c0554-ff08-472c-b1a0-f769c969b4ce service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:33.033954 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c0554-ff08-472c-b1a0-f769c969b4ce service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:33.034281 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c0554-ff08-472c-b1a0-f769c969b4ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:33.044328 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c0554-ff08-472c-b1a0-f769c969b4ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:33.047340 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c0554-ff08-472c-b1a0-f769c969b4ce service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:33.079071 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 834/1689] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:32 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:30:33.105908 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6375d9-4cb5-4b91-af52-1a3dce221f40 service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:33.272315 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6375d9-4cb5-4b91-af52-1a3dce221f40 service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:33.290675 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97a9bb-b41c-4e98-ac59-e572756ca45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:33.292173 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97a9bb-b41c-4e98-ac59-e572756ca45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:33.292625 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97a9bb-b41c-4e98-ac59-e572756ca45f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:33.293113 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97a9bb-b41c-4e98-ac59-e572756ca45f admin admin] PATH_INFO: `/v3/users/be3935380e714596b15587da7428a556` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:33.296276 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97a9bb-b41c-4e98-ac59-e572756ca45f admin admin] RBAC: Authorizing `identity:delete_user(user_id=be3935380e714596b15587da7428a556)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:33.298541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97a9bb-b41c-4e98-ac59-e572756ca45f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:33.372918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abc66e-c19a-4474-afd3-8a22405460a1 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:33.380503 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abc66e-c19a-4474-afd3-8a22405460a1 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:33.380503 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abc66e-c19a-4474-afd3-8a22405460a1 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:33.380503 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 835/1690] 10.222.0.25 () {54 vars in 921 bytes} [Fri Aug 27 01:30:33 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:30:33.391735 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee9aef-2d56-4fee-a3db-2295a3b6066b None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:33.392465 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee9aef-2d56-4fee-a3db-2295a3b6066b None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:33.392928 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee9aef-2d56-4fee-a3db-2295a3b6066b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:33.437463 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-96ee9aef-2d56-4fee-a3db-2295a3b6066b None None] MFA Rules not processed for user `249a7642a0284dde91a7719f732b2d70`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:33.439018 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-96ee9aef-2d56-4fee-a3db-2295a3b6066b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:33.703583 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 836/1691] 10.222.0.25 () {58 vars in 1019 bytes} [Fri Aug 27 01:30:33 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:30:33.915690 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-bb97a9bb-b41c-4e98-ac59-e572756ca45f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be3935380e714596b15587da7428a556'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:33.986344 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-bb97a9bb-b41c-4e98-ac59-e572756ca45f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be3935380e714596b15587da7428a556'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:34.032449 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-bb97a9bb-b41c-4e98-ac59-e572756ca45f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be3935380e714596b15587da7428a556'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:34.036156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-bb97a9bb-b41c-4e98-ac59-e572756ca45f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be3935380e714596b15587da7428a556'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:34.200667 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-bb97a9bb-b41c-4e98-ac59-e572756ca45f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be3935380e714596b15587da7428a556'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:34.215895 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 856/1692] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:30:33 2021] DELETE /identity/v3/users/be3935380e714596b15587da7428a556 => generated 0 bytes in 1111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:34.221623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c46dd5-ca58-4739-ab97-252ef4a6bb53 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:34.222013 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c46dd5-ca58-4739-ab97-252ef4a6bb53 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:34.222416 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c46dd5-ca58-4739-ab97-252ef4a6bb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:34.282980 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-e7c46dd5-ca58-4739-ab97-252ef4a6bb53 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:34.294191 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e7c46dd5-ca58-4739-ab97-252ef4a6bb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:34.362915 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97a9bb-b41c-4e98-ac59-e572756ca45f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:34.364748 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-bb97a9bb-b41c-4e98-ac59-e572756ca45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:34.611736 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 837/1693] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:34.623063 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c46dd5-ca58-4739-ab97-252ef4a6bb53 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:34.623982 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e7c46dd5-ca58-4739-ab97-252ef4a6bb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:34.630737 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97a9bb-b41c-4e98-ac59-e572756ca45f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:34.648923 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0bc59-df29-4b5e-8344-bcf832295b28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:34.652218 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0bc59-df29-4b5e-8344-bcf832295b28 service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:34.652218 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0bc59-df29-4b5e-8344-bcf832295b28 service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:34.652218 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0bc59-df29-4b5e-8344-bcf832295b28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:34.653786 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-1ab0bc59-df29-4b5e-8344-bcf832295b28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:34.698767 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0bc59-df29-4b5e-8344-bcf832295b28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:34.705778 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0bc59-df29-4b5e-8344-bcf832295b28 service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:34.777122 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 857/1694] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:34 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:30:34.794168 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c46dd5-ca58-4739-ab97-252ef4a6bb53 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:34.798513 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2a156-36d1-49f2-b2c5-dd24ddaca4c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:34.799379 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2a156-36d1-49f2-b2c5-dd24ddaca4c6 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:34.799833 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2a156-36d1-49f2-b2c5-dd24ddaca4c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:34.800313 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2a156-36d1-49f2-b2c5-dd24ddaca4c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:34.802492 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced827e8-f861-40e9-af7f-35c14d30910c None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:34.803854 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced827e8-f861-40e9-af7f-35c14d30910c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:34.803854 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced827e8-f861-40e9-af7f-35c14d30910c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:34.825117 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2a156-36d1-49f2-b2c5-dd24ddaca4c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:34.828254 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2a156-36d1-49f2-b2c5-dd24ddaca4c6 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:34.847182 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 838/1695] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:34.874588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-ced827e8-f861-40e9-af7f-35c14d30910c None None] MFA Rules not processed for user `5952a90abc5042f48c9caecd82a0c74a`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:34.882048 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-ced827e8-f861-40e9-af7f-35c14d30910c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:35.115496 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 858/1696] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:34 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:35.153065 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2a156-36d1-49f2-b2c5-dd24ddaca4c6 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:35.156851 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-f9a2a156-36d1-49f2-b2c5-dd24ddaca4c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:35.396000 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2a156-36d1-49f2-b2c5-dd24ddaca4c6 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:35.407446 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45b84b-40dd-4f55-bef7-5673270d55a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:35.410269 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45b84b-40dd-4f55-bef7-5673270d55a9 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:35.414997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45b84b-40dd-4f55-bef7-5673270d55a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:35.414997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45b84b-40dd-4f55-bef7-5673270d55a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:35.414997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-df45b84b-40dd-4f55-bef7-5673270d55a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:35.679040 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45b84b-40dd-4f55-bef7-5673270d55a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:35.679040 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45b84b-40dd-4f55-bef7-5673270d55a9 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:35.679040 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 839/1697] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:35 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:36.628424 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced827e8-f861-40e9-af7f-35c14d30910c None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:36.630033 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-ced827e8-f861-40e9-af7f-35c14d30910c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:36.670579 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced827e8-f861-40e9-af7f-35c14d30910c None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:36.677863 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8c438-3950-43f0-b706-920a118db28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:36.679232 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8c438-3950-43f0-b706-920a118db28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:36.681611 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8c438-3950-43f0-b706-920a118db28b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:36.682377 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8c438-3950-43f0-b706-920a118db28b admin admin] PATH_INFO: `/v3/users/87a38641f1364c9d8b89439caa66f14a` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:36.684350 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8c438-3950-43f0-b706-920a118db28b admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a38641f1364c9d8b89439caa66f14a)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:36.687604 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8c438-3950-43f0-b706-920a118db28b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:37.267117 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45b84b-40dd-4f55-bef7-5673270d55a9 service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:37.267117 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-df45b84b-40dd-4f55-bef7-5673270d55a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:37.302698 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a5b8c438-3950-43f0-b706-920a118db28b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a38641f1364c9d8b89439caa66f14a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:37.312715 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45b84b-40dd-4f55-bef7-5673270d55a9 service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:37.335438 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844a522-c41c-490e-a5b3-0c0ab1e301ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:37.336542 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844a522-c41c-490e-a5b3-0c0ab1e301ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:37.343833 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844a522-c41c-490e-a5b3-0c0ab1e301ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:37.344314 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844a522-c41c-490e-a5b3-0c0ab1e301ee admin admin] PATH_INFO: `/v3/projects/dec49ef3b9684d7fae88965d478e705a` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:37.369544 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844a522-c41c-490e-a5b3-0c0ab1e301ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec49ef3b9684d7fae88965d478e705a)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:37.373269 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844a522-c41c-490e-a5b3-0c0ab1e301ee admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:37.376553 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a5b8c438-3950-43f0-b706-920a118db28b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a38641f1364c9d8b89439caa66f14a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:37.398464 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a5b8c438-3950-43f0-b706-920a118db28b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a38641f1364c9d8b89439caa66f14a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:37.400992 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a5b8c438-3950-43f0-b706-920a118db28b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a38641f1364c9d8b89439caa66f14a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:37.502261 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a5b8c438-3950-43f0-b706-920a118db28b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a38641f1364c9d8b89439caa66f14a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:37.512956 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 859/1698] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:30:36 2021] DELETE /identity/v3/users/87a38641f1364c9d8b89439caa66f14a => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:37.525566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f94bc-2e11-44b0-9cbe-ab5741b591c6 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:37.525566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f94bc-2e11-44b0-9cbe-ab5741b591c6 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:37.525566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f94bc-2e11-44b0-9cbe-ab5741b591c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:37.606186 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-ad9f94bc-2e11-44b0-9cbe-ab5741b591c6 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:37.608978 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-ad9f94bc-2e11-44b0-9cbe-ab5741b591c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:37.631944 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-1844a522-c41c-490e-a5b3-0c0ab1e301ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec49ef3b9684d7fae88965d478e705a', 'request_id': 'req-1844a522-c41c-490e-a5b3-0c0ab1e301ee'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:37.658277 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-1844a522-c41c-490e-a5b3-0c0ab1e301ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec49ef3b9684d7fae88965d478e705a', 'request_id': 'req-1844a522-c41c-490e-a5b3-0c0ab1e301ee'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:37.776430 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-1844a522-c41c-490e-a5b3-0c0ab1e301ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec49ef3b9684d7fae88965d478e705a', 'request_id': 'req-1844a522-c41c-490e-a5b3-0c0ab1e301ee'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:37.783991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 860/1699] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:37.843333 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-1844a522-c41c-490e-a5b3-0c0ab1e301ee admin admin] The token cache is being invalidate because project dec49ef3b9684d7fae88965d478e705a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:30:37.843333 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-1844a522-c41c-490e-a5b3-0c0ab1e301ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:37.843333 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-1844a522-c41c-490e-a5b3-0c0ab1e301ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:37.843333 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 840/1700] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:30:37 2021] DELETE /identity/v3/projects/dec49ef3b9684d7fae88965d478e705a => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:37.843945 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e93041-77d0-43f2-a5d1-daa4e23e555e None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:37.844548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e93041-77d0-43f2-a5d1-daa4e23e555e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:37.845003 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e93041-77d0-43f2-a5d1-daa4e23e555e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:37.876404 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-04e93041-77d0-43f2-a5d1-daa4e23e555e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:37.877909 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-04e93041-77d0-43f2-a5d1-daa4e23e555e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:37.881294 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844a522-c41c-490e-a5b3-0c0ab1e301ee admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:37.887631 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1844a522-c41c-490e-a5b3-0c0ab1e301ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:37.916081 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 861/1701] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:37.926901 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e53a9-45d8-4e87-a6c6-c2678cabcaee None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:37.927313 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e53a9-45d8-4e87-a6c6-c2678cabcaee None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:37.927692 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e53a9-45d8-4e87-a6c6-c2678cabcaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:37.975277 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-c86e53a9-45d8-4e87-a6c6-c2678cabcaee None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:37.980498 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c86e53a9-45d8-4e87-a6c6-c2678cabcaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:37.998876 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 862/1702] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:30:38.010107 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e53a9-45d8-4e87-a6c6-c2678cabcaee None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:38.034035 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e53a9-45d8-4e87-a6c6-c2678cabcaee None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:38.048816 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097fffa-7eae-451f-ba7f-88abde5b1113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:38.050638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097fffa-7eae-451f-ba7f-88abde5b1113 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:38.050929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097fffa-7eae-451f-ba7f-88abde5b1113 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:38.051207 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097fffa-7eae-451f-ba7f-88abde5b1113 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:38.052170 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097fffa-7eae-451f-ba7f-88abde5b1113 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:30:38.053239 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097fffa-7eae-451f-ba7f-88abde5b1113 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:38.054758 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097fffa-7eae-451f-ba7f-88abde5b1113 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:38.090874 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 863/1703] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:30:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:30:38.097677 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097fffa-7eae-451f-ba7f-88abde5b1113 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:38.125930 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844a522-c41c-490e-a5b3-0c0ab1e301ee admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:38.130353 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c08703-ee62-4dc8-9450-eb05c9b7909e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:38.130621 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c08703-ee62-4dc8-9450-eb05c9b7909e service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:38.138651 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097fffa-7eae-451f-ba7f-88abde5b1113 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:38.145125 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c08703-ee62-4dc8-9450-eb05c9b7909e service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:38.145125 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c08703-ee62-4dc8-9450-eb05c9b7909e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:38.152061 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-07c08703-ee62-4dc8-9450-eb05c9b7909e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:38.153075 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555aefb-d846-45bb-a6aa-d9383995ddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:38.154326 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555aefb-d846-45bb-a6aa-d9383995ddff admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:38.154823 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555aefb-d846-45bb-a6aa-d9383995ddff admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:38.169155 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c08703-ee62-4dc8-9450-eb05c9b7909e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:38.177918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c08703-ee62-4dc8-9450-eb05c9b7909e service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:38.178071 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555aefb-d846-45bb-a6aa-d9383995ddff admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:38.178071 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555aefb-d846-45bb-a6aa-d9383995ddff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:38.178071 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555aefb-d846-45bb-a6aa-d9383995ddff admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:38.214584 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 841/1704] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:38.355611 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 864/1705] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:30:38 2021] POST /identity/v3/projects => generated 375 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:38.356639 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c08703-ee62-4dc8-9450-eb05c9b7909e service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:38.372114 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c08703-ee62-4dc8-9450-eb05c9b7909e service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:38.544474 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d516e02-2e3d-40d8-9233-020a1d2118a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:38.546352 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d516e02-2e3d-40d8-9233-020a1d2118a8 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:38.547288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d516e02-2e3d-40d8-9233-020a1d2118a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:38.554134 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d516e02-2e3d-40d8-9233-020a1d2118a8 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:38.554134 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d516e02-2e3d-40d8-9233-020a1d2118a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:38.565871 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d516e02-2e3d-40d8-9233-020a1d2118a8 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:38.721820 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 842/1706] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:30:38 2021] POST /identity/v3/users => generated 288 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:38.723549 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555aefb-d846-45bb-a6aa-d9383995ddff admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:38.739440 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555aefb-d846-45bb-a6aa-d9383995ddff admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:38.779310 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00982dc1-d4ed-4aed-b658-542e439b8e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:38.783804 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00982dc1-d4ed-4aed-b658-542e439b8e08 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:38.785533 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00982dc1-d4ed-4aed-b658-542e439b8e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:38.785533 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00982dc1-d4ed-4aed-b658-542e439b8e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:38.789827 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00982dc1-d4ed-4aed-b658-542e439b8e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:38.795516 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00982dc1-d4ed-4aed-b658-542e439b8e08 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:38.846178 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d516e02-2e3d-40d8-9233-020a1d2118a8 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:38.857607 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 865/1707] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:38 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:38.861111 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d516e02-2e3d-40d8-9233-020a1d2118a8 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:38.875009 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d82839-cfc5-4f86-8d0f-9e4f4276c526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:38.875741 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d82839-cfc5-4f86-8d0f-9e4f4276c526 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:38.876291 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d82839-cfc5-4f86-8d0f-9e4f4276c526 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:38.876606 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d82839-cfc5-4f86-8d0f-9e4f4276c526 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:38.878073 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d82839-cfc5-4f86-8d0f-9e4f4276c526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:38.880266 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d82839-cfc5-4f86-8d0f-9e4f4276c526 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:38.895584 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 843/1708] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:38 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:38.899177 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00982dc1-d4ed-4aed-b658-542e439b8e08 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:38.915258 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00982dc1-d4ed-4aed-b658-542e439b8e08 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:38.942527 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0185e53-1554-400d-868a-66b982c9f229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:38.944721 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0185e53-1554-400d-868a-66b982c9f229 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:38.945540 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0185e53-1554-400d-868a-66b982c9f229 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:38.952155 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0185e53-1554-400d-868a-66b982c9f229 admin admin] PATH_INFO: `/v3/projects/24b46c1f21bf4fde857fe91b83375734/users/1676ad7e4a11410ca9e082f86cfed4a3/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:38.995189 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0185e53-1554-400d-868a-66b982c9f229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b46c1f21bf4fde857fe91b83375734, user_id=1676ad7e4a11410ca9e082f86cfed4a3, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:38.998899 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0185e53-1554-400d-868a-66b982c9f229 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:39.133717 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 866/1709] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:38 2021] PUT /identity/v3/projects/24b46c1f21bf4fde857fe91b83375734/users/1676ad7e4a11410ca9e082f86cfed4a3/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:39.153822 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca779f83-c8ec-44f7-9c17-715dd8ae7313 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:39.153822 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca779f83-c8ec-44f7-9c17-715dd8ae7313 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:39.153822 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca779f83-c8ec-44f7-9c17-715dd8ae7313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:39.209050 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-ca779f83-c8ec-44f7-9c17-715dd8ae7313 None None] MFA Rules not processed for user `1676ad7e4a11410ca9e082f86cfed4a3`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:39.211309 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ca779f83-c8ec-44f7-9c17-715dd8ae7313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:39.408719 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 844/1710] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:39 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:39.425692 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0185e53-1554-400d-868a-66b982c9f229 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:39.431209 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f0185e53-1554-400d-868a-66b982c9f229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:39.571264 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0185e53-1554-400d-868a-66b982c9f229 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:39.582881 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9617671-c46d-4f56-9f48-e18e063b24d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:39.583636 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9617671-c46d-4f56-9f48-e18e063b24d3 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:39.583929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9617671-c46d-4f56-9f48-e18e063b24d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:39.584204 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9617671-c46d-4f56-9f48-e18e063b24d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:39.611964 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9617671-c46d-4f56-9f48-e18e063b24d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:39.615126 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9617671-c46d-4f56-9f48-e18e063b24d3 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:39.653153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 867/1711] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:39 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:40.454649 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca779f83-c8ec-44f7-9c17-715dd8ae7313 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:40.458750 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ca779f83-c8ec-44f7-9c17-715dd8ae7313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:40.583585 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca779f83-c8ec-44f7-9c17-715dd8ae7313 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:40.589163 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b629124-d0fd-4c55-883c-68083abfe1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:40.612382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b629124-d0fd-4c55-883c-68083abfe1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:40.612382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b629124-d0fd-4c55-883c-68083abfe1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:40.612382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b629124-d0fd-4c55-883c-68083abfe1ec admin admin] PATH_INFO: `/v3/projects/db4c1f91f5874a8f86ff9dec65c89726` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:40.612382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b629124-d0fd-4c55-883c-68083abfe1ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=db4c1f91f5874a8f86ff9dec65c89726)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:40.612382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b629124-d0fd-4c55-883c-68083abfe1ec admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:40.923897 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-6b629124-d0fd-4c55-883c-68083abfe1ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db4c1f91f5874a8f86ff9dec65c89726', 'request_id': 'req-6b629124-d0fd-4c55-883c-68083abfe1ec'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:40.933953 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-6b629124-d0fd-4c55-883c-68083abfe1ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db4c1f91f5874a8f86ff9dec65c89726', 'request_id': 'req-6b629124-d0fd-4c55-883c-68083abfe1ec'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:41.038126 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-6b629124-d0fd-4c55-883c-68083abfe1ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db4c1f91f5874a8f86ff9dec65c89726', 'request_id': 'req-6b629124-d0fd-4c55-883c-68083abfe1ec'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:41.053564 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-6b629124-d0fd-4c55-883c-68083abfe1ec admin admin] The token cache is being invalidate because project db4c1f91f5874a8f86ff9dec65c89726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:30:41.053858 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-6b629124-d0fd-4c55-883c-68083abfe1ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:41.054645 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-6b629124-d0fd-4c55-883c-68083abfe1ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:41.056673 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 845/1712] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:30:40 2021] DELETE /identity/v3/projects/db4c1f91f5874a8f86ff9dec65c89726 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:41.060573 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9617671-c46d-4f56-9f48-e18e063b24d3 service cinder] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:41.079896 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9617671-c46d-4f56-9f48-e18e063b24d3 service cinder] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:41.168180 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33beb5a-61d6-4828-a113-caa9bf834547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:41.169230 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33beb5a-61d6-4828-a113-caa9bf834547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:41.169515 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33beb5a-61d6-4828-a113-caa9bf834547 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:41.169792 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33beb5a-61d6-4828-a113-caa9bf834547 admin admin] PATH_INFO: `/v3/users/d2bd487eda81432c9cb93e3dfb82b389` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:41.171169 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33beb5a-61d6-4828-a113-caa9bf834547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2bd487eda81432c9cb93e3dfb82b389)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:41.173148 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33beb5a-61d6-4828-a113-caa9bf834547 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:41.436260 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a33beb5a-61d6-4828-a113-caa9bf834547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2bd487eda81432c9cb93e3dfb82b389'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:41.451192 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a33beb5a-61d6-4828-a113-caa9bf834547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2bd487eda81432c9cb93e3dfb82b389'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:41.459449 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08f4d4-17c0-45cf-8f15-b9c7845a8738 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:41.461111 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a33beb5a-61d6-4828-a113-caa9bf834547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2bd487eda81432c9cb93e3dfb82b389'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:41.462271 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08f4d4-17c0-45cf-8f15-b9c7845a8738 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:41.462564 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08f4d4-17c0-45cf-8f15-b9c7845a8738 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:41.463384 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a33beb5a-61d6-4828-a113-caa9bf834547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2bd487eda81432c9cb93e3dfb82b389'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:41.466219 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 846/1713] 10.222.0.25 () {54 vars in 921 bytes} [Fri Aug 27 01:30:41 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:30:41.480671 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e134bc-7e4c-4cf9-b050-ab2b63705bb4 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:41.481053 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e134bc-7e4c-4cf9-b050-ab2b63705bb4 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:41.484574 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e134bc-7e4c-4cf9-b050-ab2b63705bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:41.545009 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a33beb5a-61d6-4828-a113-caa9bf834547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2bd487eda81432c9cb93e3dfb82b389'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:41.560450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-55e134bc-7e4c-4cf9-b050-ab2b63705bb4 None None] MFA Rules not processed for user `249a7642a0284dde91a7719f732b2d70`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:41.576931 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 868/1714] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:30:41 2021] DELETE /identity/v3/users/d2bd487eda81432c9cb93e3dfb82b389 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:41.577148 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-55e134bc-7e4c-4cf9-b050-ab2b63705bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:41.767033 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 847/1715] 10.222.0.25 () {58 vars in 1019 bytes} [Fri Aug 27 01:30:41 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:30:41.825906 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33beb5a-61d6-4828-a113-caa9bf834547 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:41.827872 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a33beb5a-61d6-4828-a113-caa9bf834547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:41.852572 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33beb5a-61d6-4828-a113-caa9bf834547 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:41.860686 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1328255-d42f-44a0-ab78-25a218c0ae4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:41.861725 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1328255-d42f-44a0-ab78-25a218c0ae4f service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:41.862220 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1328255-d42f-44a0-ab78-25a218c0ae4f service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:41.862788 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1328255-d42f-44a0-ab78-25a218c0ae4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:41.874796 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1328255-d42f-44a0-ab78-25a218c0ae4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:41.881377 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1328255-d42f-44a0-ab78-25a218c0ae4f service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:41.908574 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 869/1716] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:41 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:43.037074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e134bc-7e4c-4cf9-b050-ab2b63705bb4 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:43.039311 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-55e134bc-7e4c-4cf9-b050-ab2b63705bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:43.148911 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e134bc-7e4c-4cf9-b050-ab2b63705bb4 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:43.156445 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead1f3e-e76b-40b5-b97e-46a760475c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:43.159274 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead1f3e-e76b-40b5-b97e-46a760475c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:43.159718 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead1f3e-e76b-40b5-b97e-46a760475c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:43.160277 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead1f3e-e76b-40b5-b97e-46a760475c1e admin admin] PATH_INFO: `/v3/projects/5852ac2c0f564066be36957e6db7bc9d` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:43.161790 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead1f3e-e76b-40b5-b97e-46a760475c1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5852ac2c0f564066be36957e6db7bc9d)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:43.163933 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead1f3e-e76b-40b5-b97e-46a760475c1e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:43.317105 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cead1f3e-e76b-40b5-b97e-46a760475c1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5852ac2c0f564066be36957e6db7bc9d', 'request_id': 'req-cead1f3e-e76b-40b5-b97e-46a760475c1e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:43.328465 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cead1f3e-e76b-40b5-b97e-46a760475c1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5852ac2c0f564066be36957e6db7bc9d', 'request_id': 'req-cead1f3e-e76b-40b5-b97e-46a760475c1e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:43.395612 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cead1f3e-e76b-40b5-b97e-46a760475c1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5852ac2c0f564066be36957e6db7bc9d', 'request_id': 'req-cead1f3e-e76b-40b5-b97e-46a760475c1e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:43.425161 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cead1f3e-e76b-40b5-b97e-46a760475c1e admin admin] The token cache is being invalidate because project 5852ac2c0f564066be36957e6db7bc9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:30:43.425556 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cead1f3e-e76b-40b5-b97e-46a760475c1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:43.426489 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cead1f3e-e76b-40b5-b97e-46a760475c1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:43.428413 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 848/1717] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:30:43 2021] DELETE /identity/v3/projects/5852ac2c0f564066be36957e6db7bc9d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:43.434581 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e10de1-f277-4931-937d-ac68685d2646 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:43.435462 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e10de1-f277-4931-937d-ac68685d2646 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:43.436453 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e10de1-f277-4931-937d-ac68685d2646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:43.500053 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-25e10de1-f277-4931-937d-ac68685d2646 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:43.505423 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-25e10de1-f277-4931-937d-ac68685d2646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:43.512571 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead1f3e-e76b-40b5-b97e-46a760475c1e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:43.521141 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-cead1f3e-e76b-40b5-b97e-46a760475c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:43.633192 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead1f3e-e76b-40b5-b97e-46a760475c1e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:43.641110 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 870/1718] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:43.644903 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab3b7b-68f3-4179-acaa-0240ddd0eefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:43.644903 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab3b7b-68f3-4179-acaa-0240ddd0eefc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:43.644903 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab3b7b-68f3-4179-acaa-0240ddd0eefc admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:43.645310 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab3b7b-68f3-4179-acaa-0240ddd0eefc admin admin] PATH_INFO: `/v3/users/0bc89c24516c402699ef813d789c04bd` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:43.646925 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b006f1-3f74-40ba-b936-3fc4b4a4945c None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:43.647399 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b006f1-3f74-40ba-b936-3fc4b4a4945c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:43.647619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab3b7b-68f3-4179-acaa-0240ddd0eefc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bc89c24516c402699ef813d789c04bd)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:43.648038 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b006f1-3f74-40ba-b936-3fc4b4a4945c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:43.649764 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab3b7b-68f3-4179-acaa-0240ddd0eefc admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:43.680897 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-77b006f1-3f74-40ba-b936-3fc4b4a4945c None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:43.682758 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-77b006f1-3f74-40ba-b936-3fc4b4a4945c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:43.692817 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 871/1719] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:30:43.697228 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b006f1-3f74-40ba-b936-3fc4b4a4945c None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:43.707195 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b006f1-3f74-40ba-b936-3fc4b4a4945c None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:43.713046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e538cf5-b55b-4c99-8f93-cb14c8969ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:43.713841 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e538cf5-b55b-4c99-8f93-cb14c8969ddd admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:43.714243 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e538cf5-b55b-4c99-8f93-cb14c8969ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:43.714403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e538cf5-b55b-4c99-8f93-cb14c8969ddd admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:43.715116 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e538cf5-b55b-4c99-8f93-cb14c8969ddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:30:43.715421 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e538cf5-b55b-4c99-8f93-cb14c8969ddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:43.717303 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e538cf5-b55b-4c99-8f93-cb14c8969ddd admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:43.730181 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 872/1720] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:30:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:30:43.735326 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e538cf5-b55b-4c99-8f93-cb14c8969ddd admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:43.750602 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e538cf5-b55b-4c99-8f93-cb14c8969ddd admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:43.756783 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ad3b7-3785-45da-a50d-8d8f2b337de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:43.757509 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ad3b7-3785-45da-a50d-8d8f2b337de0 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:43.757795 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ad3b7-3785-45da-a50d-8d8f2b337de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:43.758073 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ad3b7-3785-45da-a50d-8d8f2b337de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:43.758835 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ad3b7-3785-45da-a50d-8d8f2b337de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:43.761106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ad3b7-3785-45da-a50d-8d8f2b337de0 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:43.869650 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d9ab3b7b-68f3-4179-acaa-0240ddd0eefc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bc89c24516c402699ef813d789c04bd'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:43.870346 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d9ab3b7b-68f3-4179-acaa-0240ddd0eefc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bc89c24516c402699ef813d789c04bd'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:43.887655 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d9ab3b7b-68f3-4179-acaa-0240ddd0eefc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bc89c24516c402699ef813d789c04bd'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:43.889789 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d9ab3b7b-68f3-4179-acaa-0240ddd0eefc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bc89c24516c402699ef813d789c04bd'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:43.896055 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 873/1721] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:30:43 2021] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:30:43.898957 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ad3b7-3785-45da-a50d-8d8f2b337de0 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:43.904225 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-ec5ad3b7-3785-45da-a50d-8d8f2b337de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:43.963128 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d9ab3b7b-68f3-4179-acaa-0240ddd0eefc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bc89c24516c402699ef813d789c04bd'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:44.017211 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 849/1722] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:30:43 2021] DELETE /identity/v3/users/0bc89c24516c402699ef813d789c04bd => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:44.020542 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ba4ba-bd8f-4557-ac15-e1f417178654 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:44.020858 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ba4ba-bd8f-4557-ac15-e1f417178654 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:44.021471 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ba4ba-bd8f-4557-ac15-e1f417178654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:44.031681 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ad3b7-3785-45da-a50d-8d8f2b337de0 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:44.053487 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-2d4ba4ba-bd8f-4557-ac15-e1f417178654 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:44.056475 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-2d4ba4ba-bd8f-4557-ac15-e1f417178654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:44.133367 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90513529-53ed-4964-ab84-8eb38811bf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:44.135425 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90513529-53ed-4964-ab84-8eb38811bf3b admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:44.135893 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90513529-53ed-4964-ab84-8eb38811bf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:44.136349 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90513529-53ed-4964-ab84-8eb38811bf3b admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:44.137503 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90513529-53ed-4964-ab84-8eb38811bf3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:44.142287 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90513529-53ed-4964-ab84-8eb38811bf3b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:44.149823 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 850/1723] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:44.164170 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ba4ba-bd8f-4557-ac15-e1f417178654 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:44.166405 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-2d4ba4ba-bd8f-4557-ac15-e1f417178654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:44.257972 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ba4ba-bd8f-4557-ac15-e1f417178654 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:44.263605 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 874/1724] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:30:43 2021] POST /identity/v3/users => generated 289 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:44.268145 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982af0d-9392-4765-8d8a-4d905e310931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:44.269049 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982af0d-9392-4765-8d8a-4d905e310931 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:44.269348 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982af0d-9392-4765-8d8a-4d905e310931 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:44.269628 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982af0d-9392-4765-8d8a-4d905e310931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:44.271385 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90513529-53ed-4964-ab84-8eb38811bf3b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:44.303345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90513529-53ed-4964-ab84-8eb38811bf3b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:44.309813 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fcdc1-b43b-49b5-ac22-4b5465b093ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:44.310569 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fcdc1-b43b-49b5-ac22-4b5465b093ee admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:44.310973 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fcdc1-b43b-49b5-ac22-4b5465b093ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:44.311248 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fcdc1-b43b-49b5-ac22-4b5465b093ee admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:44.311981 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fcdc1-b43b-49b5-ac22-4b5465b093ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:44.313926 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fcdc1-b43b-49b5-ac22-4b5465b093ee admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:44.317819 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982af0d-9392-4765-8d8a-4d905e310931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:44.320775 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982af0d-9392-4765-8d8a-4d905e310931 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:44.329465 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 875/1725] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:44 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:44.333392 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fcdc1-b43b-49b5-ac22-4b5465b093ee admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:44.343941 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 851/1726] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:30:44.345191 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fcdc1-b43b-49b5-ac22-4b5465b093ee admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:44.354223 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de5e07-9dbf-42aa-8ed2-ecd183048e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:44.354912 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de5e07-9dbf-42aa-8ed2-ecd183048e85 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:44.355268 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de5e07-9dbf-42aa-8ed2-ecd183048e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:44.355541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de5e07-9dbf-42aa-8ed2-ecd183048e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:44.356271 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de5e07-9dbf-42aa-8ed2-ecd183048e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:44.359209 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de5e07-9dbf-42aa-8ed2-ecd183048e85 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:44.375780 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 876/1727] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:44 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:30:44.377910 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982af0d-9392-4765-8d8a-4d905e310931 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:44.389934 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982af0d-9392-4765-8d8a-4d905e310931 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:44.397223 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf427ff-e10d-4f21-bb46-89cea9c72370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:44.398720 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf427ff-e10d-4f21-bb46-89cea9c72370 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:44.398919 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf427ff-e10d-4f21-bb46-89cea9c72370 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:44.399200 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf427ff-e10d-4f21-bb46-89cea9c72370 admin admin] PATH_INFO: `/v3/projects/48a9add50c3c476db8fe91c270721304/users/9848e8b45a7945dcad428982ea000297/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:44.440278 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf427ff-e10d-4f21-bb46-89cea9c72370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a9add50c3c476db8fe91c270721304, user_id=9848e8b45a7945dcad428982ea000297, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:44.444584 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf427ff-e10d-4f21-bb46-89cea9c72370 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:44.559353 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 852/1728] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:44 2021] PUT /identity/v3/projects/48a9add50c3c476db8fe91c270721304/users/9848e8b45a7945dcad428982ea000297/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:44.569797 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878379e-0b11-42fc-8d7c-8169d9272133 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:44.570276 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878379e-0b11-42fc-8d7c-8169d9272133 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:44.570276 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878379e-0b11-42fc-8d7c-8169d9272133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:44.609449 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-7878379e-0b11-42fc-8d7c-8169d9272133 None None] MFA Rules not processed for user `9848e8b45a7945dcad428982ea000297`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:44.610921 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-7878379e-0b11-42fc-8d7c-8169d9272133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:44.730318 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 877/1729] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:44 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:44.734926 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf427ff-e10d-4f21-bb46-89cea9c72370 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:44.811849 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf427ff-e10d-4f21-bb46-89cea9c72370 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:44.817752 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac700b14-6d39-439a-b542-5588aca4d74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:44.818429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac700b14-6d39-439a-b542-5588aca4d74c admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:44.818714 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac700b14-6d39-439a-b542-5588aca4d74c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:44.818993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac700b14-6d39-439a-b542-5588aca4d74c admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:44.819704 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac700b14-6d39-439a-b542-5588aca4d74c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:44.821897 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac700b14-6d39-439a-b542-5588aca4d74c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:44.864309 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878379e-0b11-42fc-8d7c-8169d9272133 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:44.866457 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-7878379e-0b11-42fc-8d7c-8169d9272133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:44.886113 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878379e-0b11-42fc-8d7c-8169d9272133 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:44.892748 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534efea6-5d56-4d7d-a128-bd427abe1705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:44.893793 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534efea6-5d56-4d7d-a128-bd427abe1705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:44.894078 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534efea6-5d56-4d7d-a128-bd427abe1705 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:44.894364 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534efea6-5d56-4d7d-a128-bd427abe1705 admin admin] PATH_INFO: `/v3/projects/f7b952fa10d34e14bc38aae68ac00f63` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:44.895800 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534efea6-5d56-4d7d-a128-bd427abe1705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7b952fa10d34e14bc38aae68ac00f63)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:44.897786 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534efea6-5d56-4d7d-a128-bd427abe1705 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:44.919390 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 853/1730] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:30:44 2021] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:44.924406 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac700b14-6d39-439a-b542-5588aca4d74c admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:44.992693 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac700b14-6d39-439a-b542-5588aca4d74c admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:44.998167 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f233e92-4d84-4136-adc0-e6095684b464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:44.999901 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f233e92-4d84-4136-adc0-e6095684b464 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:44.999901 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f233e92-4d84-4136-adc0-e6095684b464 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:44.999901 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f233e92-4d84-4136-adc0-e6095684b464 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:45.000292 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f233e92-4d84-4136-adc0-e6095684b464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:45.002252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f233e92-4d84-4136-adc0-e6095684b464 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:45.043393 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-534efea6-5d56-4d7d-a128-bd427abe1705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7b952fa10d34e14bc38aae68ac00f63', 'request_id': 'req-534efea6-5d56-4d7d-a128-bd427abe1705'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:45.052209 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-534efea6-5d56-4d7d-a128-bd427abe1705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7b952fa10d34e14bc38aae68ac00f63', 'request_id': 'req-534efea6-5d56-4d7d-a128-bd427abe1705'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:45.072205 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 854/1731] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:30:44 2021] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:30:45.077004 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f233e92-4d84-4136-adc0-e6095684b464 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:45.089125 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f233e92-4d84-4136-adc0-e6095684b464 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:45.112106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-534efea6-5d56-4d7d-a128-bd427abe1705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7b952fa10d34e14bc38aae68ac00f63', 'request_id': 'req-534efea6-5d56-4d7d-a128-bd427abe1705'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:45.143372 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-534efea6-5d56-4d7d-a128-bd427abe1705 admin admin] The token cache is being invalidate because project f7b952fa10d34e14bc38aae68ac00f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:30:45.143882 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-534efea6-5d56-4d7d-a128-bd427abe1705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:45.152668 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-534efea6-5d56-4d7d-a128-bd427abe1705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:45.152668 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 878/1732] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:30:44 2021] DELETE /identity/v3/projects/f7b952fa10d34e14bc38aae68ac00f63 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:45.162019 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534efea6-5d56-4d7d-a128-bd427abe1705 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:45.162019 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-534efea6-5d56-4d7d-a128-bd427abe1705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:45.205381 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4983f-6e52-4090-aa78-9a5e490b678d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:45.205381 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4983f-6e52-4090-aa78-9a5e490b678d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:45.205381 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4983f-6e52-4090-aa78-9a5e490b678d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:45.205381 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4983f-6e52-4090-aa78-9a5e490b678d admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:45.205989 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4983f-6e52-4090-aa78-9a5e490b678d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:45.207663 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4983f-6e52-4090-aa78-9a5e490b678d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:45.220929 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 855/1733] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:45 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:45.222884 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4983f-6e52-4090-aa78-9a5e490b678d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:45.225235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-25e4983f-6e52-4090-aa78-9a5e490b678d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:45.238893 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4983f-6e52-4090-aa78-9a5e490b678d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:45.241452 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534efea6-5d56-4d7d-a128-bd427abe1705 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:45.244940 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bb376-3434-4b67-b159-f646f5ddc2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:45.245867 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bb376-3434-4b67-b159-f646f5ddc2f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:45.246148 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bb376-3434-4b67-b159-f646f5ddc2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:45.246719 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bb376-3434-4b67-b159-f646f5ddc2f4 admin admin] PATH_INFO: `/v3/projects/051ace3c73274cfb88d2eb9d4deb625b/users/7c0ffecbf11148a6a42142c2e36b4923/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:45.247391 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f3239-4b24-4e55-9f48-d91ed1d9da07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:45.248436 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f3239-4b24-4e55-9f48-d91ed1d9da07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:45.252220 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f3239-4b24-4e55-9f48-d91ed1d9da07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:45.252220 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f3239-4b24-4e55-9f48-d91ed1d9da07 admin admin] PATH_INFO: `/v3/users/e818665556df43c79ccce6d8d362174a` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:45.252220 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f3239-4b24-4e55-9f48-d91ed1d9da07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e818665556df43c79ccce6d8d362174a)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:45.252444 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f3239-4b24-4e55-9f48-d91ed1d9da07 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:45.262587 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bb376-3434-4b67-b159-f646f5ddc2f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=051ace3c73274cfb88d2eb9d4deb625b, user_id=7c0ffecbf11148a6a42142c2e36b4923, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:45.266196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bb376-3434-4b67-b159-f646f5ddc2f4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:45.336942 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 856/1734] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:45 2021] PUT /identity/v3/projects/051ace3c73274cfb88d2eb9d4deb625b/users/7c0ffecbf11148a6a42142c2e36b4923/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:30:45.342257 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bb376-3434-4b67-b159-f646f5ddc2f4 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:45.447722 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bb376-3434-4b67-b159-f646f5ddc2f4 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:45.454620 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df889e-22d5-4a90-860a-6235c60d3819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:45.455316 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df889e-22d5-4a90-860a-6235c60d3819 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:45.455645 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df889e-22d5-4a90-860a-6235c60d3819 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:45.455871 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df889e-22d5-4a90-860a-6235c60d3819 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:45.456761 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df889e-22d5-4a90-860a-6235c60d3819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:45.458641 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df889e-22d5-4a90-860a-6235c60d3819 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:45.479979 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 857/1735] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:45 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:30:45.484811 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df889e-22d5-4a90-860a-6235c60d3819 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:45.490653 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a31f3239-4b24-4e55-9f48-d91ed1d9da07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e818665556df43c79ccce6d8d362174a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:45.504924 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df889e-22d5-4a90-860a-6235c60d3819 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:45.507675 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a31f3239-4b24-4e55-9f48-d91ed1d9da07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e818665556df43c79ccce6d8d362174a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:45.516279 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d17dbc-1ca9-469e-b709-a3bca0b3b45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:45.517273 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d17dbc-1ca9-469e-b709-a3bca0b3b45f admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:45.517602 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d17dbc-1ca9-469e-b709-a3bca0b3b45f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:45.517878 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d17dbc-1ca9-469e-b709-a3bca0b3b45f admin admin] PATH_INFO: `/v3/projects/051ace3c73274cfb88d2eb9d4deb625b/users/7c0ffecbf11148a6a42142c2e36b4923/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:45.519576 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a31f3239-4b24-4e55-9f48-d91ed1d9da07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e818665556df43c79ccce6d8d362174a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:45.521776 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d17dbc-1ca9-469e-b709-a3bca0b3b45f admin admin] RBAC: Authorizing `identity:create_grant(project_id=051ace3c73274cfb88d2eb9d4deb625b, user_id=7c0ffecbf11148a6a42142c2e36b4923, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:45.521888 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a31f3239-4b24-4e55-9f48-d91ed1d9da07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e818665556df43c79ccce6d8d362174a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:45.524809 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d17dbc-1ca9-469e-b709-a3bca0b3b45f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:45.535709 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 858/1736] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:45 2021] PUT /identity/v3/projects/051ace3c73274cfb88d2eb9d4deb625b/users/7c0ffecbf11148a6a42142c2e36b4923/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:30:45.546987 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe3e82-4165-468a-a313-2b3cc025bf69 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:45.551627 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe3e82-4165-468a-a313-2b3cc025bf69 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:45.551627 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe3e82-4165-468a-a313-2b3cc025bf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:45.574877 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-56fe3e82-4165-468a-a313-2b3cc025bf69 None None] MFA Rules not processed for user `7c0ffecbf11148a6a42142c2e36b4923`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:45.576076 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-56fe3e82-4165-468a-a313-2b3cc025bf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:45.597416 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a31f3239-4b24-4e55-9f48-d91ed1d9da07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e818665556df43c79ccce6d8d362174a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:45.603823 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 879/1737] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:30:45 2021] DELETE /identity/v3/users/e818665556df43c79ccce6d8d362174a => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:45.646599 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 859/1738] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:45 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:30:45.657737 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f3239-4b24-4e55-9f48-d91ed1d9da07 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:45.659117 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a31f3239-4b24-4e55-9f48-d91ed1d9da07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:45.720902 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f3239-4b24-4e55-9f48-d91ed1d9da07 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:45.725043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4554ccf-fafa-4a41-b95b-846f240d723d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:45.725767 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4554ccf-fafa-4a41-b95b-846f240d723d service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:45.726052 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4554ccf-fafa-4a41-b95b-846f240d723d service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:45.726338 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4554ccf-fafa-4a41-b95b-846f240d723d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:45.728255 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a4554ccf-fafa-4a41-b95b-846f240d723d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:45.792143 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4554ccf-fafa-4a41-b95b-846f240d723d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:45.793954 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4554ccf-fafa-4a41-b95b-846f240d723d service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:45.804398 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 880/1739] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:45 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:46.042979 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe3e82-4165-468a-a313-2b3cc025bf69 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:46.044672 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-56fe3e82-4165-468a-a313-2b3cc025bf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:46.123022 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe3e82-4165-468a-a313-2b3cc025bf69 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:46.196924 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd5790-480c-46b4-b31c-cc0cbf55c0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:46.197898 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd5790-480c-46b4-b31c-cc0cbf55c0e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:46.198239 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd5790-480c-46b4-b31c-cc0cbf55c0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:46.198716 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd5790-480c-46b4-b31c-cc0cbf55c0e0 admin admin] PATH_INFO: `/v3/projects/b16c2d4a190441cf8fd416830904fb8e` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:46.200031 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd5790-480c-46b4-b31c-cc0cbf55c0e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b16c2d4a190441cf8fd416830904fb8e)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:46.202623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd5790-480c-46b4-b31c-cc0cbf55c0e0 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:46.424578 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-aacd5790-480c-46b4-b31c-cc0cbf55c0e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b16c2d4a190441cf8fd416830904fb8e', 'request_id': 'req-aacd5790-480c-46b4-b31c-cc0cbf55c0e0'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:46.439937 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-aacd5790-480c-46b4-b31c-cc0cbf55c0e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b16c2d4a190441cf8fd416830904fb8e', 'request_id': 'req-aacd5790-480c-46b4-b31c-cc0cbf55c0e0'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:46.518643 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-aacd5790-480c-46b4-b31c-cc0cbf55c0e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b16c2d4a190441cf8fd416830904fb8e', 'request_id': 'req-aacd5790-480c-46b4-b31c-cc0cbf55c0e0'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:46.539484 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-aacd5790-480c-46b4-b31c-cc0cbf55c0e0 admin admin] The token cache is being invalidate because project b16c2d4a190441cf8fd416830904fb8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:30:46.541641 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-aacd5790-480c-46b4-b31c-cc0cbf55c0e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:46.544718 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-aacd5790-480c-46b4-b31c-cc0cbf55c0e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:30:46.556952 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 860/1740] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:30:46 2021] DELETE /identity/v3/projects/b16c2d4a190441cf8fd416830904fb8e => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:30:46.559059 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243d8f0-826e-47d5-b255-c3c9e1111a97 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:46.560075 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243d8f0-826e-47d5-b255-c3c9e1111a97 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:46.561059 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243d8f0-826e-47d5-b255-c3c9e1111a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:46.640377 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f243d8f0-826e-47d5-b255-c3c9e1111a97 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:46.640377 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f243d8f0-826e-47d5-b255-c3c9e1111a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:46.831721 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 881/1741] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:30:46.839399 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e666c3-bd7c-48a6-be24-dc85d6d876ed None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:46.840692 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e666c3-bd7c-48a6-be24-dc85d6d876ed None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:46.841126 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e666c3-bd7c-48a6-be24-dc85d6d876ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:46.866088 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-89e666c3-bd7c-48a6-be24-dc85d6d876ed None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:46.870056 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-89e666c3-bd7c-48a6-be24-dc85d6d876ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:46.885119 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 861/1742] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:46.890273 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243d8f0-826e-47d5-b255-c3c9e1111a97 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:46.933027 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243d8f0-826e-47d5-b255-c3c9e1111a97 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:46.953492 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181852f8-7b77-468a-a61e-e5ac254c69b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:46.954522 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181852f8-7b77-468a-a61e-e5ac254c69b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:46.954971 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181852f8-7b77-468a-a61e-e5ac254c69b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:46.956991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181852f8-7b77-468a-a61e-e5ac254c69b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:46.956991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181852f8-7b77-468a-a61e-e5ac254c69b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:30:46.956991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181852f8-7b77-468a-a61e-e5ac254c69b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:46.969907 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181852f8-7b77-468a-a61e-e5ac254c69b3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:47.004056 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 882/1743] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:30:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:30:47.009283 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e666c3-bd7c-48a6-be24-dc85d6d876ed None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:47.028539 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e666c3-bd7c-48a6-be24-dc85d6d876ed None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:47.040647 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349034f-21db-4a9d-8d96-eea6a120a050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:47.042201 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349034f-21db-4a9d-8d96-eea6a120a050 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:47.042498 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349034f-21db-4a9d-8d96-eea6a120a050 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:47.042775 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349034f-21db-4a9d-8d96-eea6a120a050 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:47.044574 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349034f-21db-4a9d-8d96-eea6a120a050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:47.048215 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349034f-21db-4a9d-8d96-eea6a120a050 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:47.160322 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 862/1744] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:30:47 2021] POST /identity/v3/projects => generated 369 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:30:47.162612 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181852f8-7b77-468a-a61e-e5ac254c69b3 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:47.185234 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181852f8-7b77-468a-a61e-e5ac254c69b3 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:47.337088 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fdc82-9cf1-49f1-9af1-c428ef1f09a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:47.337820 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fdc82-9cf1-49f1-9af1-c428ef1f09a1 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:47.338104 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fdc82-9cf1-49f1-9af1-c428ef1f09a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:47.343314 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fdc82-9cf1-49f1-9af1-c428ef1f09a1 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:47.343492 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fdc82-9cf1-49f1-9af1-c428ef1f09a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:47.350825 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fdc82-9cf1-49f1-9af1-c428ef1f09a1 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:47.508247 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 883/1745] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:30:47 2021] POST /identity/v3/users => generated 285 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:30:47.511870 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349034f-21db-4a9d-8d96-eea6a120a050 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:47.526865 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349034f-21db-4a9d-8d96-eea6a120a050 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:47.534495 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419dabc-ac5f-4178-9355-5992ad47c714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:47.535194 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419dabc-ac5f-4178-9355-5992ad47c714 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:47.538288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419dabc-ac5f-4178-9355-5992ad47c714 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:47.538288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419dabc-ac5f-4178-9355-5992ad47c714 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:47.538288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419dabc-ac5f-4178-9355-5992ad47c714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:47.538288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419dabc-ac5f-4178-9355-5992ad47c714 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:47.552606 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 863/1746] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:47 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:30:47.556673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fdc82-9cf1-49f1-9af1-c428ef1f09a1 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:47.575656 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fdc82-9cf1-49f1-9af1-c428ef1f09a1 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:47.583272 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640c702-fdfa-4b92-b18b-c61584457677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:47.590743 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640c702-fdfa-4b92-b18b-c61584457677 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:47.590743 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640c702-fdfa-4b92-b18b-c61584457677 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:47.590743 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640c702-fdfa-4b92-b18b-c61584457677 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:47.590743 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640c702-fdfa-4b92-b18b-c61584457677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:47.590743 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640c702-fdfa-4b92-b18b-c61584457677 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:47.600938 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 884/1747] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:30:47 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:30:47.604288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419dabc-ac5f-4178-9355-5992ad47c714 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:47.619365 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419dabc-ac5f-4178-9355-5992ad47c714 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:47.629726 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5240d-3488-4ca1-b644-aa3fe3b75793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:47.631607 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5240d-3488-4ca1-b644-aa3fe3b75793 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:47.632040 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5240d-3488-4ca1-b644-aa3fe3b75793 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:47.632516 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5240d-3488-4ca1-b644-aa3fe3b75793 admin admin] PATH_INFO: `/v3/projects/393174e781224805b2589d61f8d49ad4/users/514f92fc799f4156bb843ac6b073139d/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:47.668217 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5240d-3488-4ca1-b644-aa3fe3b75793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=393174e781224805b2589d61f8d49ad4, user_id=514f92fc799f4156bb843ac6b073139d, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:47.674238 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5240d-3488-4ca1-b644-aa3fe3b75793 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:47.808709 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 864/1748] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:30:47 2021] PUT /identity/v3/projects/393174e781224805b2589d61f8d49ad4/users/514f92fc799f4156bb843ac6b073139d/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:30:47.812194 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209607e-f157-4bb5-975f-96a336614cf7 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:47.812643 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209607e-f157-4bb5-975f-96a336614cf7 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:47.813188 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209607e-f157-4bb5-975f-96a336614cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:47.895039 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-e209607e-f157-4bb5-975f-96a336614cf7 None None] MFA Rules not processed for user `514f92fc799f4156bb843ac6b073139d`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:47.896551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-e209607e-f157-4bb5-975f-96a336614cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:48.004763 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 885/1749] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:30:47 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:48.025847 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5240d-3488-4ca1-b644-aa3fe3b75793 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:48.028446 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-99b5240d-3488-4ca1-b644-aa3fe3b75793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:48.134153 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5240d-3488-4ca1-b644-aa3fe3b75793 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:48.140912 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3a209-32cc-48e2-827b-964462209d3c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59679a5d71249fc8cd65fbcf84e7bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:48.141594 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3a209-32cc-48e2-827b-964462209d3c service glance] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:48.142138 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3a209-32cc-48e2-827b-964462209d3c service glance] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:48.142387 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3a209-32cc-48e2-827b-964462209d3c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:48.165376 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3a209-32cc-48e2-827b-964462209d3c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:48.166843 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3a209-32cc-48e2-827b-964462209d3c service glance] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:48.242051 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 865/1750] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:48 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:54.781805 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209607e-f157-4bb5-975f-96a336614cf7 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:54.783380 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-e209607e-f157-4bb5-975f-96a336614cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:54.857060 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209607e-f157-4bb5-975f-96a336614cf7 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:54.863652 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcf2e6-a9e4-47b5-99fc-148ed0f91cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:54.863652 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcf2e6-a9e4-47b5-99fc-148ed0f91cec service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:54.863652 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcf2e6-a9e4-47b5-99fc-148ed0f91cec service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:54.863652 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcf2e6-a9e4-47b5-99fc-148ed0f91cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:54.864604 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-08fcf2e6-a9e4-47b5-99fc-148ed0f91cec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:54.967251 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcf2e6-a9e4-47b5-99fc-148ed0f91cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:54.969366 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcf2e6-a9e4-47b5-99fc-148ed0f91cec service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:54.985363 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 886/1751] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:54 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:30:59.347682 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89483854-b5c4-440e-b2db-5de2d3568907 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:59.348235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89483854-b5c4-440e-b2db-5de2d3568907 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:59.348235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89483854-b5c4-440e-b2db-5de2d3568907 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:59.350258 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 866/1752] 10.222.0.25 () {54 vars in 921 bytes} [Fri Aug 27 01:30:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:30:59.356971 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3347215-d530-49b4-b467-93bdbe73e516 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:59.357428 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3347215-d530-49b4-b467-93bdbe73e516 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:59.357713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3347215-d530-49b4-b467-93bdbe73e516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:59.376391 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-d3347215-d530-49b4-b467-93bdbe73e516 None None] MFA Rules not processed for user `249a7642a0284dde91a7719f732b2d70`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:30:59.377680 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-d3347215-d530-49b4-b467-93bdbe73e516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:59.450631 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 887/1753] 10.222.0.25 () {58 vars in 1019 bytes} [Fri Aug 27 01:30:59 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:30:59.491741 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89483854-b5c4-440e-b2db-5de2d3568907 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:30:59.497240 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-89483854-b5c4-440e-b2db-5de2d3568907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:30:59.522199 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89483854-b5c4-440e-b2db-5de2d3568907 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:30:59.528360 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5ba41-7d76-41eb-b580-d50d49731a05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:30:59.529058 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5ba41-7d76-41eb-b580-d50d49731a05 service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:30:59.529413 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5ba41-7d76-41eb-b580-d50d49731a05 service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:30:59.529762 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5ba41-7d76-41eb-b580-d50d49731a05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:30:59.541850 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5ba41-7d76-41eb-b580-d50d49731a05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:30:59.543661 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5ba41-7d76-41eb-b580-d50d49731a05 service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:30:59.554196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 867/1754] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:30:59 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:31:18.926804 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3347215-d530-49b4-b467-93bdbe73e516 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:18.929583 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-d3347215-d530-49b4-b467-93bdbe73e516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:19.004265 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3347215-d530-49b4-b467-93bdbe73e516 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:19.009547 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af93187-d49a-47a1-a719-5e42cddf9bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:19.014673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af93187-d49a-47a1-a719-5e42cddf9bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:19.014673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af93187-d49a-47a1-a719-5e42cddf9bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:19.014673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af93187-d49a-47a1-a719-5e42cddf9bb5 admin admin] PATH_INFO: `/v3/users/1676ad7e4a11410ca9e082f86cfed4a3` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:19.014673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af93187-d49a-47a1-a719-5e42cddf9bb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1676ad7e4a11410ca9e082f86cfed4a3)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:19.015177 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af93187-d49a-47a1-a719-5e42cddf9bb5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:19.188892 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3af93187-d49a-47a1-a719-5e42cddf9bb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1676ad7e4a11410ca9e082f86cfed4a3'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:19.202553 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3af93187-d49a-47a1-a719-5e42cddf9bb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1676ad7e4a11410ca9e082f86cfed4a3'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:19.211371 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3af93187-d49a-47a1-a719-5e42cddf9bb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1676ad7e4a11410ca9e082f86cfed4a3'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:19.217612 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3af93187-d49a-47a1-a719-5e42cddf9bb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1676ad7e4a11410ca9e082f86cfed4a3'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:19.311066 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3af93187-d49a-47a1-a719-5e42cddf9bb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1676ad7e4a11410ca9e082f86cfed4a3'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:19.322822 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 888/1755] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:31:18 2021] DELETE /identity/v3/users/1676ad7e4a11410ca9e082f86cfed4a3 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:19.322980 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d18856-8949-4e4f-bc90-0368d5e03355 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:19.322980 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d18856-8949-4e4f-bc90-0368d5e03355 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:19.323546 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d18856-8949-4e4f-bc90-0368d5e03355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:19.341132 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-24d18856-8949-4e4f-bc90-0368d5e03355 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:19.343598 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-24d18856-8949-4e4f-bc90-0368d5e03355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:19.430456 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 868/1756] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:31:19.442593 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af93187-d49a-47a1-a719-5e42cddf9bb5 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:19.446730 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-3af93187-d49a-47a1-a719-5e42cddf9bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:19.503912 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af93187-d49a-47a1-a719-5e42cddf9bb5 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:19.507935 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41e2f2-41bf-4e7d-aa7e-8ef4cd5a6a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:19.508585 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41e2f2-41bf-4e7d-aa7e-8ef4cd5a6a21 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:19.508895 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41e2f2-41bf-4e7d-aa7e-8ef4cd5a6a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:19.512238 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41e2f2-41bf-4e7d-aa7e-8ef4cd5a6a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:19.518912 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41e2f2-41bf-4e7d-aa7e-8ef4cd5a6a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:19.520336 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41e2f2-41bf-4e7d-aa7e-8ef4cd5a6a21 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:19.530329 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 889/1757] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:31:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:31:20.009586 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d18856-8949-4e4f-bc90-0368d5e03355 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:20.011116 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-24d18856-8949-4e4f-bc90-0368d5e03355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:20.024567 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d18856-8949-4e4f-bc90-0368d5e03355 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:20.030508 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2fb6a-6d79-466e-ac5d-5fa0f5c06c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:20.031456 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2fb6a-6d79-466e-ac5d-5fa0f5c06c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:20.031829 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2fb6a-6d79-466e-ac5d-5fa0f5c06c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:20.032172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2fb6a-6d79-466e-ac5d-5fa0f5c06c20 admin admin] PATH_INFO: `/v3/projects/24b46c1f21bf4fde857fe91b83375734` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:20.033872 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2fb6a-6d79-466e-ac5d-5fa0f5c06c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b46c1f21bf4fde857fe91b83375734)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:20.036145 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2fb6a-6d79-466e-ac5d-5fa0f5c06c20 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:20.149464 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2fa2fb6a-6d79-466e-ac5d-5fa0f5c06c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b46c1f21bf4fde857fe91b83375734', 'request_id': 'req-2fa2fb6a-6d79-466e-ac5d-5fa0f5c06c20'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:20.156170 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2fa2fb6a-6d79-466e-ac5d-5fa0f5c06c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b46c1f21bf4fde857fe91b83375734', 'request_id': 'req-2fa2fb6a-6d79-466e-ac5d-5fa0f5c06c20'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:20.222872 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2fa2fb6a-6d79-466e-ac5d-5fa0f5c06c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b46c1f21bf4fde857fe91b83375734', 'request_id': 'req-2fa2fb6a-6d79-466e-ac5d-5fa0f5c06c20'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:20.233059 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2fa2fb6a-6d79-466e-ac5d-5fa0f5c06c20 admin admin] The token cache is being invalidate because project 24b46c1f21bf4fde857fe91b83375734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:31:20.233340 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2fa2fb6a-6d79-466e-ac5d-5fa0f5c06c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:20.233958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2fa2fb6a-6d79-466e-ac5d-5fa0f5c06c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:20.235700 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 869/1758] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:31:20 2021] DELETE /identity/v3/projects/24b46c1f21bf4fde857fe91b83375734 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:20.241708 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bc446-8100-4877-8c46-5d16a53bc01f None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:20.244669 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bc446-8100-4877-8c46-5d16a53bc01f None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:20.244669 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bc446-8100-4877-8c46-5d16a53bc01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:20.260819 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f23bc446-8100-4877-8c46-5d16a53bc01f None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:20.262043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f23bc446-8100-4877-8c46-5d16a53bc01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:20.318421 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 890/1759] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:20.327021 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2e835-56a2-49fe-b1ca-c26c97134586 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:20.327506 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2e835-56a2-49fe-b1ca-c26c97134586 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:20.327603 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2e835-56a2-49fe-b1ca-c26c97134586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:20.345339 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-5fa2e835-56a2-49fe-b1ca-c26c97134586 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:20.346525 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-5fa2e835-56a2-49fe-b1ca-c26c97134586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:20.354265 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 870/1760] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:20.358993 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23bc446-8100-4877-8c46-5d16a53bc01f None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:20.368204 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23bc446-8100-4877-8c46-5d16a53bc01f None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:20.372619 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6d7bb-1b6d-4d7f-9289-082e16a3c32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:20.374190 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6d7bb-1b6d-4d7f-9289-082e16a3c32d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:20.374463 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6d7bb-1b6d-4d7f-9289-082e16a3c32d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:20.374736 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6d7bb-1b6d-4d7f-9289-082e16a3c32d admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:20.375451 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6d7bb-1b6d-4d7f-9289-082e16a3c32d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:31:20.375753 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6d7bb-1b6d-4d7f-9289-082e16a3c32d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:20.377360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6d7bb-1b6d-4d7f-9289-082e16a3c32d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:20.388281 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 891/1761] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:31:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:31:20.392762 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2e835-56a2-49fe-b1ca-c26c97134586 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:20.401670 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2e835-56a2-49fe-b1ca-c26c97134586 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:20.406543 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeddee4-f7e2-468b-9e66-e7614ee450b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:20.407185 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeddee4-f7e2-468b-9e66-e7614ee450b3 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:20.407465 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeddee4-f7e2-468b-9e66-e7614ee450b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:20.407738 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeddee4-f7e2-468b-9e66-e7614ee450b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:20.408429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeddee4-f7e2-468b-9e66-e7614ee450b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:20.410313 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeddee4-f7e2-468b-9e66-e7614ee450b3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:20.551825 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 871/1762] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:31:20 2021] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:31:20.556330 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6d7bb-1b6d-4d7f-9289-082e16a3c32d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:20.567146 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6d7bb-1b6d-4d7f-9289-082e16a3c32d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:20.621602 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2402d7-8748-449d-9327-87a785eb5953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:20.622272 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2402d7-8748-449d-9327-87a785eb5953 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:20.622562 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2402d7-8748-449d-9327-87a785eb5953 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:20.622842 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2402d7-8748-449d-9327-87a785eb5953 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:20.624210 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2402d7-8748-449d-9327-87a785eb5953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:20.626171 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2402d7-8748-449d-9327-87a785eb5953 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:20.727211 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 892/1763] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:31:20 2021] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:31:20.731653 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeddee4-f7e2-468b-9e66-e7614ee450b3 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:20.743088 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeddee4-f7e2-468b-9e66-e7614ee450b3 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:20.747736 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311be91-5582-4040-a2be-4bb7b29867ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:20.748550 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311be91-5582-4040-a2be-4bb7b29867ae admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:20.748864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311be91-5582-4040-a2be-4bb7b29867ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:20.749154 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311be91-5582-4040-a2be-4bb7b29867ae admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:20.749898 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311be91-5582-4040-a2be-4bb7b29867ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:20.751477 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311be91-5582-4040-a2be-4bb7b29867ae admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:20.761420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 872/1764] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:20 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:31:20.765793 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2402d7-8748-449d-9327-87a785eb5953 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:20.775659 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2402d7-8748-449d-9327-87a785eb5953 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:20.781163 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95314e65-69c2-415e-8585-2e92626433ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:20.781822 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95314e65-69c2-415e-8585-2e92626433ae admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:20.782116 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95314e65-69c2-415e-8585-2e92626433ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:20.782388 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95314e65-69c2-415e-8585-2e92626433ae admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:20.783109 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95314e65-69c2-415e-8585-2e92626433ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:20.784701 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95314e65-69c2-415e-8585-2e92626433ae admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:20.795619 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 893/1765] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:20 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:31:20.804507 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311be91-5582-4040-a2be-4bb7b29867ae admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:20.814852 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311be91-5582-4040-a2be-4bb7b29867ae admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:20.820655 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394cc887-e19f-43d8-8dde-ec376580da51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:20.821856 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cc887-e19f-43d8-8dde-ec376580da51 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:20.822172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cc887-e19f-43d8-8dde-ec376580da51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:20.822456 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cc887-e19f-43d8-8dde-ec376580da51 admin admin] PATH_INFO: `/v3/projects/4adf2dcede334e7db85993ca0bbc79db/users/c2525438d4b141f6aa9300d5aad1c566/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:20.838089 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394cc887-e19f-43d8-8dde-ec376580da51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4adf2dcede334e7db85993ca0bbc79db, user_id=c2525438d4b141f6aa9300d5aad1c566, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:20.840741 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394cc887-e19f-43d8-8dde-ec376580da51 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:20.914900 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 873/1766] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:31:20 2021] PUT /identity/v3/projects/4adf2dcede334e7db85993ca0bbc79db/users/c2525438d4b141f6aa9300d5aad1c566/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:31:20.925720 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c7dc4-2f19-48f5-ad42-b6931bd58f01 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:20.926041 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c7dc4-2f19-48f5-ad42-b6931bd58f01 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:20.929949 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c7dc4-2f19-48f5-ad42-b6931bd58f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:20.953560 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-3a7c7dc4-2f19-48f5-ad42-b6931bd58f01 None None] MFA Rules not processed for user `c2525438d4b141f6aa9300d5aad1c566`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:20.954774 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-3a7c7dc4-2f19-48f5-ad42-b6931bd58f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:21.015521 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 894/1767] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:20 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:21.020088 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394cc887-e19f-43d8-8dde-ec376580da51 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:21.082401 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394cc887-e19f-43d8-8dde-ec376580da51 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:21.087404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9441c-2aee-46ff-95e0-587f7e924614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:21.088066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9441c-2aee-46ff-95e0-587f7e924614 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:21.088367 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9441c-2aee-46ff-95e0-587f7e924614 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:21.088603 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9441c-2aee-46ff-95e0-587f7e924614 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:21.089324 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9441c-2aee-46ff-95e0-587f7e924614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:21.091258 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9441c-2aee-46ff-95e0-587f7e924614 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:21.174385 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 874/1768] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:31:21 2021] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:31:21.178451 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c7dc4-2f19-48f5-ad42-b6931bd58f01 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:21.189318 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c7dc4-2f19-48f5-ad42-b6931bd58f01 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:21.243001 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87066aed-a116-4fe5-a90c-1024965fd3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:21.243671 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87066aed-a116-4fe5-a90c-1024965fd3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:21.243970 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87066aed-a116-4fe5-a90c-1024965fd3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:21.244252 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87066aed-a116-4fe5-a90c-1024965fd3a9 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:21.245103 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87066aed-a116-4fe5-a90c-1024965fd3a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:21.247014 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87066aed-a116-4fe5-a90c-1024965fd3a9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:21.304260 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 895/1769] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:31:21 2021] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:31:21.308496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9441c-2aee-46ff-95e0-587f7e924614 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:21.328345 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9441c-2aee-46ff-95e0-587f7e924614 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:21.328345 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c0a81-9270-4641-aaa3-71e734b6a711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:21.328345 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c0a81-9270-4641-aaa3-71e734b6a711 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:21.328345 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c0a81-9270-4641-aaa3-71e734b6a711 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:21.329160 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c0a81-9270-4641-aaa3-71e734b6a711 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:21.329160 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c0a81-9270-4641-aaa3-71e734b6a711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:21.329160 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c0a81-9270-4641-aaa3-71e734b6a711 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:21.337884 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 875/1770] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:31:21.341725 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87066aed-a116-4fe5-a90c-1024965fd3a9 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:21.351328 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87066aed-a116-4fe5-a90c-1024965fd3a9 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:21.355888 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2e7a0-f6b1-4e67-8883-86aea7e3d7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:21.356522 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2e7a0-f6b1-4e67-8883-86aea7e3d7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:21.356798 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2e7a0-f6b1-4e67-8883-86aea7e3d7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:21.357102 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2e7a0-f6b1-4e67-8883-86aea7e3d7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:21.358354 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2e7a0-f6b1-4e67-8883-86aea7e3d7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:21.359911 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2e7a0-f6b1-4e67-8883-86aea7e3d7c8 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:21.369478 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 896/1771] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:21 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:31:21.373923 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c0a81-9270-4641-aaa3-71e734b6a711 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:21.383619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c0a81-9270-4641-aaa3-71e734b6a711 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:21.388241 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8d2ed-10b9-4696-a377-99e8fa56264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:21.389181 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8d2ed-10b9-4696-a377-99e8fa56264a admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:21.389888 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8d2ed-10b9-4696-a377-99e8fa56264a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:21.389888 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8d2ed-10b9-4696-a377-99e8fa56264a admin admin] PATH_INFO: `/v3/projects/e8f8cf09cbc84ab797ed6ed91a6b4884/users/a61742a76d74444790e67aa0d0f345dd/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:21.403955 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8d2ed-10b9-4696-a377-99e8fa56264a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f8cf09cbc84ab797ed6ed91a6b4884, user_id=a61742a76d74444790e67aa0d0f345dd, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:21.406685 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8d2ed-10b9-4696-a377-99e8fa56264a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:21.480435 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 876/1772] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:31:21 2021] PUT /identity/v3/projects/e8f8cf09cbc84ab797ed6ed91a6b4884/users/a61742a76d74444790e67aa0d0f345dd/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:31:21.491498 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633a21c-a032-490b-9b24-24957299b427 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:21.491814 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633a21c-a032-490b-9b24-24957299b427 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:21.492094 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633a21c-a032-490b-9b24-24957299b427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:21.518334 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-5633a21c-a032-490b-9b24-24957299b427 None None] MFA Rules not processed for user `a61742a76d74444790e67aa0d0f345dd`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:21.519553 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-5633a21c-a032-490b-9b24-24957299b427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:21.579929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 897/1773] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:21 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:31:21.584516 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8d2ed-10b9-4696-a377-99e8fa56264a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:21.642789 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8d2ed-10b9-4696-a377-99e8fa56264a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:21.647419 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e772a-c203-4ee8-8750-c54bd577c6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:21.648064 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e772a-c203-4ee8-8750-c54bd577c6d6 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:21.648343 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e772a-c203-4ee8-8750-c54bd577c6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:21.648617 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e772a-c203-4ee8-8750-c54bd577c6d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:21.649345 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e772a-c203-4ee8-8750-c54bd577c6d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:21.651206 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e772a-c203-4ee8-8750-c54bd577c6d6 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:21.726241 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 877/1774] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:31:21 2021] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:31:21.730302 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633a21c-a032-490b-9b24-24957299b427 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:21.741142 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633a21c-a032-490b-9b24-24957299b427 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:21.796532 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ece143-c7f6-479f-9ef6-9ee32b24a937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:21.797233 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ece143-c7f6-479f-9ef6-9ee32b24a937 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:21.797520 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ece143-c7f6-479f-9ef6-9ee32b24a937 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:21.797797 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ece143-c7f6-479f-9ef6-9ee32b24a937 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:21.798481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ece143-c7f6-479f-9ef6-9ee32b24a937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:21.800454 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ece143-c7f6-479f-9ef6-9ee32b24a937 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:21.921666 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 898/1775] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:31:21 2021] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:31:21.927329 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e772a-c203-4ee8-8750-c54bd577c6d6 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:21.938306 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e772a-c203-4ee8-8750-c54bd577c6d6 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:21.942869 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a22771-7d15-4209-8e18-50c1fcbf3ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:21.943524 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a22771-7d15-4209-8e18-50c1fcbf3ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:21.943802 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a22771-7d15-4209-8e18-50c1fcbf3ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:21.944074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a22771-7d15-4209-8e18-50c1fcbf3ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:21.944783 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a22771-7d15-4209-8e18-50c1fcbf3ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:21.946378 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a22771-7d15-4209-8e18-50c1fcbf3ee4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:21.956491 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 878/1776] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:31:21.961961 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ece143-c7f6-479f-9ef6-9ee32b24a937 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:21.971987 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ece143-c7f6-479f-9ef6-9ee32b24a937 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:21.976800 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07165284-a173-4ade-95de-ca1837d6dd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:21.977732 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07165284-a173-4ade-95de-ca1837d6dd46 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:21.978015 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07165284-a173-4ade-95de-ca1837d6dd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:21.978288 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07165284-a173-4ade-95de-ca1837d6dd46 admin admin] PATH_INFO: `/v3/projects/6fdc32314cea43cfaf91bab82e02bf8a/users/6ddaa9260f3e48eb9d4f767fabe4564e/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:21.993443 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07165284-a173-4ade-95de-ca1837d6dd46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fdc32314cea43cfaf91bab82e02bf8a, user_id=6ddaa9260f3e48eb9d4f767fabe4564e, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:21.996232 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07165284-a173-4ade-95de-ca1837d6dd46 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:22.069940 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 899/1777] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:31:21 2021] PUT /identity/v3/projects/6fdc32314cea43cfaf91bab82e02bf8a/users/6ddaa9260f3e48eb9d4f767fabe4564e/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:22.073846 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a22771-7d15-4209-8e18-50c1fcbf3ee4 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:22.083954 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a22771-7d15-4209-8e18-50c1fcbf3ee4 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:22.138911 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa368c-314f-4e15-a095-ad4dc1a0f9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:22.139583 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa368c-314f-4e15-a095-ad4dc1a0f9ba admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:22.139881 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa368c-314f-4e15-a095-ad4dc1a0f9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:22.140144 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa368c-314f-4e15-a095-ad4dc1a0f9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:22.140932 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa368c-314f-4e15-a095-ad4dc1a0f9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:22.142510 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa368c-314f-4e15-a095-ad4dc1a0f9ba admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:22.152354 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 879/1778] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:22 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:31:22.157628 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07165284-a173-4ade-95de-ca1837d6dd46 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:22.167969 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07165284-a173-4ade-95de-ca1837d6dd46 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:22.173205 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b15f55-3398-4193-ade7-0d1e2dc1ccca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:22.174080 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b15f55-3398-4193-ade7-0d1e2dc1ccca admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:22.174366 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b15f55-3398-4193-ade7-0d1e2dc1ccca admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:22.174643 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b15f55-3398-4193-ade7-0d1e2dc1ccca admin admin] PATH_INFO: `/v3/projects/6fdc32314cea43cfaf91bab82e02bf8a/users/6ddaa9260f3e48eb9d4f767fabe4564e/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:22.176583 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b15f55-3398-4193-ade7-0d1e2dc1ccca admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fdc32314cea43cfaf91bab82e02bf8a, user_id=6ddaa9260f3e48eb9d4f767fabe4564e, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:22.179225 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b15f55-3398-4193-ade7-0d1e2dc1ccca admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:22.190531 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 900/1779] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:31:22 2021] PUT /identity/v3/projects/6fdc32314cea43cfaf91bab82e02bf8a/users/6ddaa9260f3e48eb9d4f767fabe4564e/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:22.201907 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ab98b-a01c-491e-b2c0-1140baa13666 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:22.202206 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ab98b-a01c-491e-b2c0-1140baa13666 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:22.202491 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ab98b-a01c-491e-b2c0-1140baa13666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:22.228599 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-6c0ab98b-a01c-491e-b2c0-1140baa13666 None None] MFA Rules not processed for user `6ddaa9260f3e48eb9d4f767fabe4564e`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:22.229864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-6c0ab98b-a01c-491e-b2c0-1140baa13666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:22.294809 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 880/1780] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:22 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:22.305935 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b15f55-3398-4193-ade7-0d1e2dc1ccca admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:22.307618 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a9b15f55-3398-4193-ade7-0d1e2dc1ccca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:22.362348 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b15f55-3398-4193-ade7-0d1e2dc1ccca admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:22.365935 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47de543-0596-42bc-b6bc-368c10d001b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:22.366573 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47de543-0596-42bc-b6bc-368c10d001b8 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:22.366856 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47de543-0596-42bc-b6bc-368c10d001b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:22.367134 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47de543-0596-42bc-b6bc-368c10d001b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:22.420349 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47de543-0596-42bc-b6bc-368c10d001b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:22.421774 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47de543-0596-42bc-b6bc-368c10d001b8 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:22.430719 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 901/1781] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:31:22 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:31:29.765788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ab98b-a01c-491e-b2c0-1140baa13666 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:29.775114 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ab98b-a01c-491e-b2c0-1140baa13666 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:29.778906 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fba81-baad-4f8c-98bc-e0fdc4507622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:29.779551 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fba81-baad-4f8c-98bc-e0fdc4507622 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:29.779858 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fba81-baad-4f8c-98bc-e0fdc4507622 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:29.780129 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fba81-baad-4f8c-98bc-e0fdc4507622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:29.836246 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fba81-baad-4f8c-98bc-e0fdc4507622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:29.837743 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fba81-baad-4f8c-98bc-e0fdc4507622 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:29.847019 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 881/1782] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:31:29 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:31:31.454361 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47de543-0596-42bc-b6bc-368c10d001b8 service cinder] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:31.462631 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47de543-0596-42bc-b6bc-368c10d001b8 service cinder] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:31.466590 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ff8fb-cb88-4650-bde2-ac8f684127cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:31.467236 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ff8fb-cb88-4650-bde2-ac8f684127cb service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:31.467543 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ff8fb-cb88-4650-bde2-ac8f684127cb service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:31.467823 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ff8fb-cb88-4650-bde2-ac8f684127cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:31.477336 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ff8fb-cb88-4650-bde2-ac8f684127cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:31.478772 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ff8fb-cb88-4650-bde2-ac8f684127cb service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:31.488153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 902/1783] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:31:31 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:31:34.738250 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fba81-baad-4f8c-98bc-e0fdc4507622 service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:34.739831 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-5c6fba81-baad-4f8c-98bc-e0fdc4507622 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:34.809391 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fba81-baad-4f8c-98bc-e0fdc4507622 service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:34.814869 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac05124-e570-408d-982c-53e4ba89dcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:34.815725 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac05124-e570-408d-982c-53e4ba89dcbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:34.816003 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac05124-e570-408d-982c-53e4ba89dcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:34.816273 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac05124-e570-408d-982c-53e4ba89dcbe admin admin] PATH_INFO: `/v3/users/9848e8b45a7945dcad428982ea000297` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:34.817525 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac05124-e570-408d-982c-53e4ba89dcbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=9848e8b45a7945dcad428982ea000297)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:34.819407 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac05124-e570-408d-982c-53e4ba89dcbe admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:34.958449 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-fac05124-e570-408d-982c-53e4ba89dcbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9848e8b45a7945dcad428982ea000297'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:34.959112 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-fac05124-e570-408d-982c-53e4ba89dcbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9848e8b45a7945dcad428982ea000297'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:34.966462 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-fac05124-e570-408d-982c-53e4ba89dcbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9848e8b45a7945dcad428982ea000297'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:34.967139 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-fac05124-e570-408d-982c-53e4ba89dcbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9848e8b45a7945dcad428982ea000297'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:35.028777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-fac05124-e570-408d-982c-53e4ba89dcbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9848e8b45a7945dcad428982ea000297'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:35.048328 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 882/1784] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:31:34 2021] DELETE /identity/v3/users/9848e8b45a7945dcad428982ea000297 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:31:35.052746 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4798f-f375-4578-b88b-0b25a3976004 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:35.053289 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4798f-f375-4578-b88b-0b25a3976004 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:35.053378 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4798f-f375-4578-b88b-0b25a3976004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:35.071255 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-c0b4798f-f375-4578-b88b-0b25a3976004 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:35.072455 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c0b4798f-f375-4578-b88b-0b25a3976004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:35.129000 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 903/1785] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:35.138666 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac05124-e570-408d-982c-53e4ba89dcbe admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:35.140108 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-fac05124-e570-408d-982c-53e4ba89dcbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:35.198404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac05124-e570-408d-982c-53e4ba89dcbe admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:35.203780 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d4842-181a-4836-820d-345db2abcc7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:35.204431 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d4842-181a-4836-820d-345db2abcc7f service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:35.204716 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d4842-181a-4836-820d-345db2abcc7f service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:35.205001 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d4842-181a-4836-820d-345db2abcc7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:35.214281 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d4842-181a-4836-820d-345db2abcc7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:35.215703 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d4842-181a-4836-820d-345db2abcc7f service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:35.235390 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 883/1786] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:31:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:31:35.681839 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4798f-f375-4578-b88b-0b25a3976004 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:35.683468 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c0b4798f-f375-4578-b88b-0b25a3976004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:35.700871 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4798f-f375-4578-b88b-0b25a3976004 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:35.706172 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b69abe-9dc1-4efd-ba71-71b01d886c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:35.707394 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b69abe-9dc1-4efd-ba71-71b01d886c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:35.707686 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b69abe-9dc1-4efd-ba71-71b01d886c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:35.708007 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b69abe-9dc1-4efd-ba71-71b01d886c21 admin admin] PATH_INFO: `/v3/projects/48a9add50c3c476db8fe91c270721304` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:35.709348 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b69abe-9dc1-4efd-ba71-71b01d886c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a9add50c3c476db8fe91c270721304)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:35.711651 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b69abe-9dc1-4efd-ba71-71b01d886c21 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:35.858935 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-60b69abe-9dc1-4efd-ba71-71b01d886c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a9add50c3c476db8fe91c270721304', 'request_id': 'req-60b69abe-9dc1-4efd-ba71-71b01d886c21'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:35.864915 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-60b69abe-9dc1-4efd-ba71-71b01d886c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a9add50c3c476db8fe91c270721304', 'request_id': 'req-60b69abe-9dc1-4efd-ba71-71b01d886c21'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:35.938755 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-60b69abe-9dc1-4efd-ba71-71b01d886c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a9add50c3c476db8fe91c270721304', 'request_id': 'req-60b69abe-9dc1-4efd-ba71-71b01d886c21'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:35.949654 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-60b69abe-9dc1-4efd-ba71-71b01d886c21 admin admin] The token cache is being invalidate because project 48a9add50c3c476db8fe91c270721304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:31:35.949937 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-60b69abe-9dc1-4efd-ba71-71b01d886c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:35.950612 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-60b69abe-9dc1-4efd-ba71-71b01d886c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:35.952165 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 904/1787] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:31:35 2021] DELETE /identity/v3/projects/48a9add50c3c476db8fe91c270721304 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:35.956146 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d4842-181a-4836-820d-345db2abcc7f service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:35.965643 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d4842-181a-4836-820d-345db2abcc7f service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:36.021457 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e74cf-82e2-4495-a1ee-a5cc71be17a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:36.022362 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e74cf-82e2-4495-a1ee-a5cc71be17a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:36.022643 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e74cf-82e2-4495-a1ee-a5cc71be17a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:36.022921 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e74cf-82e2-4495-a1ee-a5cc71be17a7 admin admin] PATH_INFO: `/v3/users/7c0ffecbf11148a6a42142c2e36b4923` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:36.024095 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e74cf-82e2-4495-a1ee-a5cc71be17a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c0ffecbf11148a6a42142c2e36b4923)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:36.026062 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e74cf-82e2-4495-a1ee-a5cc71be17a7 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:36.241889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-362e74cf-82e2-4495-a1ee-a5cc71be17a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c0ffecbf11148a6a42142c2e36b4923'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:36.242625 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-362e74cf-82e2-4495-a1ee-a5cc71be17a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c0ffecbf11148a6a42142c2e36b4923'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:36.249460 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-362e74cf-82e2-4495-a1ee-a5cc71be17a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c0ffecbf11148a6a42142c2e36b4923'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:36.250124 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-362e74cf-82e2-4495-a1ee-a5cc71be17a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c0ffecbf11148a6a42142c2e36b4923'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:36.301112 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b69abe-9dc1-4efd-ba71-71b01d886c21 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:36.303239 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-60b69abe-9dc1-4efd-ba71-71b01d886c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:36.314485 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-362e74cf-82e2-4495-a1ee-a5cc71be17a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c0ffecbf11148a6a42142c2e36b4923'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:36.318546 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b69abe-9dc1-4efd-ba71-71b01d886c21 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:36.330103 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c4464-f1d5-4ab5-9f78-3bf28c196f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:36.330103 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c4464-f1d5-4ab5-9f78-3bf28c196f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:36.330103 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c4464-f1d5-4ab5-9f78-3bf28c196f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:36.330103 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c4464-f1d5-4ab5-9f78-3bf28c196f20 admin admin] PATH_INFO: `/v3/users/c2525438d4b141f6aa9300d5aad1c566` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:36.330977 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c4464-f1d5-4ab5-9f78-3bf28c196f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2525438d4b141f6aa9300d5aad1c566)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:36.330977 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c4464-f1d5-4ab5-9f78-3bf28c196f20 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:36.334915 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 884/1788] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:31:35 2021] DELETE /identity/v3/users/7c0ffecbf11148a6a42142c2e36b4923 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:31:36.598549 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3d8c4464-f1d5-4ab5-9f78-3bf28c196f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2525438d4b141f6aa9300d5aad1c566'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:36.611946 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3d8c4464-f1d5-4ab5-9f78-3bf28c196f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2525438d4b141f6aa9300d5aad1c566'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:36.620255 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3d8c4464-f1d5-4ab5-9f78-3bf28c196f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2525438d4b141f6aa9300d5aad1c566'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:36.621147 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3d8c4464-f1d5-4ab5-9f78-3bf28c196f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2525438d4b141f6aa9300d5aad1c566'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:36.692847 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3d8c4464-f1d5-4ab5-9f78-3bf28c196f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2525438d4b141f6aa9300d5aad1c566'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:36.699071 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 905/1789] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:31:36 2021] DELETE /identity/v3/users/c2525438d4b141f6aa9300d5aad1c566 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:36.704923 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cde26f-5609-46b3-b19d-c6c07604cd7a None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:36.705238 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cde26f-5609-46b3-b19d-c6c07604cd7a None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:36.705518 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cde26f-5609-46b3-b19d-c6c07604cd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:36.721909 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-a7cde26f-5609-46b3-b19d-c6c07604cd7a None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:36.726413 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a7cde26f-5609-46b3-b19d-c6c07604cd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:36.752339 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c4464-f1d5-4ab5-9f78-3bf28c196f20 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:36.754061 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-3d8c4464-f1d5-4ab5-9f78-3bf28c196f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:36.785340 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 885/1790] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:31:36.797468 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cde26f-5609-46b3-b19d-c6c07604cd7a None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:36.799094 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a7cde26f-5609-46b3-b19d-c6c07604cd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:36.836345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c4464-f1d5-4ab5-9f78-3bf28c196f20 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:36.841236 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e9aca-8490-4a51-8faa-4ec3a0f9e7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:36.842093 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e9aca-8490-4a51-8faa-4ec3a0f9e7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:36.842367 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e9aca-8490-4a51-8faa-4ec3a0f9e7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:36.842640 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e9aca-8490-4a51-8faa-4ec3a0f9e7e7 admin admin] PATH_INFO: `/v3/projects/051ace3c73274cfb88d2eb9d4deb625b` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:36.844244 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e9aca-8490-4a51-8faa-4ec3a0f9e7e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=051ace3c73274cfb88d2eb9d4deb625b)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:36.846266 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e9aca-8490-4a51-8faa-4ec3a0f9e7e7 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:36.855938 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cde26f-5609-46b3-b19d-c6c07604cd7a None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:36.860111 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1798d0-29db-41db-87a5-e7a8cb32bf64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:36.860748 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1798d0-29db-41db-87a5-e7a8cb32bf64 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:36.861052 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1798d0-29db-41db-87a5-e7a8cb32bf64 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:36.861319 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1798d0-29db-41db-87a5-e7a8cb32bf64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:36.870177 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1798d0-29db-41db-87a5-e7a8cb32bf64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:36.871638 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1798d0-29db-41db-87a5-e7a8cb32bf64 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:36.882194 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 886/1791] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:31:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:31:36.960563 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a79e9aca-8490-4a51-8faa-4ec3a0f9e7e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '051ace3c73274cfb88d2eb9d4deb625b', 'request_id': 'req-a79e9aca-8490-4a51-8faa-4ec3a0f9e7e7'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:36.966949 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a79e9aca-8490-4a51-8faa-4ec3a0f9e7e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '051ace3c73274cfb88d2eb9d4deb625b', 'request_id': 'req-a79e9aca-8490-4a51-8faa-4ec3a0f9e7e7'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:37.058531 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a79e9aca-8490-4a51-8faa-4ec3a0f9e7e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '051ace3c73274cfb88d2eb9d4deb625b', 'request_id': 'req-a79e9aca-8490-4a51-8faa-4ec3a0f9e7e7'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:37.070358 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a79e9aca-8490-4a51-8faa-4ec3a0f9e7e7 admin admin] The token cache is being invalidate because project 051ace3c73274cfb88d2eb9d4deb625b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:31:37.070632 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a79e9aca-8490-4a51-8faa-4ec3a0f9e7e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:37.071261 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a79e9aca-8490-4a51-8faa-4ec3a0f9e7e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:37.072936 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 906/1792] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:31:36 2021] DELETE /identity/v3/projects/051ace3c73274cfb88d2eb9d4deb625b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:31:37.079748 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bfb70-271f-4bc3-abc2-71ab39842062 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:37.080231 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bfb70-271f-4bc3-abc2-71ab39842062 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:37.080328 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bfb70-271f-4bc3-abc2-71ab39842062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:37.098610 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-6a7bfb70-271f-4bc3-abc2-71ab39842062 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:37.099826 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-6a7bfb70-271f-4bc3-abc2-71ab39842062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:37.160747 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 887/1793] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:37.168313 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88c129-fd57-475b-a739-3fcd8a396b94 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:37.168605 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88c129-fd57-475b-a739-3fcd8a396b94 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:37.168912 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88c129-fd57-475b-a739-3fcd8a396b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:37.186910 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-1d88c129-fd57-475b-a739-3fcd8a396b94 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:37.188682 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-1d88c129-fd57-475b-a739-3fcd8a396b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:37.197017 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 907/1794] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:37.201445 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bfb70-271f-4bc3-abc2-71ab39842062 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:37.211778 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bfb70-271f-4bc3-abc2-71ab39842062 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:37.216418 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb32d1-33f8-4943-8073-3325868d2758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:37.217107 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb32d1-33f8-4943-8073-3325868d2758 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:37.217394 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb32d1-33f8-4943-8073-3325868d2758 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:37.217671 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb32d1-33f8-4943-8073-3325868d2758 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:37.218393 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb32d1-33f8-4943-8073-3325868d2758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:31:37.219340 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb32d1-33f8-4943-8073-3325868d2758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:37.221403 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb32d1-33f8-4943-8073-3325868d2758 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:37.232879 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 888/1795] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:31:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:31:37.246682 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88c129-fd57-475b-a739-3fcd8a396b94 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:37.256217 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88c129-fd57-475b-a739-3fcd8a396b94 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:37.260802 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaefbf5-553e-45cb-ae81-2885e0efb24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:37.261479 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaefbf5-553e-45cb-ae81-2885e0efb24c admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:37.261756 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaefbf5-553e-45cb-ae81-2885e0efb24c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:37.262026 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaefbf5-553e-45cb-ae81-2885e0efb24c admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:37.262716 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaefbf5-553e-45cb-ae81-2885e0efb24c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:37.264582 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaefbf5-553e-45cb-ae81-2885e0efb24c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:37.332119 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb32d1-33f8-4943-8073-3325868d2758 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:37.333869 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-42fb32d1-33f8-4943-8073-3325868d2758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:37.349528 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb32d1-33f8-4943-8073-3325868d2758 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:37.355053 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243331bf-8b42-405c-ab84-5ccd9108f791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:37.355913 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243331bf-8b42-405c-ab84-5ccd9108f791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:37.356196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243331bf-8b42-405c-ab84-5ccd9108f791 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:37.356469 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243331bf-8b42-405c-ab84-5ccd9108f791 admin admin] PATH_INFO: `/v3/projects/4adf2dcede334e7db85993ca0bbc79db` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:37.357945 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243331bf-8b42-405c-ab84-5ccd9108f791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4adf2dcede334e7db85993ca0bbc79db)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:37.359633 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243331bf-8b42-405c-ab84-5ccd9108f791 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:37.365475 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 908/1796] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:31:37 2021] POST /identity/v3/projects => generated 393 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:31:37.372687 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaefbf5-553e-45cb-ae81-2885e0efb24c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:37.432588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaefbf5-553e-45cb-ae81-2885e0efb24c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:37.437789 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d52abf-011e-4ab3-b084-12dc096ba1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:37.438595 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d52abf-011e-4ab3-b084-12dc096ba1af admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:37.438832 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d52abf-011e-4ab3-b084-12dc096ba1af admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:37.439113 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d52abf-011e-4ab3-b084-12dc096ba1af admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:37.439799 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d52abf-011e-4ab3-b084-12dc096ba1af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:37.441738 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d52abf-011e-4ab3-b084-12dc096ba1af admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:37.474816 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-243331bf-8b42-405c-ab84-5ccd9108f791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4adf2dcede334e7db85993ca0bbc79db', 'request_id': 'req-243331bf-8b42-405c-ab84-5ccd9108f791'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:37.481762 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-243331bf-8b42-405c-ab84-5ccd9108f791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4adf2dcede334e7db85993ca0bbc79db', 'request_id': 'req-243331bf-8b42-405c-ab84-5ccd9108f791'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:37.543195 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 909/1797] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:31:37 2021] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:31:37.547266 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d52abf-011e-4ab3-b084-12dc096ba1af admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:37.556757 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d52abf-011e-4ab3-b084-12dc096ba1af admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:37.565851 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-243331bf-8b42-405c-ab84-5ccd9108f791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4adf2dcede334e7db85993ca0bbc79db', 'request_id': 'req-243331bf-8b42-405c-ab84-5ccd9108f791'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:37.577268 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-243331bf-8b42-405c-ab84-5ccd9108f791 admin admin] The token cache is being invalidate because project 4adf2dcede334e7db85993ca0bbc79db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:31:37.577485 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-243331bf-8b42-405c-ab84-5ccd9108f791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:37.578674 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-243331bf-8b42-405c-ab84-5ccd9108f791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:37.580269 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 889/1798] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:31:37 2021] DELETE /identity/v3/projects/4adf2dcede334e7db85993ca0bbc79db => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:31:37.584059 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243331bf-8b42-405c-ab84-5ccd9108f791 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:37.585459 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-243331bf-8b42-405c-ab84-5ccd9108f791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:37.620221 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41426c7b-09f6-4fd2-ba26-46062cf6f064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:37.621219 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41426c7b-09f6-4fd2-ba26-46062cf6f064 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:37.621507 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41426c7b-09f6-4fd2-ba26-46062cf6f064 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:37.621772 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41426c7b-09f6-4fd2-ba26-46062cf6f064 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:37.622538 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41426c7b-09f6-4fd2-ba26-46062cf6f064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:37.624187 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41426c7b-09f6-4fd2-ba26-46062cf6f064 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:37.638416 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 910/1799] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:37 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:31:37.642391 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41426c7b-09f6-4fd2-ba26-46062cf6f064 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:37.644117 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-41426c7b-09f6-4fd2-ba26-46062cf6f064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:37.657072 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41426c7b-09f6-4fd2-ba26-46062cf6f064 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:37.658039 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243331bf-8b42-405c-ab84-5ccd9108f791 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:37.661893 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f975c-c941-4fdb-a0c6-77f112143974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:37.662563 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f975c-c941-4fdb-a0c6-77f112143974 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:37.662844 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f975c-c941-4fdb-a0c6-77f112143974 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:37.662952 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bea4a-246f-4cd6-8cbe-1cc10621c914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:37.663118 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f975c-c941-4fdb-a0c6-77f112143974 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:37.663801 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bea4a-246f-4cd6-8cbe-1cc10621c914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:37.663908 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f975c-c941-4fdb-a0c6-77f112143974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:37.664083 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bea4a-246f-4cd6-8cbe-1cc10621c914 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:37.664357 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bea4a-246f-4cd6-8cbe-1cc10621c914 admin admin] PATH_INFO: `/v3/users/a61742a76d74444790e67aa0d0f345dd` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:37.665456 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f975c-c941-4fdb-a0c6-77f112143974 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:37.667395 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bea4a-246f-4cd6-8cbe-1cc10621c914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a61742a76d74444790e67aa0d0f345dd)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:37.667506 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bea4a-246f-4cd6-8cbe-1cc10621c914 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:37.675320 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 911/1800] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:37 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:31:37.679546 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f975c-c941-4fdb-a0c6-77f112143974 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:37.689323 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f975c-c941-4fdb-a0c6-77f112143974 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:37.693983 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9b3a4-7cb7-41c7-b04d-5e091efac198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:37.696107 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9b3a4-7cb7-41c7-b04d-5e091efac198 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:37.696107 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9b3a4-7cb7-41c7-b04d-5e091efac198 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:37.696107 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9b3a4-7cb7-41c7-b04d-5e091efac198 admin admin] PATH_INFO: `/v3/projects/0af0b9042fff4f45a8be3201d9e04428/users/6933a4efcd544005baeb72e3903aa5f6/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:37.710366 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9b3a4-7cb7-41c7-b04d-5e091efac198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af0b9042fff4f45a8be3201d9e04428, user_id=6933a4efcd544005baeb72e3903aa5f6, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:37.712995 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9b3a4-7cb7-41c7-b04d-5e091efac198 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:37.819243 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 912/1801] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:31:37 2021] PUT /identity/v3/projects/0af0b9042fff4f45a8be3201d9e04428/users/6933a4efcd544005baeb72e3903aa5f6/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:31:37.830695 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d51823-3db4-4772-9a2d-9b45e148369c None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:37.830919 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d51823-3db4-4772-9a2d-9b45e148369c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:37.831205 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d51823-3db4-4772-9a2d-9b45e148369c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:37.856746 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-e6d51823-3db4-4772-9a2d-9b45e148369c None None] MFA Rules not processed for user `6933a4efcd544005baeb72e3903aa5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:37.858160 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-e6d51823-3db4-4772-9a2d-9b45e148369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:37.889929 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-537bea4a-246f-4cd6-8cbe-1cc10621c914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a61742a76d74444790e67aa0d0f345dd'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:37.890635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-537bea4a-246f-4cd6-8cbe-1cc10621c914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a61742a76d74444790e67aa0d0f345dd'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:37.897233 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-537bea4a-246f-4cd6-8cbe-1cc10621c914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a61742a76d74444790e67aa0d0f345dd'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:37.897865 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-537bea4a-246f-4cd6-8cbe-1cc10621c914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a61742a76d74444790e67aa0d0f345dd'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:37.922966 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 913/1802] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:37 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:31:37.930970 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d51823-3db4-4772-9a2d-9b45e148369c None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:37.932248 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-e6d51823-3db4-4772-9a2d-9b45e148369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:37.938433 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-537bea4a-246f-4cd6-8cbe-1cc10621c914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a61742a76d74444790e67aa0d0f345dd'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:37.956082 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 890/1803] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:31:37 2021] DELETE /identity/v3/users/a61742a76d74444790e67aa0d0f345dd => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:31:37.995281 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d51823-3db4-4772-9a2d-9b45e148369c None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:38.053816 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee778c25-13a5-4afc-8458-075476656441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:38.054482 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee778c25-13a5-4afc-8458-075476656441 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:38.055025 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee778c25-13a5-4afc-8458-075476656441 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:38.055295 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee778c25-13a5-4afc-8458-075476656441 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:38.055975 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee778c25-13a5-4afc-8458-075476656441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:38.057941 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee778c25-13a5-4afc-8458-075476656441 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:38.166189 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 914/1804] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:31:37 2021] POST /identity/v3/projects => generated 389 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:31:38.167321 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bea4a-246f-4cd6-8cbe-1cc10621c914 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:38.177267 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bea4a-246f-4cd6-8cbe-1cc10621c914 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:38.235715 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582df5e-5b24-450b-bbf7-702f91caf547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:38.236397 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582df5e-5b24-450b-bbf7-702f91caf547 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:38.236682 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582df5e-5b24-450b-bbf7-702f91caf547 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:38.236997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582df5e-5b24-450b-bbf7-702f91caf547 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:38.237691 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582df5e-5b24-450b-bbf7-702f91caf547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:38.239634 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582df5e-5b24-450b-bbf7-702f91caf547 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:38.349914 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 891/1805] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:31:38 2021] POST /identity/v3/users => generated 301 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:31:38.353873 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee778c25-13a5-4afc-8458-075476656441 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:38.364613 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee778c25-13a5-4afc-8458-075476656441 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:38.369336 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bae04a-95e7-40f6-bb91-40554183281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:38.369997 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bae04a-95e7-40f6-bb91-40554183281f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:38.370279 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bae04a-95e7-40f6-bb91-40554183281f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:38.370560 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bae04a-95e7-40f6-bb91-40554183281f admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:38.371314 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bae04a-95e7-40f6-bb91-40554183281f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:38.372942 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bae04a-95e7-40f6-bb91-40554183281f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:38.384020 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 915/1806] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:38 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:31:38.385472 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582df5e-5b24-450b-bbf7-702f91caf547 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:38.387336 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-3582df5e-5b24-450b-bbf7-702f91caf547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:38.387865 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bae04a-95e7-40f6-bb91-40554183281f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:38.399714 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582df5e-5b24-450b-bbf7-702f91caf547 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:38.404446 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357885f-b7a7-4a6c-b6b7-2184dd2900dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:38.405866 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357885f-b7a7-4a6c-b6b7-2184dd2900dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:38.405866 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357885f-b7a7-4a6c-b6b7-2184dd2900dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:38.406095 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357885f-b7a7-4a6c-b6b7-2184dd2900dd admin admin] PATH_INFO: `/v3/projects/e8f8cf09cbc84ab797ed6ed91a6b4884` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:38.406372 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bae04a-95e7-40f6-bb91-40554183281f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:38.407358 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357885f-b7a7-4a6c-b6b7-2184dd2900dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f8cf09cbc84ab797ed6ed91a6b4884)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:38.411159 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357885f-b7a7-4a6c-b6b7-2184dd2900dd admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:38.411276 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f109c-9883-42b5-98e3-4695bd74dff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:38.416875 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f109c-9883-42b5-98e3-4695bd74dff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:38.416875 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f109c-9883-42b5-98e3-4695bd74dff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:38.416875 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f109c-9883-42b5-98e3-4695bd74dff5 admin admin] PATH_INFO: `/v3/projects/5ca1291734164c52bc8d26d371e0f166/users/cdca610e43df495980a6d734aabe0bf3/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:38.433720 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f109c-9883-42b5-98e3-4695bd74dff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca1291734164c52bc8d26d371e0f166, user_id=cdca610e43df495980a6d734aabe0bf3, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:38.436537 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f109c-9883-42b5-98e3-4695bd74dff5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:38.534755 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 916/1807] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:31:38 2021] PUT /identity/v3/projects/5ca1291734164c52bc8d26d371e0f166/users/cdca610e43df495980a6d734aabe0bf3/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:31:38.541699 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0357885f-b7a7-4a6c-b6b7-2184dd2900dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f8cf09cbc84ab797ed6ed91a6b4884', 'request_id': 'req-0357885f-b7a7-4a6c-b6b7-2184dd2900dd'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:38.542774 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f109c-9883-42b5-98e3-4695bd74dff5 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:38.548958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0357885f-b7a7-4a6c-b6b7-2184dd2900dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f8cf09cbc84ab797ed6ed91a6b4884', 'request_id': 'req-0357885f-b7a7-4a6c-b6b7-2184dd2900dd'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:38.604344 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f109c-9883-42b5-98e3-4695bd74dff5 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:38.623938 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0357885f-b7a7-4a6c-b6b7-2184dd2900dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f8cf09cbc84ab797ed6ed91a6b4884', 'request_id': 'req-0357885f-b7a7-4a6c-b6b7-2184dd2900dd'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:38.635116 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0357885f-b7a7-4a6c-b6b7-2184dd2900dd admin admin] The token cache is being invalidate because project e8f8cf09cbc84ab797ed6ed91a6b4884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:31:38.635404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0357885f-b7a7-4a6c-b6b7-2184dd2900dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:38.636055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0357885f-b7a7-4a6c-b6b7-2184dd2900dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:38.637645 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 892/1808] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:31:38 2021] DELETE /identity/v3/projects/e8f8cf09cbc84ab797ed6ed91a6b4884 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:31:38.641678 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357885f-b7a7-4a6c-b6b7-2184dd2900dd admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:38.643040 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-0357885f-b7a7-4a6c-b6b7-2184dd2900dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:38.660816 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10658605-14ec-4ddd-8736-5f3650fadd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:38.661533 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10658605-14ec-4ddd-8736-5f3650fadd8f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:38.662150 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10658605-14ec-4ddd-8736-5f3650fadd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:38.662150 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10658605-14ec-4ddd-8736-5f3650fadd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:38.662927 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10658605-14ec-4ddd-8736-5f3650fadd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:38.664616 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10658605-14ec-4ddd-8736-5f3650fadd8f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:38.678429 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 917/1809] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:38 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:31:38.679253 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10658605-14ec-4ddd-8736-5f3650fadd8f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:38.681241 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-10658605-14ec-4ddd-8736-5f3650fadd8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:38.693636 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10658605-14ec-4ddd-8736-5f3650fadd8f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:38.698251 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72586e-d972-4806-9bfc-87edcb7f2d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:38.699161 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72586e-d972-4806-9bfc-87edcb7f2d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:38.699439 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72586e-d972-4806-9bfc-87edcb7f2d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:38.699715 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72586e-d972-4806-9bfc-87edcb7f2d81 admin admin] PATH_INFO: `/v3/projects/5ca1291734164c52bc8d26d371e0f166/users/cdca610e43df495980a6d734aabe0bf3/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:38.701676 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72586e-d972-4806-9bfc-87edcb7f2d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca1291734164c52bc8d26d371e0f166, user_id=cdca610e43df495980a6d734aabe0bf3, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:38.704328 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72586e-d972-4806-9bfc-87edcb7f2d81 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:38.711062 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357885f-b7a7-4a6c-b6b7-2184dd2900dd admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:38.714283 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 918/1810] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:31:38 2021] PUT /identity/v3/projects/5ca1291734164c52bc8d26d371e0f166/users/cdca610e43df495980a6d734aabe0bf3/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:38.724700 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620262d8-e4b1-47e7-9307-8fd7c1c897e7 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:38.725040 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620262d8-e4b1-47e7-9307-8fd7c1c897e7 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:38.725316 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620262d8-e4b1-47e7-9307-8fd7c1c897e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:38.751837 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-620262d8-e4b1-47e7-9307-8fd7c1c897e7 None None] MFA Rules not processed for user `cdca610e43df495980a6d734aabe0bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:38.753090 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-620262d8-e4b1-47e7-9307-8fd7c1c897e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:38.766432 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a15fe9-10c3-406c-8adc-87cf4ff3c544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:38.767022 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a15fe9-10c3-406c-8adc-87cf4ff3c544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:38.767300 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a15fe9-10c3-406c-8adc-87cf4ff3c544 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:38.767570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a15fe9-10c3-406c-8adc-87cf4ff3c544 admin admin] PATH_INFO: `/v3/users/6ddaa9260f3e48eb9d4f767fabe4564e` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:38.768764 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a15fe9-10c3-406c-8adc-87cf4ff3c544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ddaa9260f3e48eb9d4f767fabe4564e)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:38.771109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a15fe9-10c3-406c-8adc-87cf4ff3c544 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:38.819085 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 919/1811] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:38 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:31:38.830132 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620262d8-e4b1-47e7-9307-8fd7c1c897e7 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:38.831463 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-620262d8-e4b1-47e7-9307-8fd7c1c897e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:38.885130 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620262d8-e4b1-47e7-9307-8fd7c1c897e7 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:38.888706 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa338f09-dfc8-44d2-99d0-06ea462debcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:38.889374 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa338f09-dfc8-44d2-99d0-06ea462debcf service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:38.889653 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa338f09-dfc8-44d2-99d0-06ea462debcf service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:38.889926 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa338f09-dfc8-44d2-99d0-06ea462debcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:38.899375 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa338f09-dfc8-44d2-99d0-06ea462debcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:38.900791 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa338f09-dfc8-44d2-99d0-06ea462debcf service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:38.910213 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 920/1812] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:31:38 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:31:38.929317 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-69a15fe9-10c3-406c-8adc-87cf4ff3c544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ddaa9260f3e48eb9d4f767fabe4564e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:38.930240 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-69a15fe9-10c3-406c-8adc-87cf4ff3c544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ddaa9260f3e48eb9d4f767fabe4564e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:38.937651 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-69a15fe9-10c3-406c-8adc-87cf4ff3c544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ddaa9260f3e48eb9d4f767fabe4564e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:38.938284 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-69a15fe9-10c3-406c-8adc-87cf4ff3c544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ddaa9260f3e48eb9d4f767fabe4564e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:38.955211 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa338f09-dfc8-44d2-99d0-06ea462debcf service cinder] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:38.956669 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-aa338f09-dfc8-44d2-99d0-06ea462debcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:38.967544 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa338f09-dfc8-44d2-99d0-06ea462debcf service cinder] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:38.971385 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38867d-3d6f-4950-8423-5b209b855fc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:38.972021 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38867d-3d6f-4950-8423-5b209b855fc3 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:38.972303 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38867d-3d6f-4950-8423-5b209b855fc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:38.972578 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38867d-3d6f-4950-8423-5b209b855fc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:38.974390 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-9d38867d-3d6f-4950-8423-5b209b855fc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:38.990045 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-69a15fe9-10c3-406c-8adc-87cf4ff3c544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ddaa9260f3e48eb9d4f767fabe4564e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:39.008064 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 893/1813] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:31:38 2021] DELETE /identity/v3/users/6ddaa9260f3e48eb9d4f767fabe4564e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:39.032799 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38867d-3d6f-4950-8423-5b209b855fc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:39.034314 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38867d-3d6f-4950-8423-5b209b855fc3 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:39.043497 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 921/1814] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:31:38 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:31:39.436456 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a15fe9-10c3-406c-8adc-87cf4ff3c544 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:39.438030 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-69a15fe9-10c3-406c-8adc-87cf4ff3c544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:39.506531 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a15fe9-10c3-406c-8adc-87cf4ff3c544 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:39.511322 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a942cdb-6b32-4ea5-a92a-63bd840a26fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:39.512314 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a942cdb-6b32-4ea5-a92a-63bd840a26fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:39.512742 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a942cdb-6b32-4ea5-a92a-63bd840a26fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:39.512936 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a942cdb-6b32-4ea5-a92a-63bd840a26fe admin admin] PATH_INFO: `/v3/projects/6fdc32314cea43cfaf91bab82e02bf8a` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:39.514106 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a942cdb-6b32-4ea5-a92a-63bd840a26fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fdc32314cea43cfaf91bab82e02bf8a)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:39.516040 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a942cdb-6b32-4ea5-a92a-63bd840a26fe admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:39.692915 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-5a942cdb-6b32-4ea5-a92a-63bd840a26fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fdc32314cea43cfaf91bab82e02bf8a', 'request_id': 'req-5a942cdb-6b32-4ea5-a92a-63bd840a26fe'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:39.700257 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-5a942cdb-6b32-4ea5-a92a-63bd840a26fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fdc32314cea43cfaf91bab82e02bf8a', 'request_id': 'req-5a942cdb-6b32-4ea5-a92a-63bd840a26fe'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:39.761196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-5a942cdb-6b32-4ea5-a92a-63bd840a26fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fdc32314cea43cfaf91bab82e02bf8a', 'request_id': 'req-5a942cdb-6b32-4ea5-a92a-63bd840a26fe'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:39.773076 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-5a942cdb-6b32-4ea5-a92a-63bd840a26fe admin admin] The token cache is being invalidate because project 6fdc32314cea43cfaf91bab82e02bf8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:31:39.773387 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-5a942cdb-6b32-4ea5-a92a-63bd840a26fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:39.774133 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-5a942cdb-6b32-4ea5-a92a-63bd840a26fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:39.780890 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 894/1815] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:31:39 2021] DELETE /identity/v3/projects/6fdc32314cea43cfaf91bab82e02bf8a => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:39.782621 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1f3a6-ebf2-4d83-b683-c432f9208580 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:39.783099 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1f3a6-ebf2-4d83-b683-c432f9208580 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:39.783381 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1f3a6-ebf2-4d83-b683-c432f9208580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:39.801818 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-fce1f3a6-ebf2-4d83-b683-c432f9208580 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:39.803024 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-fce1f3a6-ebf2-4d83-b683-c432f9208580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:39.863437 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 922/1816] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:39.871355 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f153877-a787-4261-99da-ca3f95985ee9 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:39.871641 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f153877-a787-4261-99da-ca3f95985ee9 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:39.871912 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f153877-a787-4261-99da-ca3f95985ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:39.890979 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-8f153877-a787-4261-99da-ca3f95985ee9 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:39.892281 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8f153877-a787-4261-99da-ca3f95985ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:39.900143 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 895/1817] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:39.904462 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1f3a6-ebf2-4d83-b683-c432f9208580 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:39.914895 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1f3a6-ebf2-4d83-b683-c432f9208580 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:39.919526 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023544e1-d8c6-4135-bd53-0862cef6b52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:39.920180 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023544e1-d8c6-4135-bd53-0862cef6b52c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:39.920459 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023544e1-d8c6-4135-bd53-0862cef6b52c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:39.920732 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023544e1-d8c6-4135-bd53-0862cef6b52c admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:39.921482 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023544e1-d8c6-4135-bd53-0862cef6b52c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:31:39.921955 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023544e1-d8c6-4135-bd53-0862cef6b52c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:39.923754 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023544e1-d8c6-4135-bd53-0862cef6b52c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:39.935273 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 923/1818] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:31:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:31:39.939668 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f153877-a787-4261-99da-ca3f95985ee9 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:39.948722 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f153877-a787-4261-99da-ca3f95985ee9 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:39.953921 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163301e-a22c-485c-b846-ada805a875a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:39.954566 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163301e-a22c-485c-b846-ada805a875a5 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:39.954846 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163301e-a22c-485c-b846-ada805a875a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:39.955120 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163301e-a22c-485c-b846-ada805a875a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:39.955804 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163301e-a22c-485c-b846-ada805a875a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:39.957712 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163301e-a22c-485c-b846-ada805a875a5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:40.042775 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 896/1819] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:31:39 2021] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:31:40.047102 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023544e1-d8c6-4135-bd53-0862cef6b52c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:40.057080 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023544e1-d8c6-4135-bd53-0862cef6b52c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:40.110224 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9c27b-685d-454c-82a2-b4d0659cf125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:40.110881 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9c27b-685d-454c-82a2-b4d0659cf125 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:40.111164 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9c27b-685d-454c-82a2-b4d0659cf125 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:40.111441 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9c27b-685d-454c-82a2-b4d0659cf125 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:40.112133 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9c27b-685d-454c-82a2-b4d0659cf125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:40.114061 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9c27b-685d-454c-82a2-b4d0659cf125 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:40.178609 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 924/1820] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:31:40 2021] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:31:40.182979 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163301e-a22c-485c-b846-ada805a875a5 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:40.193628 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163301e-a22c-485c-b846-ada805a875a5 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:40.198240 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1075f-76b9-438d-9ee5-760624195742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:40.198903 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1075f-76b9-438d-9ee5-760624195742 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:40.199185 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1075f-76b9-438d-9ee5-760624195742 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:40.199461 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1075f-76b9-438d-9ee5-760624195742 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:40.200179 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1075f-76b9-438d-9ee5-760624195742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:40.201781 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1075f-76b9-438d-9ee5-760624195742 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:40.212599 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 897/1821] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:40 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:31:40.216493 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9c27b-685d-454c-82a2-b4d0659cf125 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:40.226557 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9c27b-685d-454c-82a2-b4d0659cf125 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:40.231207 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea018e-71d3-4feb-a9b7-38795a707020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:40.231860 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea018e-71d3-4feb-a9b7-38795a707020 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:40.232144 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea018e-71d3-4feb-a9b7-38795a707020 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:40.232420 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea018e-71d3-4feb-a9b7-38795a707020 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:40.233231 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea018e-71d3-4feb-a9b7-38795a707020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:40.234899 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea018e-71d3-4feb-a9b7-38795a707020 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:40.244446 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 925/1822] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:40 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:31:40.248450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1075f-76b9-438d-9ee5-760624195742 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:40.258787 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1075f-76b9-438d-9ee5-760624195742 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:40.263280 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1dad1-97b4-45f9-92f6-53662ab9c197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:40.264145 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1dad1-97b4-45f9-92f6-53662ab9c197 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:40.264435 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1dad1-97b4-45f9-92f6-53662ab9c197 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:40.264708 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1dad1-97b4-45f9-92f6-53662ab9c197 admin admin] PATH_INFO: `/v3/projects/2a8e6cdbb0d64e80b58ff584ec68f27a/users/c25361f02052459c81e6b27299ab11be/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:40.279085 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1dad1-97b4-45f9-92f6-53662ab9c197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a8e6cdbb0d64e80b58ff584ec68f27a, user_id=c25361f02052459c81e6b27299ab11be, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:40.282043 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1dad1-97b4-45f9-92f6-53662ab9c197 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:40.354999 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 898/1823] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:31:40 2021] PUT /identity/v3/projects/2a8e6cdbb0d64e80b58ff584ec68f27a/users/c25361f02052459c81e6b27299ab11be/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:40.365941 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774ea45-a61d-4740-b151-51c963c7aa60 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:40.366232 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774ea45-a61d-4740-b151-51c963c7aa60 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:40.366512 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774ea45-a61d-4740-b151-51c963c7aa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:40.394158 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-c774ea45-a61d-4740-b151-51c963c7aa60 None None] MFA Rules not processed for user `c25361f02052459c81e6b27299ab11be`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:40.395382 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c774ea45-a61d-4740-b151-51c963c7aa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:40.457843 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 926/1824] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:40 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:40.470448 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1dad1-97b4-45f9-92f6-53662ab9c197 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:40.471210 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-0bc1dad1-97b4-45f9-92f6-53662ab9c197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:40.525386 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1dad1-97b4-45f9-92f6-53662ab9c197 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:40.528977 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea55fbc-bbfe-4285-abc7-9af414a8ef93 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59679a5d71249fc8cd65fbcf84e7bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:40.529620 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea55fbc-bbfe-4285-abc7-9af414a8ef93 service glance] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:40.529895 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea55fbc-bbfe-4285-abc7-9af414a8ef93 service glance] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:40.530165 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea55fbc-bbfe-4285-abc7-9af414a8ef93 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:40.539130 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea55fbc-bbfe-4285-abc7-9af414a8ef93 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:40.540535 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea55fbc-bbfe-4285-abc7-9af414a8ef93 service glance] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:40.550690 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 899/1825] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:31:40 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:31:42.880707 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe111b6-d6f0-43c2-bed5-b0525d7e00c0 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:42.881273 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe111b6-d6f0-43c2-bed5-b0525d7e00c0 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:42.881273 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe111b6-d6f0-43c2-bed5-b0525d7e00c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:42.899439 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-6fe111b6-d6f0-43c2-bed5-b0525d7e00c0 None None] MFA Rules not processed for user `589eca6a184e4505a0c0f97efe65892e`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:42.900558 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-6fe111b6-d6f0-43c2-bed5-b0525d7e00c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:42.953873 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 927/1826] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:42 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:43.909902 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea55fbc-bbfe-4285-abc7-9af414a8ef93 service glance] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:43.912452 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-2ea55fbc-bbfe-4285-abc7-9af414a8ef93 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:44.002777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea55fbc-bbfe-4285-abc7-9af414a8ef93 service glance] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:44.008763 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1318b9d-9e2c-4c4b-808c-9d07e7fbf40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:44.009682 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1318b9d-9e2c-4c4b-808c-9d07e7fbf40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:44.009958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1318b9d-9e2c-4c4b-808c-9d07e7fbf40d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:44.010232 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1318b9d-9e2c-4c4b-808c-9d07e7fbf40d admin admin] PATH_INFO: `/v3/users/6933a4efcd544005baeb72e3903aa5f6` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:44.011457 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1318b9d-9e2c-4c4b-808c-9d07e7fbf40d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6933a4efcd544005baeb72e3903aa5f6)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:44.013406 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1318b9d-9e2c-4c4b-808c-9d07e7fbf40d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:44.231312 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b1318b9d-9e2c-4c4b-808c-9d07e7fbf40d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6933a4efcd544005baeb72e3903aa5f6'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:44.231954 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b1318b9d-9e2c-4c4b-808c-9d07e7fbf40d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6933a4efcd544005baeb72e3903aa5f6'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:44.239342 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b1318b9d-9e2c-4c4b-808c-9d07e7fbf40d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6933a4efcd544005baeb72e3903aa5f6'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:44.239956 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b1318b9d-9e2c-4c4b-808c-9d07e7fbf40d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6933a4efcd544005baeb72e3903aa5f6'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:44.303855 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b1318b9d-9e2c-4c4b-808c-9d07e7fbf40d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6933a4efcd544005baeb72e3903aa5f6'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:44.322090 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 900/1827] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:31:43 2021] DELETE /identity/v3/users/6933a4efcd544005baeb72e3903aa5f6 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:44.326599 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d398fd-52a9-4143-a1b8-c7f86d790126 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:44.327098 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d398fd-52a9-4143-a1b8-c7f86d790126 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:44.327187 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d398fd-52a9-4143-a1b8-c7f86d790126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:44.344492 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-b5d398fd-52a9-4143-a1b8-c7f86d790126 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:44.345723 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-b5d398fd-52a9-4143-a1b8-c7f86d790126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:44.403705 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 928/1828] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:44.414071 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1318b9d-9e2c-4c4b-808c-9d07e7fbf40d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:44.417879 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b1318b9d-9e2c-4c4b-808c-9d07e7fbf40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:44.479189 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1318b9d-9e2c-4c4b-808c-9d07e7fbf40d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:44.484728 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef7e41-018a-4fd5-b0b5-6db3f2399ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:44.485827 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef7e41-018a-4fd5-b0b5-6db3f2399ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:44.486288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef7e41-018a-4fd5-b0b5-6db3f2399ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:44.486714 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef7e41-018a-4fd5-b0b5-6db3f2399ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:44.502883 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef7e41-018a-4fd5-b0b5-6db3f2399ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:44.505470 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef7e41-018a-4fd5-b0b5-6db3f2399ae2 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:44.521959 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 901/1829] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:31:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:31:45.116100 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d398fd-52a9-4143-a1b8-c7f86d790126 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:45.117849 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-b5d398fd-52a9-4143-a1b8-c7f86d790126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:45.130354 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d398fd-52a9-4143-a1b8-c7f86d790126 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:45.135100 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609fbf0-d21e-4ea7-8274-0a37fee6ad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:45.136004 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609fbf0-d21e-4ea7-8274-0a37fee6ad62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:45.136283 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609fbf0-d21e-4ea7-8274-0a37fee6ad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:45.136697 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609fbf0-d21e-4ea7-8274-0a37fee6ad62 admin admin] PATH_INFO: `/v3/projects/0af0b9042fff4f45a8be3201d9e04428` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:45.137935 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609fbf0-d21e-4ea7-8274-0a37fee6ad62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0af0b9042fff4f45a8be3201d9e04428)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:45.139847 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609fbf0-d21e-4ea7-8274-0a37fee6ad62 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:45.283219 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4609fbf0-d21e-4ea7-8274-0a37fee6ad62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af0b9042fff4f45a8be3201d9e04428', 'request_id': 'req-4609fbf0-d21e-4ea7-8274-0a37fee6ad62'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:45.290975 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4609fbf0-d21e-4ea7-8274-0a37fee6ad62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af0b9042fff4f45a8be3201d9e04428', 'request_id': 'req-4609fbf0-d21e-4ea7-8274-0a37fee6ad62'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:45.372445 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4609fbf0-d21e-4ea7-8274-0a37fee6ad62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af0b9042fff4f45a8be3201d9e04428', 'request_id': 'req-4609fbf0-d21e-4ea7-8274-0a37fee6ad62'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:45.383768 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4609fbf0-d21e-4ea7-8274-0a37fee6ad62 admin admin] The token cache is being invalidate because project 0af0b9042fff4f45a8be3201d9e04428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:31:45.383980 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4609fbf0-d21e-4ea7-8274-0a37fee6ad62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:45.384589 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4609fbf0-d21e-4ea7-8274-0a37fee6ad62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:45.386125 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 929/1830] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:31:45 2021] DELETE /identity/v3/projects/0af0b9042fff4f45a8be3201d9e04428 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:45.390760 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef7e41-018a-4fd5-b0b5-6db3f2399ae2 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:45.400444 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef7e41-018a-4fd5-b0b5-6db3f2399ae2 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:45.461031 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692ea13-d42e-4d6b-8146-910fff7fe268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:45.461912 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692ea13-d42e-4d6b-8146-910fff7fe268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:45.462191 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692ea13-d42e-4d6b-8146-910fff7fe268 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:45.462584 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692ea13-d42e-4d6b-8146-910fff7fe268 admin admin] PATH_INFO: `/v3/users/cdca610e43df495980a6d734aabe0bf3` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:45.463768 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692ea13-d42e-4d6b-8146-910fff7fe268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdca610e43df495980a6d734aabe0bf3)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:45.465731 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692ea13-d42e-4d6b-8146-910fff7fe268 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:45.665996 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-a692ea13-d42e-4d6b-8146-910fff7fe268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdca610e43df495980a6d734aabe0bf3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:45.666623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-a692ea13-d42e-4d6b-8146-910fff7fe268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdca610e43df495980a6d734aabe0bf3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:45.673516 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-a692ea13-d42e-4d6b-8146-910fff7fe268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdca610e43df495980a6d734aabe0bf3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:45.674157 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-a692ea13-d42e-4d6b-8146-910fff7fe268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdca610e43df495980a6d734aabe0bf3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:45.753803 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-a692ea13-d42e-4d6b-8146-910fff7fe268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdca610e43df495980a6d734aabe0bf3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:45.771957 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 902/1831] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:31:45 2021] DELETE /identity/v3/users/cdca610e43df495980a6d734aabe0bf3 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:31:46.351767 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609fbf0-d21e-4ea7-8274-0a37fee6ad62 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:46.353720 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-4609fbf0-d21e-4ea7-8274-0a37fee6ad62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:46.372227 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609fbf0-d21e-4ea7-8274-0a37fee6ad62 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:46.446151 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b148f-216e-4da4-8da2-bd78ff794769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:46.446925 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b148f-216e-4da4-8da2-bd78ff794769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:46.447205 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b148f-216e-4da4-8da2-bd78ff794769 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:46.447480 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b148f-216e-4da4-8da2-bd78ff794769 admin admin] PATH_INFO: `/v3/projects/5ca1291734164c52bc8d26d371e0f166` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:46.448655 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b148f-216e-4da4-8da2-bd78ff794769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca1291734164c52bc8d26d371e0f166)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:46.450592 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b148f-216e-4da4-8da2-bd78ff794769 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:46.579618 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-313b148f-216e-4da4-8da2-bd78ff794769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca1291734164c52bc8d26d371e0f166', 'request_id': 'req-313b148f-216e-4da4-8da2-bd78ff794769'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:46.585626 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-313b148f-216e-4da4-8da2-bd78ff794769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca1291734164c52bc8d26d371e0f166', 'request_id': 'req-313b148f-216e-4da4-8da2-bd78ff794769'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:46.652644 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-313b148f-216e-4da4-8da2-bd78ff794769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca1291734164c52bc8d26d371e0f166', 'request_id': 'req-313b148f-216e-4da4-8da2-bd78ff794769'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:46.664797 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-313b148f-216e-4da4-8da2-bd78ff794769 admin admin] The token cache is being invalidate because project 5ca1291734164c52bc8d26d371e0f166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:31:46.665144 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-313b148f-216e-4da4-8da2-bd78ff794769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:46.665791 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-313b148f-216e-4da4-8da2-bd78ff794769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:46.667346 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 930/1832] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:31:46 2021] DELETE /identity/v3/projects/5ca1291734164c52bc8d26d371e0f166 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:46.673857 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98cef9-889c-4a59-85d9-3cb088fe5b53 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:46.674349 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98cef9-889c-4a59-85d9-3cb088fe5b53 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:46.674435 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98cef9-889c-4a59-85d9-3cb088fe5b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:46.693156 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-ef98cef9-889c-4a59-85d9-3cb088fe5b53 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:46.694387 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ef98cef9-889c-4a59-85d9-3cb088fe5b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:46.753779 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 903/1833] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:31:46.763462 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2dc43-49da-4666-8d50-d7199cc7194f None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:46.763757 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2dc43-49da-4666-8d50-d7199cc7194f None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:46.764034 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2dc43-49da-4666-8d50-d7199cc7194f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:46.781977 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-35d2dc43-49da-4666-8d50-d7199cc7194f None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:46.783389 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-35d2dc43-49da-4666-8d50-d7199cc7194f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:46.791450 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 931/1834] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:46.797692 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98cef9-889c-4a59-85d9-3cb088fe5b53 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:46.808869 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98cef9-889c-4a59-85d9-3cb088fe5b53 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:46.814974 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4638683-c14e-4a56-ade3-d846e5e0b975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:46.815715 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4638683-c14e-4a56-ade3-d846e5e0b975 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:46.815946 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4638683-c14e-4a56-ade3-d846e5e0b975 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:46.816216 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4638683-c14e-4a56-ade3-d846e5e0b975 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:46.816993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4638683-c14e-4a56-ade3-d846e5e0b975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:31:46.817298 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4638683-c14e-4a56-ade3-d846e5e0b975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:46.818899 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4638683-c14e-4a56-ade3-d846e5e0b975 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:46.831688 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 904/1835] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:31:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:31:46.836013 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2dc43-49da-4666-8d50-d7199cc7194f None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:46.845616 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2dc43-49da-4666-8d50-d7199cc7194f None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:46.850486 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd591b7-eafc-4aac-9336-50d6cdc12d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:46.851141 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd591b7-eafc-4aac-9336-50d6cdc12d16 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:46.851427 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd591b7-eafc-4aac-9336-50d6cdc12d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:46.851705 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd591b7-eafc-4aac-9336-50d6cdc12d16 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:46.852408 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd591b7-eafc-4aac-9336-50d6cdc12d16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:46.854336 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd591b7-eafc-4aac-9336-50d6cdc12d16 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:46.974361 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 932/1836] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:31:46 2021] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:31:46.978721 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4638683-c14e-4a56-ade3-d846e5e0b975 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:46.990709 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4638683-c14e-4a56-ade3-d846e5e0b975 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:47.059074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9b3c4-8d11-4a89-bd53-9910936f1684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:47.059795 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9b3c4-8d11-4a89-bd53-9910936f1684 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:47.060081 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9b3c4-8d11-4a89-bd53-9910936f1684 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:47.060356 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9b3c4-8d11-4a89-bd53-9910936f1684 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:47.061161 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9b3c4-8d11-4a89-bd53-9910936f1684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:47.063510 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9b3c4-8d11-4a89-bd53-9910936f1684 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:47.180332 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 905/1837] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:31:46 2021] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:31:47.184788 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd591b7-eafc-4aac-9336-50d6cdc12d16 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:47.195501 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd591b7-eafc-4aac-9336-50d6cdc12d16 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:47.201205 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f3c52-6312-4ec6-9610-06fb409e59c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:47.202138 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f3c52-6312-4ec6-9610-06fb409e59c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:47.202744 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f3c52-6312-4ec6-9610-06fb409e59c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:47.203058 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f3c52-6312-4ec6-9610-06fb409e59c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:47.204031 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f3c52-6312-4ec6-9610-06fb409e59c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:47.206096 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f3c52-6312-4ec6-9610-06fb409e59c8 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:47.219667 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 933/1838] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:47 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:31:47.223708 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9b3c4-8d11-4a89-bd53-9910936f1684 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:47.241431 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9b3c4-8d11-4a89-bd53-9910936f1684 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:47.247484 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a0bf4-97c2-4b9c-902a-a4ec1a8ede06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:47.248158 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a0bf4-97c2-4b9c-902a-a4ec1a8ede06 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:47.259341 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a0bf4-97c2-4b9c-902a-a4ec1a8ede06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:47.259341 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a0bf4-97c2-4b9c-902a-a4ec1a8ede06 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:47.259341 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a0bf4-97c2-4b9c-902a-a4ec1a8ede06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:47.259341 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a0bf4-97c2-4b9c-902a-a4ec1a8ede06 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:47.263989 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 906/1839] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:47 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:31:47.269382 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f3c52-6312-4ec6-9610-06fb409e59c8 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:47.280615 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f3c52-6312-4ec6-9610-06fb409e59c8 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:47.285612 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55229ceb-2592-4ad8-88d0-d908a2abf8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:47.286850 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55229ceb-2592-4ad8-88d0-d908a2abf8e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:47.287065 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55229ceb-2592-4ad8-88d0-d908a2abf8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:47.287338 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55229ceb-2592-4ad8-88d0-d908a2abf8e1 admin admin] PATH_INFO: `/v3/projects/41a5bf9fe38d4e25961c0a7dbd34f3ed/users/95110d6780d742c089067c35fe06c16c/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:47.308477 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55229ceb-2592-4ad8-88d0-d908a2abf8e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a5bf9fe38d4e25961c0a7dbd34f3ed, user_id=95110d6780d742c089067c35fe06c16c, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:47.311278 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55229ceb-2592-4ad8-88d0-d908a2abf8e1 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:47.384537 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 934/1840] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:31:47 2021] PUT /identity/v3/projects/41a5bf9fe38d4e25961c0a7dbd34f3ed/users/95110d6780d742c089067c35fe06c16c/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:31:47.398686 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6c03a-5948-40ac-af54-11e7304a728a None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:47.399096 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6c03a-5948-40ac-af54-11e7304a728a None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:47.399381 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6c03a-5948-40ac-af54-11e7304a728a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:47.435321 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-60e6c03a-5948-40ac-af54-11e7304a728a None None] MFA Rules not processed for user `95110d6780d742c089067c35fe06c16c`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:47.436668 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-60e6c03a-5948-40ac-af54-11e7304a728a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:47.502193 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 907/1841] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:47 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:47.506655 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55229ceb-2592-4ad8-88d0-d908a2abf8e1 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:47.569484 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55229ceb-2592-4ad8-88d0-d908a2abf8e1 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:47.574212 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a221e-f320-4d60-b8b3-17aff8cbdab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:47.574872 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a221e-f320-4d60-b8b3-17aff8cbdab8 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:47.575151 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a221e-f320-4d60-b8b3-17aff8cbdab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:47.575423 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a221e-f320-4d60-b8b3-17aff8cbdab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:47.576114 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a221e-f320-4d60-b8b3-17aff8cbdab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:47.578198 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a221e-f320-4d60-b8b3-17aff8cbdab8 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:47.669603 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6c03a-5948-40ac-af54-11e7304a728a None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:47.671016 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-60e6c03a-5948-40ac-af54-11e7304a728a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:47.686611 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6c03a-5948-40ac-af54-11e7304a728a None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:47.691682 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797e7cb-d425-48f5-aa80-6539be2caf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:47.692823 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797e7cb-d425-48f5-aa80-6539be2caf37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:47.693217 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797e7cb-d425-48f5-aa80-6539be2caf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:47.693568 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797e7cb-d425-48f5-aa80-6539be2caf37 admin admin] PATH_INFO: `/v3/users/514f92fc799f4156bb843ac6b073139d` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:47.694870 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797e7cb-d425-48f5-aa80-6539be2caf37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=514f92fc799f4156bb843ac6b073139d)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:47.695291 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 935/1842] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:31:47 2021] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:31:47.696918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797e7cb-d425-48f5-aa80-6539be2caf37 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:47.699737 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a221e-f320-4d60-b8b3-17aff8cbdab8 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:47.765658 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a221e-f320-4d60-b8b3-17aff8cbdab8 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:47.770694 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67544ce-fdb1-42aa-8eb8-9f899d32b47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:47.771419 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67544ce-fdb1-42aa-8eb8-9f899d32b47b admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:47.771701 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67544ce-fdb1-42aa-8eb8-9f899d32b47b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:47.771976 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67544ce-fdb1-42aa-8eb8-9f899d32b47b admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:47.773001 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67544ce-fdb1-42aa-8eb8-9f899d32b47b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:47.774934 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67544ce-fdb1-42aa-8eb8-9f899d32b47b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:47.891823 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-9797e7cb-d425-48f5-aa80-6539be2caf37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '514f92fc799f4156bb843ac6b073139d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:47.892488 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-9797e7cb-d425-48f5-aa80-6539be2caf37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '514f92fc799f4156bb843ac6b073139d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:47.899028 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-9797e7cb-d425-48f5-aa80-6539be2caf37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '514f92fc799f4156bb843ac6b073139d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:47.899661 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-9797e7cb-d425-48f5-aa80-6539be2caf37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '514f92fc799f4156bb843ac6b073139d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:47.916932 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 936/1843] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:31:47 2021] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:31:47.920958 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67544ce-fdb1-42aa-8eb8-9f899d32b47b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:47.923595 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a67544ce-fdb1-42aa-8eb8-9f899d32b47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:47.938758 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67544ce-fdb1-42aa-8eb8-9f899d32b47b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:47.946785 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144cea2-2a05-45be-991c-e453d3ca4fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:47.947457 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144cea2-2a05-45be-991c-e453d3ca4fdf admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:47.947739 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144cea2-2a05-45be-991c-e453d3ca4fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:47.948015 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144cea2-2a05-45be-991c-e453d3ca4fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:47.948772 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144cea2-2a05-45be-991c-e453d3ca4fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:47.950380 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144cea2-2a05-45be-991c-e453d3ca4fdf admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:47.960548 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-9797e7cb-d425-48f5-aa80-6539be2caf37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '514f92fc799f4156bb843ac6b073139d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:47.964175 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 937/1844] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:47 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:31:47.965301 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144cea2-2a05-45be-991c-e453d3ca4fdf admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:47.976146 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144cea2-2a05-45be-991c-e453d3ca4fdf admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:47.981021 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd18080-9b62-4b5a-8b47-e2415cba8b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:47.981683 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd18080-9b62-4b5a-8b47-e2415cba8b8a admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:47.982129 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd18080-9b62-4b5a-8b47-e2415cba8b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:47.982565 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd18080-9b62-4b5a-8b47-e2415cba8b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:47.983719 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd18080-9b62-4b5a-8b47-e2415cba8b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:47.986194 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd18080-9b62-4b5a-8b47-e2415cba8b8a admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:47.988799 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 908/1845] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:31:47 2021] DELETE /identity/v3/users/514f92fc799f4156bb843ac6b073139d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:47.990858 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3beac1c-5191-4528-95a1-7271c4db3047 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:47.991498 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3beac1c-5191-4528-95a1-7271c4db3047 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:47.991977 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3beac1c-5191-4528-95a1-7271c4db3047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:48.000870 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 938/1846] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:47 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:31:48.006564 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd18080-9b62-4b5a-8b47-e2415cba8b8a admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:48.023651 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd18080-9b62-4b5a-8b47-e2415cba8b8a admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:48.024941 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b3beac1c-5191-4528-95a1-7271c4db3047 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:48.026072 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b3beac1c-5191-4528-95a1-7271c4db3047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:48.090821 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbd511-0db5-4c1d-9843-f99aa2dce2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:48.091662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbd511-0db5-4c1d-9843-f99aa2dce2eb admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:48.091945 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbd511-0db5-4c1d-9843-f99aa2dce2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:48.092221 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbd511-0db5-4c1d-9843-f99aa2dce2eb admin admin] PATH_INFO: `/v3/projects/8a8b8c45139e4139a73ed4714dd495e5/users/cf1c912fca5a483889317ce71bc9bbf6/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:48.095703 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 909/1847] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:48.105082 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3beac1c-5191-4528-95a1-7271c4db3047 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:48.106695 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b3beac1c-5191-4528-95a1-7271c4db3047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:48.114954 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbd511-0db5-4c1d-9843-f99aa2dce2eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a8b8c45139e4139a73ed4714dd495e5, user_id=cf1c912fca5a483889317ce71bc9bbf6, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:48.117717 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbd511-0db5-4c1d-9843-f99aa2dce2eb admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:48.172896 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3beac1c-5191-4528-95a1-7271c4db3047 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:48.176618 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49191b6-2d93-41fa-acae-1094057e6064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:48.177500 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49191b6-2d93-41fa-acae-1094057e6064 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:48.177790 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49191b6-2d93-41fa-acae-1094057e6064 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:48.178062 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49191b6-2d93-41fa-acae-1094057e6064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:48.189154 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49191b6-2d93-41fa-acae-1094057e6064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:48.191215 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49191b6-2d93-41fa-acae-1094057e6064 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:48.207410 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 910/1848] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:31:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:31:48.216584 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 939/1849] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:31:48 2021] PUT /identity/v3/projects/8a8b8c45139e4139a73ed4714dd495e5/users/cf1c912fca5a483889317ce71bc9bbf6/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:31:48.231424 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0702aa7-f044-4406-a270-567e3a6e076c None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:48.231739 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0702aa7-f044-4406-a270-567e3a6e076c None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:48.231981 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0702aa7-f044-4406-a270-567e3a6e076c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:48.265480 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-a0702aa7-f044-4406-a270-567e3a6e076c None None] MFA Rules not processed for user `cf1c912fca5a483889317ce71bc9bbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:48.266707 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a0702aa7-f044-4406-a270-567e3a6e076c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:48.345048 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 911/1850] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:48 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:48.351168 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbd511-0db5-4c1d-9843-f99aa2dce2eb admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:48.413376 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbd511-0db5-4c1d-9843-f99aa2dce2eb admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:48.420762 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf0e9-68ab-4718-8985-4995fff35e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:48.422285 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf0e9-68ab-4718-8985-4995fff35e88 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:48.422884 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf0e9-68ab-4718-8985-4995fff35e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:48.423072 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf0e9-68ab-4718-8985-4995fff35e88 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:48.423943 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bf0e9-68ab-4718-8985-4995fff35e88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:48.425948 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bf0e9-68ab-4718-8985-4995fff35e88 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:48.522660 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 940/1851] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:31:48 2021] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:31:48.527006 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0702aa7-f044-4406-a270-567e3a6e076c None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:48.542901 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0702aa7-f044-4406-a270-567e3a6e076c None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:48.615812 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b595f-e0b0-47a9-a413-3df8114f32c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:48.616495 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b595f-e0b0-47a9-a413-3df8114f32c5 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:48.617498 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b595f-e0b0-47a9-a413-3df8114f32c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:48.617811 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b595f-e0b0-47a9-a413-3df8114f32c5 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:48.618641 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b595f-e0b0-47a9-a413-3df8114f32c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:48.621471 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b595f-e0b0-47a9-a413-3df8114f32c5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:48.716101 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 912/1852] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:31:48 2021] POST /identity/v3/users => generated 295 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:31:48.721427 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf0e9-68ab-4718-8985-4995fff35e88 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:48.732058 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf0e9-68ab-4718-8985-4995fff35e88 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:48.737604 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f586873-346a-4e3e-a382-86aac3a193af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:48.738273 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f586873-346a-4e3e-a382-86aac3a193af admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:48.738585 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f586873-346a-4e3e-a382-86aac3a193af admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:48.738892 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f586873-346a-4e3e-a382-86aac3a193af admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:48.739660 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f586873-346a-4e3e-a382-86aac3a193af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:48.741300 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f586873-346a-4e3e-a382-86aac3a193af admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:48.755814 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 941/1853] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:48 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:31:48.757039 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b595f-e0b0-47a9-a413-3df8114f32c5 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:48.771158 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b595f-e0b0-47a9-a413-3df8114f32c5 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:48.776117 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657fae7-2059-4ef7-b0dc-fee13262df93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:48.777046 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657fae7-2059-4ef7-b0dc-fee13262df93 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:48.777331 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657fae7-2059-4ef7-b0dc-fee13262df93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:48.777613 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657fae7-2059-4ef7-b0dc-fee13262df93 admin admin] PATH_INFO: `/v3/projects/e80ceed0cba0497196e77ab02b69cec7/users/18e9fedfd1fd41beb8dcb2d2b44285b8/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:48.792826 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657fae7-2059-4ef7-b0dc-fee13262df93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80ceed0cba0497196e77ab02b69cec7, user_id=18e9fedfd1fd41beb8dcb2d2b44285b8, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:48.795715 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657fae7-2059-4ef7-b0dc-fee13262df93 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:48.902901 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 913/1854] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:31:48 2021] PUT /identity/v3/projects/e80ceed0cba0497196e77ab02b69cec7/users/18e9fedfd1fd41beb8dcb2d2b44285b8/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:48.907923 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f586873-346a-4e3e-a382-86aac3a193af admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:48.920011 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f586873-346a-4e3e-a382-86aac3a193af admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:48.928855 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657fae7-2059-4ef7-b0dc-fee13262df93 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:48.931147 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8657fae7-2059-4ef7-b0dc-fee13262df93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:48.991027 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac8b63-8e39-4cd6-a02a-70ae71ce974e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:48.992103 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac8b63-8e39-4cd6-a02a-70ae71ce974e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:48.992581 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac8b63-8e39-4cd6-a02a-70ae71ce974e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:48.993080 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac8b63-8e39-4cd6-a02a-70ae71ce974e admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:48.994230 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac8b63-8e39-4cd6-a02a-70ae71ce974e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:48.996017 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac8b63-8e39-4cd6-a02a-70ae71ce974e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:48.997360 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657fae7-2059-4ef7-b0dc-fee13262df93 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:49.002070 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861ab1d-ade5-471a-8bd0-0b7577535c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:49.003059 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861ab1d-ade5-471a-8bd0-0b7577535c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:49.008635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861ab1d-ade5-471a-8bd0-0b7577535c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:49.008635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861ab1d-ade5-471a-8bd0-0b7577535c93 admin admin] PATH_INFO: `/v3/projects/393174e781224805b2589d61f8d49ad4` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:49.008635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861ab1d-ade5-471a-8bd0-0b7577535c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=393174e781224805b2589d61f8d49ad4)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:49.008635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861ab1d-ade5-471a-8bd0-0b7577535c93 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:49.018028 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 942/1855] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:48 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:31:49.019108 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac8b63-8e39-4cd6-a02a-70ae71ce974e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:49.029435 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac8b63-8e39-4cd6-a02a-70ae71ce974e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:49.035420 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573154f-d09c-4f7e-a586-4cfe91f85e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:49.036373 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573154f-d09c-4f7e-a586-4cfe91f85e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:49.036653 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573154f-d09c-4f7e-a586-4cfe91f85e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:49.036958 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573154f-d09c-4f7e-a586-4cfe91f85e13 admin admin] PATH_INFO: `/v3/projects/e80ceed0cba0497196e77ab02b69cec7/users/18e9fedfd1fd41beb8dcb2d2b44285b8/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:49.039138 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573154f-d09c-4f7e-a586-4cfe91f85e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80ceed0cba0497196e77ab02b69cec7, user_id=18e9fedfd1fd41beb8dcb2d2b44285b8, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:49.041965 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573154f-d09c-4f7e-a586-4cfe91f85e13 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:49.053842 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 943/1856] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:31:49 2021] PUT /identity/v3/projects/e80ceed0cba0497196e77ab02b69cec7/users/18e9fedfd1fd41beb8dcb2d2b44285b8/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:49.065186 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f5121-9904-408d-bc40-ceed333f1196 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:49.065552 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f5121-9904-408d-bc40-ceed333f1196 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:49.066008 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f5121-9904-408d-bc40-ceed333f1196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:49.095080 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-d09f5121-9904-408d-bc40-ceed333f1196 None None] MFA Rules not processed for user `18e9fedfd1fd41beb8dcb2d2b44285b8`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:49.096294 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-d09f5121-9904-408d-bc40-ceed333f1196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:49.119995 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d861ab1d-ade5-471a-8bd0-0b7577535c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '393174e781224805b2589d61f8d49ad4', 'request_id': 'req-d861ab1d-ade5-471a-8bd0-0b7577535c93'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:49.127776 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d861ab1d-ade5-471a-8bd0-0b7577535c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '393174e781224805b2589d61f8d49ad4', 'request_id': 'req-d861ab1d-ade5-471a-8bd0-0b7577535c93'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:49.168517 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 944/1857] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:49 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:31:49.179071 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f5121-9904-408d-bc40-ceed333f1196 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:49.180718 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-d09f5121-9904-408d-bc40-ceed333f1196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:49.200363 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d861ab1d-ade5-471a-8bd0-0b7577535c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '393174e781224805b2589d61f8d49ad4', 'request_id': 'req-d861ab1d-ade5-471a-8bd0-0b7577535c93'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:49.212583 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d861ab1d-ade5-471a-8bd0-0b7577535c93 admin admin] The token cache is being invalidate because project 393174e781224805b2589d61f8d49ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:31:49.213403 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d861ab1d-ade5-471a-8bd0-0b7577535c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:49.214030 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d861ab1d-ade5-471a-8bd0-0b7577535c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:49.216152 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 914/1858] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:31:48 2021] DELETE /identity/v3/projects/393174e781224805b2589d61f8d49ad4 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:31:49.221420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cb752-7ff9-490c-ac82-00457f482cb9 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:49.221824 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cb752-7ff9-490c-ac82-00457f482cb9 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:49.222198 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cb752-7ff9-490c-ac82-00457f482cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:49.249942 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-969cb752-7ff9-490c-ac82-00457f482cb9 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:49.251228 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-969cb752-7ff9-490c-ac82-00457f482cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:49.257132 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f5121-9904-408d-bc40-ceed333f1196 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:49.313785 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 915/1859] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:49.321286 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c3664-b40f-4585-ba11-e4718ef408b8 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:49.321794 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c3664-b40f-4585-ba11-e4718ef408b8 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:49.322078 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c3664-b40f-4585-ba11-e4718ef408b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:49.331124 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9253d15-a9e1-4df1-9e96-09def157edb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:49.331827 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9253d15-a9e1-4df1-9e96-09def157edb8 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:49.332110 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9253d15-a9e1-4df1-9e96-09def157edb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:49.332389 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9253d15-a9e1-4df1-9e96-09def157edb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:49.334304 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c9253d15-a9e1-4df1-9e96-09def157edb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:49.354123 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-7f1c3664-b40f-4585-ba11-e4718ef408b8 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:49.355361 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-7f1c3664-b40f-4585-ba11-e4718ef408b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:49.364173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 916/1860] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:31:49.367725 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c3664-b40f-4585-ba11-e4718ef408b8 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:49.377449 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c3664-b40f-4585-ba11-e4718ef408b8 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:49.382303 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df5c45-1d7b-4468-b780-02bcc53b62a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:49.382955 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df5c45-1d7b-4468-b780-02bcc53b62a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:49.389433 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df5c45-1d7b-4468-b780-02bcc53b62a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:49.389433 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df5c45-1d7b-4468-b780-02bcc53b62a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:49.389433 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df5c45-1d7b-4468-b780-02bcc53b62a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:31:49.389433 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df5c45-1d7b-4468-b780-02bcc53b62a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:49.389433 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df5c45-1d7b-4468-b780-02bcc53b62a1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:49.401843 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 917/1861] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:31:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:31:49.403151 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df5c45-1d7b-4468-b780-02bcc53b62a1 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:49.412796 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df5c45-1d7b-4468-b780-02bcc53b62a1 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:49.418863 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9253d15-a9e1-4df1-9e96-09def157edb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:49.420245 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9253d15-a9e1-4df1-9e96-09def157edb8 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:49.421913 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3be1d-575d-4a3a-8ba2-904e07db7c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:49.422613 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3be1d-575d-4a3a-8ba2-904e07db7c0b admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:49.422908 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3be1d-575d-4a3a-8ba2-904e07db7c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:49.423172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3be1d-575d-4a3a-8ba2-904e07db7c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:49.423862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3be1d-575d-4a3a-8ba2-904e07db7c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:49.426603 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3be1d-575d-4a3a-8ba2-904e07db7c0b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:49.430552 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 945/1862] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:31:49 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:31:49.522042 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 918/1863] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:31:49 2021] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:31:49.526342 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9253d15-a9e1-4df1-9e96-09def157edb8 service cinder] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:49.536745 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9253d15-a9e1-4df1-9e96-09def157edb8 service cinder] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:49.555981 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3be1d-575d-4a3a-8ba2-904e07db7c0b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:49.557611 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ada3be1d-575d-4a3a-8ba2-904e07db7c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:49.606342 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197de0b-3a75-4659-939e-9d639281a1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:49.607021 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197de0b-3a75-4659-939e-9d639281a1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:49.607310 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197de0b-3a75-4659-939e-9d639281a1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:49.607590 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197de0b-3a75-4659-939e-9d639281a1a5 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:49.608316 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197de0b-3a75-4659-939e-9d639281a1a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:49.610896 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197de0b-3a75-4659-939e-9d639281a1a5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:49.622726 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3be1d-575d-4a3a-8ba2-904e07db7c0b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:49.626632 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a24f6-144d-4b74-b112-5bf313ad5600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:49.627279 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a24f6-144d-4b74-b112-5bf313ad5600 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:49.627562 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a24f6-144d-4b74-b112-5bf313ad5600 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:49.627839 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a24f6-144d-4b74-b112-5bf313ad5600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:49.629641 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-3b5a24f6-144d-4b74-b112-5bf313ad5600 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:49.697766 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a24f6-144d-4b74-b112-5bf313ad5600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:49.700494 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a24f6-144d-4b74-b112-5bf313ad5600 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:49.709491 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 919/1864] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:31:49 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:31:49.732992 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 946/1865] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:31:49 2021] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:31:49.736702 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a24f6-144d-4b74-b112-5bf313ad5600 service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:49.747413 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a24f6-144d-4b74-b112-5bf313ad5600 service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:49.752398 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf7cd6-ccf3-4d56-9291-772cdbb02603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:49.753151 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf7cd6-ccf3-4d56-9291-772cdbb02603 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:49.753382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf7cd6-ccf3-4d56-9291-772cdbb02603 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:49.753659 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf7cd6-ccf3-4d56-9291-772cdbb02603 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:49.754380 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf7cd6-ccf3-4d56-9291-772cdbb02603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:49.756032 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf7cd6-ccf3-4d56-9291-772cdbb02603 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:49.767082 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 920/1866] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:49 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:31:49.772415 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197de0b-3a75-4659-939e-9d639281a1a5 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:49.783353 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197de0b-3a75-4659-939e-9d639281a1a5 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:49.788246 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61287da6-aca0-42c3-9f06-3acea2f58ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:49.788955 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61287da6-aca0-42c3-9f06-3acea2f58ebf admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:49.789228 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61287da6-aca0-42c3-9f06-3acea2f58ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:49.789499 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61287da6-aca0-42c3-9f06-3acea2f58ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:49.790222 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61287da6-aca0-42c3-9f06-3acea2f58ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:49.791819 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61287da6-aca0-42c3-9f06-3acea2f58ebf admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:49.805743 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 947/1867] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:49 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:31:49.806913 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf7cd6-ccf3-4d56-9291-772cdbb02603 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:49.817485 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf7cd6-ccf3-4d56-9291-772cdbb02603 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:49.824097 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d0a54-7b36-4d59-a61f-3262b4a23cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:49.825278 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d0a54-7b36-4d59-a61f-3262b4a23cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:49.825570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d0a54-7b36-4d59-a61f-3262b4a23cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:49.825847 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d0a54-7b36-4d59-a61f-3262b4a23cc8 admin admin] PATH_INFO: `/v3/projects/d5947c1820014ca09719e5d27f807b31/users/fd64c6c23a8b495caf2bae6ce73348e8/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:49.848958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d0a54-7b36-4d59-a61f-3262b4a23cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5947c1820014ca09719e5d27f807b31, user_id=fd64c6c23a8b495caf2bae6ce73348e8, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:49.848958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d0a54-7b36-4d59-a61f-3262b4a23cc8 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:49.924005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 921/1868] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:31:49 2021] PUT /identity/v3/projects/d5947c1820014ca09719e5d27f807b31/users/fd64c6c23a8b495caf2bae6ce73348e8/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:49.944814 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db3d1e-bf9d-4730-bf73-71a5f5ca926c None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:49.944814 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db3d1e-bf9d-4730-bf73-71a5f5ca926c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:49.944814 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db3d1e-bf9d-4730-bf73-71a5f5ca926c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:49.974396 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-60db3d1e-bf9d-4730-bf73-71a5f5ca926c None None] MFA Rules not processed for user `fd64c6c23a8b495caf2bae6ce73348e8`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:49.975793 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-60db3d1e-bf9d-4730-bf73-71a5f5ca926c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:50.058857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 948/1869] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:49 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:50.069591 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d0a54-7b36-4d59-a61f-3262b4a23cc8 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:50.071293 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-903d0a54-7b36-4d59-a61f-3262b4a23cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:50.129349 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d0a54-7b36-4d59-a61f-3262b4a23cc8 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:50.133200 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721a277-5e8e-4f8e-b2df-8e5cc5f8a7ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:50.133838 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721a277-5e8e-4f8e-b2df-8e5cc5f8a7ce service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:50.134261 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721a277-5e8e-4f8e-b2df-8e5cc5f8a7ce service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:50.134535 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721a277-5e8e-4f8e-b2df-8e5cc5f8a7ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:50.143943 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721a277-5e8e-4f8e-b2df-8e5cc5f8a7ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:50.145705 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721a277-5e8e-4f8e-b2df-8e5cc5f8a7ce service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:50.156539 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 922/1870] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:31:50 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:31:54.013303 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db3d1e-bf9d-4730-bf73-71a5f5ca926c None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:54.014740 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-60db3d1e-bf9d-4730-bf73-71a5f5ca926c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:54.079850 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db3d1e-bf9d-4730-bf73-71a5f5ca926c None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:54.084358 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7661f03-dae8-4583-baca-afc356b6efcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:54.085290 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7661f03-dae8-4583-baca-afc356b6efcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:54.085575 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7661f03-dae8-4583-baca-afc356b6efcc admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:54.085851 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7661f03-dae8-4583-baca-afc356b6efcc admin admin] PATH_INFO: `/v3/users/95110d6780d742c089067c35fe06c16c` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:54.087081 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7661f03-dae8-4583-baca-afc356b6efcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=95110d6780d742c089067c35fe06c16c)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:54.088982 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7661f03-dae8-4583-baca-afc356b6efcc admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:54.238109 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-c7661f03-dae8-4583-baca-afc356b6efcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95110d6780d742c089067c35fe06c16c'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:54.257788 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-c7661f03-dae8-4583-baca-afc356b6efcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95110d6780d742c089067c35fe06c16c'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:54.264461 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-c7661f03-dae8-4583-baca-afc356b6efcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95110d6780d742c089067c35fe06c16c'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:54.265844 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-c7661f03-dae8-4583-baca-afc356b6efcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95110d6780d742c089067c35fe06c16c'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:54.326277 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-c7661f03-dae8-4583-baca-afc356b6efcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95110d6780d742c089067c35fe06c16c'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:54.333023 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 949/1871] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:31:54 2021] DELETE /identity/v3/users/95110d6780d742c089067c35fe06c16c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:54.337567 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb49b2-3a86-4374-808e-3e5b853a4129 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:54.338005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb49b2-3a86-4374-808e-3e5b853a4129 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:54.338092 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb49b2-3a86-4374-808e-3e5b853a4129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:54.352060 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7661f03-dae8-4583-baca-afc356b6efcc admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:54.353635 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c7661f03-dae8-4583-baca-afc356b6efcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:54.356855 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-beeb49b2-3a86-4374-808e-3e5b853a4129 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:54.358235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-beeb49b2-3a86-4374-808e-3e5b853a4129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:54.419298 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7661f03-dae8-4583-baca-afc356b6efcc admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:54.419964 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 923/1872] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:31:54.424414 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1d838-ae5d-456d-9aae-c61fdeb1a088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:54.425333 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1d838-ae5d-456d-9aae-c61fdeb1a088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:54.425614 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1d838-ae5d-456d-9aae-c61fdeb1a088 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:54.425889 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1d838-ae5d-456d-9aae-c61fdeb1a088 admin admin] PATH_INFO: `/v3/users/fd64c6c23a8b495caf2bae6ce73348e8` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:54.427104 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1d838-ae5d-456d-9aae-c61fdeb1a088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd64c6c23a8b495caf2bae6ce73348e8)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:54.429071 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1d838-ae5d-456d-9aae-c61fdeb1a088 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:54.431735 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb49b2-3a86-4374-808e-3e5b853a4129 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:54.433019 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-beeb49b2-3a86-4374-808e-3e5b853a4129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:54.495872 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb49b2-3a86-4374-808e-3e5b853a4129 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:54.500483 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a525daa-acfa-443c-b9a2-84346f976b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:54.501421 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a525daa-acfa-443c-b9a2-84346f976b3d service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:54.501830 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a525daa-acfa-443c-b9a2-84346f976b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:54.501958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a525daa-acfa-443c-b9a2-84346f976b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:54.513629 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a525daa-acfa-443c-b9a2-84346f976b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:54.516165 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a525daa-acfa-443c-b9a2-84346f976b3d service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:54.527748 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 924/1873] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:31:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:31:54.576288 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-26d1d838-ae5d-456d-9aae-c61fdeb1a088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd64c6c23a8b495caf2bae6ce73348e8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:54.590530 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-26d1d838-ae5d-456d-9aae-c61fdeb1a088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd64c6c23a8b495caf2bae6ce73348e8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:54.598070 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-26d1d838-ae5d-456d-9aae-c61fdeb1a088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd64c6c23a8b495caf2bae6ce73348e8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:54.599206 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-26d1d838-ae5d-456d-9aae-c61fdeb1a088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd64c6c23a8b495caf2bae6ce73348e8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:54.674273 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-26d1d838-ae5d-456d-9aae-c61fdeb1a088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd64c6c23a8b495caf2bae6ce73348e8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:54.683249 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 950/1874] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:31:54 2021] DELETE /identity/v3/users/fd64c6c23a8b495caf2bae6ce73348e8 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:31:54.690768 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3ea13-2ed1-4057-8ca0-6a86f57a5573 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:54.691054 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3ea13-2ed1-4057-8ca0-6a86f57a5573 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:54.691327 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3ea13-2ed1-4057-8ca0-6a86f57a5573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:54.718157 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-e0a3ea13-2ed1-4057-8ca0-6a86f57a5573 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:54.719776 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e0a3ea13-2ed1-4057-8ca0-6a86f57a5573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:54.799810 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 925/1875] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:54.824409 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1d838-ae5d-456d-9aae-c61fdeb1a088 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:54.826633 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-26d1d838-ae5d-456d-9aae-c61fdeb1a088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:54.908889 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1d838-ae5d-456d-9aae-c61fdeb1a088 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:54.912604 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60646a-7dd7-433f-af29-d4de1583459b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:54.913291 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60646a-7dd7-433f-af29-d4de1583459b service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:54.913575 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60646a-7dd7-433f-af29-d4de1583459b service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:54.914526 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60646a-7dd7-433f-af29-d4de1583459b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:54.923807 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60646a-7dd7-433f-af29-d4de1583459b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:54.925280 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60646a-7dd7-433f-af29-d4de1583459b service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:54.937300 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 951/1876] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:31:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:31:55.031649 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3ea13-2ed1-4057-8ca0-6a86f57a5573 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:55.033562 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e0a3ea13-2ed1-4057-8ca0-6a86f57a5573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:55.046180 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3ea13-2ed1-4057-8ca0-6a86f57a5573 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:55.051196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b1b9d-5c1f-4dbe-9b33-ef55778eb4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:55.052146 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b1b9d-5c1f-4dbe-9b33-ef55778eb4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:55.052431 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b1b9d-5c1f-4dbe-9b33-ef55778eb4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:55.052702 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b1b9d-5c1f-4dbe-9b33-ef55778eb4bc admin admin] PATH_INFO: `/v3/projects/41a5bf9fe38d4e25961c0a7dbd34f3ed` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:55.054552 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b1b9d-5c1f-4dbe-9b33-ef55778eb4bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a5bf9fe38d4e25961c0a7dbd34f3ed)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:55.056787 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b1b9d-5c1f-4dbe-9b33-ef55778eb4bc admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:55.189276 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-082b1b9d-5c1f-4dbe-9b33-ef55778eb4bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a5bf9fe38d4e25961c0a7dbd34f3ed', 'request_id': 'req-082b1b9d-5c1f-4dbe-9b33-ef55778eb4bc'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:55.195416 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-082b1b9d-5c1f-4dbe-9b33-ef55778eb4bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a5bf9fe38d4e25961c0a7dbd34f3ed', 'request_id': 'req-082b1b9d-5c1f-4dbe-9b33-ef55778eb4bc'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:55.273756 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-082b1b9d-5c1f-4dbe-9b33-ef55778eb4bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a5bf9fe38d4e25961c0a7dbd34f3ed', 'request_id': 'req-082b1b9d-5c1f-4dbe-9b33-ef55778eb4bc'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:55.284507 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-082b1b9d-5c1f-4dbe-9b33-ef55778eb4bc admin admin] The token cache is being invalidate because project 41a5bf9fe38d4e25961c0a7dbd34f3ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:31:55.289157 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-082b1b9d-5c1f-4dbe-9b33-ef55778eb4bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:55.289157 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-082b1b9d-5c1f-4dbe-9b33-ef55778eb4bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:55.289157 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 926/1877] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:31:55 2021] DELETE /identity/v3/projects/41a5bf9fe38d4e25961c0a7dbd34f3ed => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:55.291325 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60646a-7dd7-433f-af29-d4de1583459b service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:55.301135 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60646a-7dd7-433f-af29-d4de1583459b service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:55.357862 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b789dd-794f-4425-9b73-6f16aa5fa0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:55.358769 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b789dd-794f-4425-9b73-6f16aa5fa0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:55.359075 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b789dd-794f-4425-9b73-6f16aa5fa0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:55.359352 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b789dd-794f-4425-9b73-6f16aa5fa0dd admin admin] PATH_INFO: `/v3/users/cf1c912fca5a483889317ce71bc9bbf6` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:55.360560 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b789dd-794f-4425-9b73-6f16aa5fa0dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1c912fca5a483889317ce71bc9bbf6)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:55.362670 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b789dd-794f-4425-9b73-6f16aa5fa0dd admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:55.420300 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b1b9d-5c1f-4dbe-9b33-ef55778eb4bc admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:55.422976 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-082b1b9d-5c1f-4dbe-9b33-ef55778eb4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:55.444159 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b1b9d-5c1f-4dbe-9b33-ef55778eb4bc admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:55.451145 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858436a6-8f14-422b-b0c7-202014293d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:55.452201 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858436a6-8f14-422b-b0c7-202014293d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:55.452505 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858436a6-8f14-422b-b0c7-202014293d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:55.452845 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858436a6-8f14-422b-b0c7-202014293d15 admin admin] PATH_INFO: `/v3/projects/d5947c1820014ca09719e5d27f807b31` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:55.454642 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858436a6-8f14-422b-b0c7-202014293d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5947c1820014ca09719e5d27f807b31)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:55.456771 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858436a6-8f14-422b-b0c7-202014293d15 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:55.499708 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-01b789dd-794f-4425-9b73-6f16aa5fa0dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1c912fca5a483889317ce71bc9bbf6'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:55.511584 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-01b789dd-794f-4425-9b73-6f16aa5fa0dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1c912fca5a483889317ce71bc9bbf6'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:55.518808 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-01b789dd-794f-4425-9b73-6f16aa5fa0dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1c912fca5a483889317ce71bc9bbf6'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:55.519518 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-01b789dd-794f-4425-9b73-6f16aa5fa0dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1c912fca5a483889317ce71bc9bbf6'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:55.554679 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-858436a6-8f14-422b-b0c7-202014293d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5947c1820014ca09719e5d27f807b31', 'request_id': 'req-858436a6-8f14-422b-b0c7-202014293d15'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:55.560596 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-858436a6-8f14-422b-b0c7-202014293d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5947c1820014ca09719e5d27f807b31', 'request_id': 'req-858436a6-8f14-422b-b0c7-202014293d15'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:55.566141 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-01b789dd-794f-4425-9b73-6f16aa5fa0dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1c912fca5a483889317ce71bc9bbf6'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:55.572707 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 952/1878] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:31:55 2021] DELETE /identity/v3/users/cf1c912fca5a483889317ce71bc9bbf6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:55.623932 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-858436a6-8f14-422b-b0c7-202014293d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5947c1820014ca09719e5d27f807b31', 'request_id': 'req-858436a6-8f14-422b-b0c7-202014293d15'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:55.637438 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-858436a6-8f14-422b-b0c7-202014293d15 admin admin] The token cache is being invalidate because project d5947c1820014ca09719e5d27f807b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:31:55.637745 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-858436a6-8f14-422b-b0c7-202014293d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:55.638396 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-858436a6-8f14-422b-b0c7-202014293d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:55.640132 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 927/1879] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:31:55 2021] DELETE /identity/v3/projects/d5947c1820014ca09719e5d27f807b31 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:55.646889 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9689b0-f8f2-4193-bdb5-eb815f2a6f31 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:55.647509 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9689b0-f8f2-4193-bdb5-eb815f2a6f31 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:55.647790 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9689b0-f8f2-4193-bdb5-eb815f2a6f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:55.666763 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-1a9689b0-f8f2-4193-bdb5-eb815f2a6f31 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:55.668153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-1a9689b0-f8f2-4193-bdb5-eb815f2a6f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:55.731851 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 953/1880] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:55.739864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cb2f0-f6b6-4aab-87f5-9a36fd9407d0 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:55.744195 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cb2f0-f6b6-4aab-87f5-9a36fd9407d0 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:55.744195 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cb2f0-f6b6-4aab-87f5-9a36fd9407d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:55.776044 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-1c3cb2f0-f6b6-4aab-87f5-9a36fd9407d0 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:55.777373 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1c3cb2f0-f6b6-4aab-87f5-9a36fd9407d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:55.798220 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 928/1881] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:55.806493 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9689b0-f8f2-4193-bdb5-eb815f2a6f31 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:55.817352 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9689b0-f8f2-4193-bdb5-eb815f2a6f31 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:55.823296 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7cc52-1211-4c28-8df4-d3d8b1391b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:55.824073 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7cc52-1211-4c28-8df4-d3d8b1391b95 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:55.824551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7cc52-1211-4c28-8df4-d3d8b1391b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:55.824963 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7cc52-1211-4c28-8df4-d3d8b1391b95 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:55.825763 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7cc52-1211-4c28-8df4-d3d8b1391b95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:31:55.826147 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7cc52-1211-4c28-8df4-d3d8b1391b95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:55.827837 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7cc52-1211-4c28-8df4-d3d8b1391b95 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:55.843192 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 954/1882] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:31:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:31:55.845575 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3cb2f0-f6b6-4aab-87f5-9a36fd9407d0 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:55.854867 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3cb2f0-f6b6-4aab-87f5-9a36fd9407d0 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:55.864691 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec9dd9-8106-4e00-9dee-063a4bb31171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:55.865413 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec9dd9-8106-4e00-9dee-063a4bb31171 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:55.865690 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec9dd9-8106-4e00-9dee-063a4bb31171 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:55.865962 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec9dd9-8106-4e00-9dee-063a4bb31171 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:55.866660 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec9dd9-8106-4e00-9dee-063a4bb31171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:55.868558 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec9dd9-8106-4e00-9dee-063a4bb31171 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:55.989175 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 929/1883] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:31:55 2021] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:31:55.993379 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7cc52-1211-4c28-8df4-d3d8b1391b95 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:56.005077 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7cc52-1211-4c28-8df4-d3d8b1391b95 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:56.024686 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec9dd9-8106-4e00-9dee-063a4bb31171 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:56.026867 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1dec9dd9-8106-4e00-9dee-063a4bb31171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:56.102951 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08bbee-e0ca-43f2-94c4-c0da80e7ad80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:56.103699 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08bbee-e0ca-43f2-94c4-c0da80e7ad80 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:56.103991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08bbee-e0ca-43f2-94c4-c0da80e7ad80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:56.104274 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08bbee-e0ca-43f2-94c4-c0da80e7ad80 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:56.105343 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08bbee-e0ca-43f2-94c4-c0da80e7ad80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:56.107312 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08bbee-e0ca-43f2-94c4-c0da80e7ad80 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:56.133081 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec9dd9-8106-4e00-9dee-063a4bb31171 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:56.137892 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e845489-97ad-4f43-a529-12b7c9de528d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:56.138796 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e845489-97ad-4f43-a529-12b7c9de528d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:56.139083 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e845489-97ad-4f43-a529-12b7c9de528d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:56.139361 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e845489-97ad-4f43-a529-12b7c9de528d admin admin] PATH_INFO: `/v3/projects/8a8b8c45139e4139a73ed4714dd495e5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:56.140544 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e845489-97ad-4f43-a529-12b7c9de528d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a8b8c45139e4139a73ed4714dd495e5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:56.142817 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e845489-97ad-4f43-a529-12b7c9de528d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:56.204775 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 955/1884] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:31:55 2021] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:31:56.206280 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08bbee-e0ca-43f2-94c4-c0da80e7ad80 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:56.215920 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08bbee-e0ca-43f2-94c4-c0da80e7ad80 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:56.221750 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b957e03-a0a1-4903-b656-e24d93c41674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:56.222478 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b957e03-a0a1-4903-b656-e24d93c41674 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:56.222762 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b957e03-a0a1-4903-b656-e24d93c41674 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:56.223042 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b957e03-a0a1-4903-b656-e24d93c41674 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:56.223781 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b957e03-a0a1-4903-b656-e24d93c41674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:56.226491 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b957e03-a0a1-4903-b656-e24d93c41674 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:56.239148 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 956/1885] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:56 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:31:56.240164 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b957e03-a0a1-4903-b656-e24d93c41674 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:56.249847 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b957e03-a0a1-4903-b656-e24d93c41674 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:56.262600 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172be878-c92a-4764-b083-ea52369ad9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:56.265357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172be878-c92a-4764-b083-ea52369ad9ee admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:56.265357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172be878-c92a-4764-b083-ea52369ad9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:56.265357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172be878-c92a-4764-b083-ea52369ad9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:56.265357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172be878-c92a-4764-b083-ea52369ad9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:56.268640 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172be878-c92a-4764-b083-ea52369ad9ee admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:56.273683 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4e845489-97ad-4f43-a529-12b7c9de528d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a8b8c45139e4139a73ed4714dd495e5', 'request_id': 'req-4e845489-97ad-4f43-a529-12b7c9de528d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:56.279682 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 957/1886] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:56 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:31:56.284480 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172be878-c92a-4764-b083-ea52369ad9ee admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:56.293917 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4e845489-97ad-4f43-a529-12b7c9de528d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a8b8c45139e4139a73ed4714dd495e5', 'request_id': 'req-4e845489-97ad-4f43-a529-12b7c9de528d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:56.296005 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172be878-c92a-4764-b083-ea52369ad9ee admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:56.360647 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23494122-5579-4f57-b4b1-275bcf634376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:56.361551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23494122-5579-4f57-b4b1-275bcf634376 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:56.361852 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23494122-5579-4f57-b4b1-275bcf634376 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:56.362121 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23494122-5579-4f57-b4b1-275bcf634376 admin admin] PATH_INFO: `/v3/projects/b0342a0d1e3b49c29852c11d8aeadb6f/users/76bcad9416ea4ffd966b9827246ef936/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:56.376576 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23494122-5579-4f57-b4b1-275bcf634376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0342a0d1e3b49c29852c11d8aeadb6f, user_id=76bcad9416ea4ffd966b9827246ef936, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:56.379255 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23494122-5579-4f57-b4b1-275bcf634376 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:56.389492 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4e845489-97ad-4f43-a529-12b7c9de528d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a8b8c45139e4139a73ed4714dd495e5', 'request_id': 'req-4e845489-97ad-4f43-a529-12b7c9de528d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:56.401473 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4e845489-97ad-4f43-a529-12b7c9de528d admin admin] The token cache is being invalidate because project 8a8b8c45139e4139a73ed4714dd495e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:31:56.401785 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4e845489-97ad-4f43-a529-12b7c9de528d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:56.402595 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4e845489-97ad-4f43-a529-12b7c9de528d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:56.404188 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 930/1887] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:31:56 2021] DELETE /identity/v3/projects/8a8b8c45139e4139a73ed4714dd495e5 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:31:56.408612 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e845489-97ad-4f43-a529-12b7c9de528d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:56.410024 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-4e845489-97ad-4f43-a529-12b7c9de528d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:56.436878 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e845489-97ad-4f43-a529-12b7c9de528d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:56.442504 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef4565-1126-4e72-a13f-999ef37fbe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:56.443380 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef4565-1126-4e72-a13f-999ef37fbe04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:56.443666 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef4565-1126-4e72-a13f-999ef37fbe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:56.444471 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef4565-1126-4e72-a13f-999ef37fbe04 admin admin] PATH_INFO: `/v3/users/18e9fedfd1fd41beb8dcb2d2b44285b8` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:56.445981 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef4565-1126-4e72-a13f-999ef37fbe04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18e9fedfd1fd41beb8dcb2d2b44285b8)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:56.448060 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef4565-1126-4e72-a13f-999ef37fbe04 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:56.482636 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 958/1888] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:31:56 2021] PUT /identity/v3/projects/b0342a0d1e3b49c29852c11d8aeadb6f/users/76bcad9416ea4ffd966b9827246ef936/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:31:56.487616 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed9f53-5f32-4929-b296-046af0a84fdd None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:56.487901 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed9f53-5f32-4929-b296-046af0a84fdd None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:56.488176 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed9f53-5f32-4929-b296-046af0a84fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:56.506982 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-e9ed9f53-5f32-4929-b296-046af0a84fdd None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:56.508198 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-e9ed9f53-5f32-4929-b296-046af0a84fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:56.576474 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 959/1889] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:31:56.586855 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed9f53-5f32-4929-b296-046af0a84fdd None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:56.588096 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-e9ed9f53-5f32-4929-b296-046af0a84fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:56.658509 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed9f53-5f32-4929-b296-046af0a84fdd None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:56.663475 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e64cfa-6e25-4eb0-acc6-d567c0c94558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:56.666236 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e64cfa-6e25-4eb0-acc6-d567c0c94558 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:56.666539 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e64cfa-6e25-4eb0-acc6-d567c0c94558 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:56.666887 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e64cfa-6e25-4eb0-acc6-d567c0c94558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:56.699848 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e64cfa-6e25-4eb0-acc6-d567c0c94558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:56.703918 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e64cfa-6e25-4eb0-acc6-d567c0c94558 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:56.707127 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ddef4565-1126-4e72-a13f-999ef37fbe04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18e9fedfd1fd41beb8dcb2d2b44285b8'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:56.709187 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ddef4565-1126-4e72-a13f-999ef37fbe04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18e9fedfd1fd41beb8dcb2d2b44285b8'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:56.726792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ddef4565-1126-4e72-a13f-999ef37fbe04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18e9fedfd1fd41beb8dcb2d2b44285b8'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:56.727529 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ddef4565-1126-4e72-a13f-999ef37fbe04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18e9fedfd1fd41beb8dcb2d2b44285b8'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:56.729306 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 960/1890] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:31:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:31:56.819341 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ddef4565-1126-4e72-a13f-999ef37fbe04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18e9fedfd1fd41beb8dcb2d2b44285b8'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:56.858913 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 931/1891] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:31:56 2021] DELETE /identity/v3/users/18e9fedfd1fd41beb8dcb2d2b44285b8 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:31:57.544153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e64cfa-6e25-4eb0-acc6-d567c0c94558 service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:57.563293 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e64cfa-6e25-4eb0-acc6-d567c0c94558 service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:57.628601 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215f5f9-d510-452e-b25f-a87abf82262f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:57.629587 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215f5f9-d510-452e-b25f-a87abf82262f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:57.629869 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215f5f9-d510-452e-b25f-a87abf82262f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:57.630176 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215f5f9-d510-452e-b25f-a87abf82262f admin admin] PATH_INFO: `/v3/projects/e80ceed0cba0497196e77ab02b69cec7` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:57.631376 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215f5f9-d510-452e-b25f-a87abf82262f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e80ceed0cba0497196e77ab02b69cec7)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:57.633968 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215f5f9-d510-452e-b25f-a87abf82262f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:57.779068 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-c215f5f9-d510-452e-b25f-a87abf82262f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e80ceed0cba0497196e77ab02b69cec7', 'request_id': 'req-c215f5f9-d510-452e-b25f-a87abf82262f'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:57.785905 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-c215f5f9-d510-452e-b25f-a87abf82262f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e80ceed0cba0497196e77ab02b69cec7', 'request_id': 'req-c215f5f9-d510-452e-b25f-a87abf82262f'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:57.840676 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-c215f5f9-d510-452e-b25f-a87abf82262f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e80ceed0cba0497196e77ab02b69cec7', 'request_id': 'req-c215f5f9-d510-452e-b25f-a87abf82262f'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:57.851705 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-c215f5f9-d510-452e-b25f-a87abf82262f admin admin] The token cache is being invalidate because project e80ceed0cba0497196e77ab02b69cec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:31:57.851994 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-c215f5f9-d510-452e-b25f-a87abf82262f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:57.852615 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-c215f5f9-d510-452e-b25f-a87abf82262f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:31:57.854184 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 961/1892] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:31:57 2021] DELETE /identity/v3/projects/e80ceed0cba0497196e77ab02b69cec7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:57.861910 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf05d33-1507-49e0-9819-d6646298e36a None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:57.862400 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf05d33-1507-49e0-9819-d6646298e36a None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:57.864444 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf05d33-1507-49e0-9819-d6646298e36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:57.881011 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-fdf05d33-1507-49e0-9819-d6646298e36a None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:57.882251 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-fdf05d33-1507-49e0-9819-d6646298e36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:57.946495 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 932/1893] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:31:57.954552 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa80cb-8997-4ba5-88a4-76be586b1306 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:57.956341 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa80cb-8997-4ba5-88a4-76be586b1306 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:57.956341 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa80cb-8997-4ba5-88a4-76be586b1306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:57.972958 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-98aa80cb-8997-4ba5-88a4-76be586b1306 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:57.974172 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-98aa80cb-8997-4ba5-88a4-76be586b1306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:57.982014 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 962/1894] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:57.989191 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf05d33-1507-49e0-9819-d6646298e36a None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:57.996462 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf05d33-1507-49e0-9819-d6646298e36a None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:58.002409 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef5322-798c-4fc1-b507-767ef7bbb7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:58.003097 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef5322-798c-4fc1-b507-767ef7bbb7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:58.003951 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef5322-798c-4fc1-b507-767ef7bbb7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:58.003951 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef5322-798c-4fc1-b507-767ef7bbb7b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:58.004363 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef5322-798c-4fc1-b507-767ef7bbb7b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:31:58.004675 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef5322-798c-4fc1-b507-767ef7bbb7b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:58.006668 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef5322-798c-4fc1-b507-767ef7bbb7b1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:58.020490 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 933/1895] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:31:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:31:58.025716 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa80cb-8997-4ba5-88a4-76be586b1306 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:58.046004 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa80cb-8997-4ba5-88a4-76be586b1306 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:58.053331 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbcec1-b5f2-47fb-a64a-2721ac611370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:58.054419 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbcec1-b5f2-47fb-a64a-2721ac611370 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:58.054773 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbcec1-b5f2-47fb-a64a-2721ac611370 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:58.055341 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbcec1-b5f2-47fb-a64a-2721ac611370 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:58.056162 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbcec1-b5f2-47fb-a64a-2721ac611370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:58.058398 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbcec1-b5f2-47fb-a64a-2721ac611370 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:58.124933 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd1bca-0f10-4187-a714-fe217dcc86f0 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:58.127644 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd1bca-0f10-4187-a714-fe217dcc86f0 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:58.128045 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd1bca-0f10-4187-a714-fe217dcc86f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:58.169984 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 963/1896] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:31:58 2021] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:31:58.175092 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbcec1-b5f2-47fb-a64a-2721ac611370 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:58.257787 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbcec1-b5f2-47fb-a64a-2721ac611370 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:58.263064 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1348b23-cff4-4186-a3df-80ca931a8b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:58.263737 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1348b23-cff4-4186-a3df-80ca931a8b06 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:58.264021 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1348b23-cff4-4186-a3df-80ca931a8b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:58.264360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1348b23-cff4-4186-a3df-80ca931a8b06 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:58.265083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1348b23-cff4-4186-a3df-80ca931a8b06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:58.267471 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1348b23-cff4-4186-a3df-80ca931a8b06 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:58.285426 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-12fd1bca-0f10-4187-a714-fe217dcc86f0 None None] MFA Rules not processed for user `76bcad9416ea4ffd966b9827246ef936`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:58.286834 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-12fd1bca-0f10-4187-a714-fe217dcc86f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:58.372226 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 934/1897] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:58 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:31:58.379083 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd1bca-0f10-4187-a714-fe217dcc86f0 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:58.381629 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 964/1898] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:31:58 2021] POST /identity/v3/users => generated 284 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:31:58.383757 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-12fd1bca-0f10-4187-a714-fe217dcc86f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:58.385081 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1348b23-cff4-4186-a3df-80ca931a8b06 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:58.408813 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1348b23-cff4-4186-a3df-80ca931a8b06 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:58.422300 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570b305-d92f-40f1-a122-ca85be7b57e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:58.423581 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570b305-d92f-40f1-a122-ca85be7b57e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:58.423862 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570b305-d92f-40f1-a122-ca85be7b57e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:58.424122 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570b305-d92f-40f1-a122-ca85be7b57e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:58.424895 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570b305-d92f-40f1-a122-ca85be7b57e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:58.426516 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570b305-d92f-40f1-a122-ca85be7b57e3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:58.440372 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 965/1899] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:58 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:31:58.444029 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570b305-d92f-40f1-a122-ca85be7b57e3 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:58.458525 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570b305-d92f-40f1-a122-ca85be7b57e3 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:58.462117 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd1bca-0f10-4187-a714-fe217dcc86f0 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:58.464551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf8ffa-bc5b-4830-8488-814e3af38ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:58.465394 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf8ffa-bc5b-4830-8488-814e3af38ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:58.465863 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf8ffa-bc5b-4830-8488-814e3af38ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:58.466182 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c748d-e91b-4ef2-ab4b-c0eb716cfe12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:58.466457 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf8ffa-bc5b-4830-8488-814e3af38ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:58.466837 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c748d-e91b-4ef2-ab4b-c0eb716cfe12 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:58.467117 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c748d-e91b-4ef2-ab4b-c0eb716cfe12 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:58.467493 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c748d-e91b-4ef2-ab4b-c0eb716cfe12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:58.467601 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf8ffa-bc5b-4830-8488-814e3af38ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:58.472574 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf8ffa-bc5b-4830-8488-814e3af38ec6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:58.480325 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c748d-e91b-4ef2-ab4b-c0eb716cfe12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:58.482095 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c748d-e91b-4ef2-ab4b-c0eb716cfe12 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:58.494924 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 935/1900] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:31:58 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:31:58.496180 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 966/1901] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:58 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:31:58.502803 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c748d-e91b-4ef2-ab4b-c0eb716cfe12 service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:58.522269 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c748d-e91b-4ef2-ab4b-c0eb716cfe12 service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:58.531436 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b1ed5-fa87-4020-ae8e-f21f4ff2f339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:58.533666 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b1ed5-fa87-4020-ae8e-f21f4ff2f339 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:58.534170 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b1ed5-fa87-4020-ae8e-f21f4ff2f339 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:58.534757 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b1ed5-fa87-4020-ae8e-f21f4ff2f339 admin admin] PATH_INFO: `/v3/projects/910c678b96e84ceb88998fca81ac97da/users/e5e1a7228ad4458fb768c168e2b669ef/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:58.558529 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b1ed5-fa87-4020-ae8e-f21f4ff2f339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=910c678b96e84ceb88998fca81ac97da, user_id=e5e1a7228ad4458fb768c168e2b669ef, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:58.563681 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b1ed5-fa87-4020-ae8e-f21f4ff2f339 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:58.665177 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 936/1902] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:31:58 2021] PUT /identity/v3/projects/910c678b96e84ceb88998fca81ac97da/users/e5e1a7228ad4458fb768c168e2b669ef/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:58.678553 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebe1f2-86f7-4e96-b70f-2b08b733f2cd None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:58.679372 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebe1f2-86f7-4e96-b70f-2b08b733f2cd None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:58.679372 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebe1f2-86f7-4e96-b70f-2b08b733f2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:58.713792 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f2ebe1f2-86f7-4e96-b70f-2b08b733f2cd None None] MFA Rules not processed for user `e5e1a7228ad4458fb768c168e2b669ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:58.715190 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f2ebe1f2-86f7-4e96-b70f-2b08b733f2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:58.777968 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 967/1903] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:58 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:31:58.783877 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b1ed5-fa87-4020-ae8e-f21f4ff2f339 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:58.847297 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b1ed5-fa87-4020-ae8e-f21f4ff2f339 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:58.853122 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe920f-73f0-4861-a798-229ea4dc522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:58.853793 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe920f-73f0-4861-a798-229ea4dc522e admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:58.854073 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe920f-73f0-4861-a798-229ea4dc522e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:58.854343 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe920f-73f0-4861-a798-229ea4dc522e admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:58.855037 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe920f-73f0-4861-a798-229ea4dc522e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:58.857070 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe920f-73f0-4861-a798-229ea4dc522e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:58.999828 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 937/1904] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:31:58 2021] POST /identity/v3/projects => generated 367 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:31:59.003479 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebe1f2-86f7-4e96-b70f-2b08b733f2cd None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:59.013873 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebe1f2-86f7-4e96-b70f-2b08b733f2cd None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:59.077698 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d4146-0534-440c-b372-c46e401c99fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:59.077698 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d4146-0534-440c-b372-c46e401c99fc admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:59.077698 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d4146-0534-440c-b372-c46e401c99fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:59.077698 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d4146-0534-440c-b372-c46e401c99fc admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:59.078041 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d4146-0534-440c-b372-c46e401c99fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:59.079459 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d4146-0534-440c-b372-c46e401c99fc admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:59.183661 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 968/1905] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:31:59 2021] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:31:59.188600 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe920f-73f0-4861-a798-229ea4dc522e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:59.200281 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe920f-73f0-4861-a798-229ea4dc522e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:59.206303 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f25a41-d9af-4175-b156-0e6eb6a0ec19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:59.207047 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f25a41-d9af-4175-b156-0e6eb6a0ec19 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:59.207421 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f25a41-d9af-4175-b156-0e6eb6a0ec19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:59.207705 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f25a41-d9af-4175-b156-0e6eb6a0ec19 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:59.208462 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f25a41-d9af-4175-b156-0e6eb6a0ec19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:59.210049 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f25a41-d9af-4175-b156-0e6eb6a0ec19 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:59.221488 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 938/1906] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:59 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:31:59.225696 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d4146-0534-440c-b372-c46e401c99fc admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:59.237063 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d4146-0534-440c-b372-c46e401c99fc admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:59.242154 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6918ad-638c-4e84-8254-466375a18983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:59.243044 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6918ad-638c-4e84-8254-466375a18983 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:59.243329 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6918ad-638c-4e84-8254-466375a18983 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:59.243606 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6918ad-638c-4e84-8254-466375a18983 admin admin] PATH_INFO: `/v3/projects/cb6b78b2f6654e879c40a7d0b37cd015/users/cfe52d9387ac48dfbfbb6b22a23242c0/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:59.261104 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6918ad-638c-4e84-8254-466375a18983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb6b78b2f6654e879c40a7d0b37cd015, user_id=cfe52d9387ac48dfbfbb6b22a23242c0, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:59.264116 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6918ad-638c-4e84-8254-466375a18983 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:59.351908 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 969/1907] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:31:59 2021] PUT /identity/v3/projects/cb6b78b2f6654e879c40a7d0b37cd015/users/cfe52d9387ac48dfbfbb6b22a23242c0/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:31:59.356195 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f25a41-d9af-4175-b156-0e6eb6a0ec19 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:59.368575 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f25a41-d9af-4175-b156-0e6eb6a0ec19 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:59.430311 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726ff1b-5da6-4477-b12a-4f7b2d84a97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:59.430983 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726ff1b-5da6-4477-b12a-4f7b2d84a97e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:59.431268 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726ff1b-5da6-4477-b12a-4f7b2d84a97e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:59.431543 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726ff1b-5da6-4477-b12a-4f7b2d84a97e admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:59.432265 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726ff1b-5da6-4477-b12a-4f7b2d84a97e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:59.433898 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726ff1b-5da6-4477-b12a-4f7b2d84a97e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:59.444113 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 939/1908] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:31:59 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:31:59.448168 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6918ad-638c-4e84-8254-466375a18983 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:59.458314 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6918ad-638c-4e84-8254-466375a18983 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:59.463440 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef97fc-452e-4c04-b2c2-33a7f0d03fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:59.464353 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef97fc-452e-4c04-b2c2-33a7f0d03fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:59.464634 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef97fc-452e-4c04-b2c2-33a7f0d03fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:59.464995 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef97fc-452e-4c04-b2c2-33a7f0d03fe4 admin admin] PATH_INFO: `/v3/projects/cb6b78b2f6654e879c40a7d0b37cd015/users/cfe52d9387ac48dfbfbb6b22a23242c0/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:59.466997 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef97fc-452e-4c04-b2c2-33a7f0d03fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb6b78b2f6654e879c40a7d0b37cd015, user_id=cfe52d9387ac48dfbfbb6b22a23242c0, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:59.469885 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef97fc-452e-4c04-b2c2-33a7f0d03fe4 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:59.480685 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 970/1909] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:31:59 2021] PUT /identity/v3/projects/cb6b78b2f6654e879c40a7d0b37cd015/users/cfe52d9387ac48dfbfbb6b22a23242c0/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:31:59.491496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa739b-3ebe-4400-909a-688b7ee58892 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:59.491772 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa739b-3ebe-4400-909a-688b7ee58892 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:59.492053 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa739b-3ebe-4400-909a-688b7ee58892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:59.519343 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-a2aa739b-3ebe-4400-909a-688b7ee58892 None None] MFA Rules not processed for user `cfe52d9387ac48dfbfbb6b22a23242c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:31:59.520569 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a2aa739b-3ebe-4400-909a-688b7ee58892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:59.588206 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 940/1910] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:31:59 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:31:59.599853 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef97fc-452e-4c04-b2c2-33a7f0d03fe4 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:59.601598 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-60ef97fc-452e-4c04-b2c2-33a7f0d03fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:31:59.660843 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef97fc-452e-4c04-b2c2-33a7f0d03fe4 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:59.664605 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f69772-2240-4193-9db6-ec4ae02713df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:59.665301 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f69772-2240-4193-9db6-ec4ae02713df service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:59.665586 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f69772-2240-4193-9db6-ec4ae02713df service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:59.665862 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f69772-2240-4193-9db6-ec4ae02713df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:59.677522 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f69772-2240-4193-9db6-ec4ae02713df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:31:59.680415 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f69772-2240-4193-9db6-ec4ae02713df service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:31:59.691213 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 971/1911] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:31:59 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:31:59.925327 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa739b-3ebe-4400-909a-688b7ee58892 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:31:59.936071 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa739b-3ebe-4400-909a-688b7ee58892 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:31:59.940350 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f78c1-144d-42b7-8729-808bacd79848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:31:59.941070 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f78c1-144d-42b7-8729-808bacd79848 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:31:59.941381 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f78c1-144d-42b7-8729-808bacd79848 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:31:59.941650 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f78c1-144d-42b7-8729-808bacd79848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:31:59.998973 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f78c1-144d-42b7-8729-808bacd79848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:00.000398 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f78c1-144d-42b7-8729-808bacd79848 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:00.009864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 941/1912] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:31:59 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:32:00.290011 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48794bc4-4b35-4ed9-bd80-4628789b8995 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:00.290371 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48794bc4-4b35-4ed9-bd80-4628789b8995 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:00.290567 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48794bc4-4b35-4ed9-bd80-4628789b8995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:00.310079 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-48794bc4-4b35-4ed9-bd80-4628789b8995 None None] MFA Rules not processed for user `76bcad9416ea4ffd966b9827246ef936`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:00.311524 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-48794bc4-4b35-4ed9-bd80-4628789b8995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:00.382716 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 972/1913] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:00 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:32:02.137261 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f78c1-144d-42b7-8729-808bacd79848 service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:02.139124 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-388f78c1-144d-42b7-8729-808bacd79848 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:02.224814 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f78c1-144d-42b7-8729-808bacd79848 service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:02.229693 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554b463-fe74-4475-a676-6b18f5d1af70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:02.230571 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554b463-fe74-4475-a676-6b18f5d1af70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:02.233836 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554b463-fe74-4475-a676-6b18f5d1af70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:02.233836 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554b463-fe74-4475-a676-6b18f5d1af70 admin admin] PATH_INFO: `/v3/users/63916350d84642b0b2606341d71651f8` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:02.237181 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554b463-fe74-4475-a676-6b18f5d1af70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63916350d84642b0b2606341d71651f8)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:02.237729 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554b463-fe74-4475-a676-6b18f5d1af70 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:02.493620 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-c554b463-fe74-4475-a676-6b18f5d1af70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63916350d84642b0b2606341d71651f8'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:02.494303 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-c554b463-fe74-4475-a676-6b18f5d1af70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63916350d84642b0b2606341d71651f8'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:02.501131 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-c554b463-fe74-4475-a676-6b18f5d1af70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63916350d84642b0b2606341d71651f8'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:02.501757 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-c554b463-fe74-4475-a676-6b18f5d1af70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63916350d84642b0b2606341d71651f8'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:02.595109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-c554b463-fe74-4475-a676-6b18f5d1af70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63916350d84642b0b2606341d71651f8'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:02.616073 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 942/1914] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:32:02 2021] DELETE /identity/v3/users/63916350d84642b0b2606341d71651f8 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:32:02.859373 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48794bc4-4b35-4ed9-bd80-4628789b8995 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:02.870663 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48794bc4-4b35-4ed9-bd80-4628789b8995 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:02.928392 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e4179-199a-4c43-90b8-43850213739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:02.929545 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e4179-199a-4c43-90b8-43850213739d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:02.929824 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e4179-199a-4c43-90b8-43850213739d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:02.930096 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e4179-199a-4c43-90b8-43850213739d admin admin] PATH_INFO: `/v3/projects/b8f4319d61634014a030eb7b9b741e92` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:02.931261 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e4179-199a-4c43-90b8-43850213739d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8f4319d61634014a030eb7b9b741e92)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:02.933209 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e4179-199a-4c43-90b8-43850213739d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:03.073315 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-319e4179-199a-4c43-90b8-43850213739d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8f4319d61634014a030eb7b9b741e92', 'request_id': 'req-319e4179-199a-4c43-90b8-43850213739d'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:03.081187 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-319e4179-199a-4c43-90b8-43850213739d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8f4319d61634014a030eb7b9b741e92', 'request_id': 'req-319e4179-199a-4c43-90b8-43850213739d'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:03.199318 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823d5a0-3390-463d-9020-df4e93cad709 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:03.199318 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823d5a0-3390-463d-9020-df4e93cad709 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:03.199318 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823d5a0-3390-463d-9020-df4e93cad709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:03.221456 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-9823d5a0-3390-463d-9020-df4e93cad709 None None] MFA Rules not processed for user `589eca6a184e4505a0c0f97efe65892e`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:03.222716 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-9823d5a0-3390-463d-9020-df4e93cad709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:03.235712 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-319e4179-199a-4c43-90b8-43850213739d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8f4319d61634014a030eb7b9b741e92', 'request_id': 'req-319e4179-199a-4c43-90b8-43850213739d'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:03.251334 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-319e4179-199a-4c43-90b8-43850213739d admin admin] The token cache is being invalidate because project b8f4319d61634014a030eb7b9b741e92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:32:03.251334 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-319e4179-199a-4c43-90b8-43850213739d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:03.251334 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-319e4179-199a-4c43-90b8-43850213739d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:03.251334 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 973/1915] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:32:02 2021] DELETE /identity/v3/projects/b8f4319d61634014a030eb7b9b741e92 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:32:03.255167 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739f57c-47d5-4327-98f8-6e600175dbac None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:03.255455 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739f57c-47d5-4327-98f8-6e600175dbac None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:03.255760 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739f57c-47d5-4327-98f8-6e600175dbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:03.275395 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-1739f57c-47d5-4327-98f8-6e600175dbac None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:03.276770 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-1739f57c-47d5-4327-98f8-6e600175dbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:03.283639 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 943/1916] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:03 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:32:03.386007 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 974/1917] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:32:03.387942 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dcf04-f806-4201-9a6f-1848e2733220 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:03.389068 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dcf04-f806-4201-9a6f-1848e2733220 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:03.389590 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dcf04-f806-4201-9a6f-1848e2733220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:03.425495 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-8e6dcf04-f806-4201-9a6f-1848e2733220 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:03.427965 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8e6dcf04-f806-4201-9a6f-1848e2733220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:03.455772 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 944/1918] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:32:03.460182 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739f57c-47d5-4327-98f8-6e600175dbac None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:03.471640 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739f57c-47d5-4327-98f8-6e600175dbac None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:03.478097 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285d69b-8906-42be-a9d5-a98961c6e7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:03.478770 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285d69b-8906-42be-a9d5-a98961c6e7ad admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:03.479055 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285d69b-8906-42be-a9d5-a98961c6e7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:03.479377 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285d69b-8906-42be-a9d5-a98961c6e7ad admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:03.480055 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285d69b-8906-42be-a9d5-a98961c6e7ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:32:03.480662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285d69b-8906-42be-a9d5-a98961c6e7ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:03.491556 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285d69b-8906-42be-a9d5-a98961c6e7ad admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:03.497312 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 975/1919] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:32:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:32:03.506437 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dcf04-f806-4201-9a6f-1848e2733220 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:03.517848 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dcf04-f806-4201-9a6f-1848e2733220 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:03.523195 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841ca3a-34f9-4ad0-9779-95eedec8e1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:03.523871 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841ca3a-34f9-4ad0-9779-95eedec8e1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:03.524213 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841ca3a-34f9-4ad0-9779-95eedec8e1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:03.534327 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841ca3a-34f9-4ad0-9779-95eedec8e1f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:03.534327 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841ca3a-34f9-4ad0-9779-95eedec8e1f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:03.535801 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841ca3a-34f9-4ad0-9779-95eedec8e1f9 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:03.666705 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 945/1920] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:32:03 2021] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:32:03.670664 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285d69b-8906-42be-a9d5-a98961c6e7ad admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:03.681935 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285d69b-8906-42be-a9d5-a98961c6e7ad admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:03.746428 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7785-7262-48a3-974f-fc50ca391ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:03.747261 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7785-7262-48a3-974f-fc50ca391ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:03.747616 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7785-7262-48a3-974f-fc50ca391ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:03.747964 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7785-7262-48a3-974f-fc50ca391ef2 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:03.748752 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf7785-7262-48a3-974f-fc50ca391ef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:03.752892 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf7785-7262-48a3-974f-fc50ca391ef2 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:03.819227 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 976/1921] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:32:03 2021] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:32:03.823752 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841ca3a-34f9-4ad0-9779-95eedec8e1f9 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:03.838074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841ca3a-34f9-4ad0-9779-95eedec8e1f9 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:03.846883 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb41b0-57c8-4a22-b6e0-e9f52df4af7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:03.847353 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb41b0-57c8-4a22-b6e0-e9f52df4af7a admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:03.847443 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb41b0-57c8-4a22-b6e0-e9f52df4af7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:03.847718 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb41b0-57c8-4a22-b6e0-e9f52df4af7a admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:03.848626 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb41b0-57c8-4a22-b6e0-e9f52df4af7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:03.850319 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb41b0-57c8-4a22-b6e0-e9f52df4af7a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:03.865180 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 946/1922] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:32:03 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:32:03.877092 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7785-7262-48a3-974f-fc50ca391ef2 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:03.890263 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7785-7262-48a3-974f-fc50ca391ef2 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:03.896795 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be800d1e-7765-41b4-8064-bd0466d7ab0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:03.901454 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be800d1e-7765-41b4-8064-bd0466d7ab0d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:03.901454 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be800d1e-7765-41b4-8064-bd0466d7ab0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:03.901454 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be800d1e-7765-41b4-8064-bd0466d7ab0d admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:03.901454 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be800d1e-7765-41b4-8064-bd0466d7ab0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:03.901454 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be800d1e-7765-41b4-8064-bd0466d7ab0d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:03.911598 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 977/1923] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:32:03 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:32:03.916329 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb41b0-57c8-4a22-b6e0-e9f52df4af7a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:03.929590 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb41b0-57c8-4a22-b6e0-e9f52df4af7a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:03.934539 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d073eab-25d5-47ac-a8e3-ef3f9da7c85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:03.935443 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d073eab-25d5-47ac-a8e3-ef3f9da7c85f admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:03.935721 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d073eab-25d5-47ac-a8e3-ef3f9da7c85f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:03.936049 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d073eab-25d5-47ac-a8e3-ef3f9da7c85f admin admin] PATH_INFO: `/v3/projects/6356696117f147108a8a29d46bfdc4c7/users/1ff38ccec60c47a5aee0cd620d2c8c15/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:03.951429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d073eab-25d5-47ac-a8e3-ef3f9da7c85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6356696117f147108a8a29d46bfdc4c7, user_id=1ff38ccec60c47a5aee0cd620d2c8c15, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:03.954367 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d073eab-25d5-47ac-a8e3-ef3f9da7c85f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:04.081910 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 947/1924] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:32:03 2021] PUT /identity/v3/projects/6356696117f147108a8a29d46bfdc4c7/users/1ff38ccec60c47a5aee0cd620d2c8c15/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:32:04.146467 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4be484-49c8-4860-9f8f-efd610a86462 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:04.147230 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4be484-49c8-4860-9f8f-efd610a86462 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:04.147230 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4be484-49c8-4860-9f8f-efd610a86462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:04.178330 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-ff4be484-49c8-4860-9f8f-efd610a86462 None None] MFA Rules not processed for user `1ff38ccec60c47a5aee0cd620d2c8c15`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:04.180037 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-ff4be484-49c8-4860-9f8f-efd610a86462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:04.295274 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 978/1925] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:04 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:32:04.299120 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d073eab-25d5-47ac-a8e3-ef3f9da7c85f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:04.412146 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d073eab-25d5-47ac-a8e3-ef3f9da7c85f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:04.421472 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febeaeb-320a-44c8-8c57-c37f840176a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:04.422206 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febeaeb-320a-44c8-8c57-c37f840176a5 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:04.429270 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febeaeb-320a-44c8-8c57-c37f840176a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:04.429270 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febeaeb-320a-44c8-8c57-c37f840176a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:04.429270 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febeaeb-320a-44c8-8c57-c37f840176a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:04.429270 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febeaeb-320a-44c8-8c57-c37f840176a5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:04.528186 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 948/1926] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:32:04 2021] POST /identity/v3/projects => generated 373 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:32:04.532606 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4be484-49c8-4860-9f8f-efd610a86462 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:04.543211 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4be484-49c8-4860-9f8f-efd610a86462 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:04.638154 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded523c8-38b4-4d0e-ae55-29c89440a31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:04.639236 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded523c8-38b4-4d0e-ae55-29c89440a31c admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:04.639236 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded523c8-38b4-4d0e-ae55-29c89440a31c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:04.639629 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded523c8-38b4-4d0e-ae55-29c89440a31c admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:04.640357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded523c8-38b4-4d0e-ae55-29c89440a31c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:04.643256 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded523c8-38b4-4d0e-ae55-29c89440a31c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:04.722025 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 979/1927] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:32:04 2021] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:32:04.723403 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febeaeb-320a-44c8-8c57-c37f840176a5 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:04.733960 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febeaeb-320a-44c8-8c57-c37f840176a5 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:04.739735 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c98561-67f6-4d11-b813-b11860fc3be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:04.740425 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c98561-67f6-4d11-b813-b11860fc3be4 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:04.740711 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c98561-67f6-4d11-b813-b11860fc3be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:04.741016 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c98561-67f6-4d11-b813-b11860fc3be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:04.741792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c98561-67f6-4d11-b813-b11860fc3be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:04.743365 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c98561-67f6-4d11-b813-b11860fc3be4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:04.754981 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 949/1928] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:32:04 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:32:04.759155 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded523c8-38b4-4d0e-ae55-29c89440a31c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:04.770202 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded523c8-38b4-4d0e-ae55-29c89440a31c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:04.776481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895149a-868a-452a-b25a-ba0083757c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:04.777500 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895149a-868a-452a-b25a-ba0083757c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:04.777857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895149a-868a-452a-b25a-ba0083757c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:04.778204 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895149a-868a-452a-b25a-ba0083757c55 admin admin] PATH_INFO: `/v3/projects/bdd9a85d8a1b4b458862e2d7fa91b181/users/d5d26134c0814223b3675c45a284cc12/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:04.794939 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895149a-868a-452a-b25a-ba0083757c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd9a85d8a1b4b458862e2d7fa91b181, user_id=d5d26134c0814223b3675c45a284cc12, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:04.799018 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895149a-868a-452a-b25a-ba0083757c55 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:04.886503 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 980/1929] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:32:04 2021] PUT /identity/v3/projects/bdd9a85d8a1b4b458862e2d7fa91b181/users/d5d26134c0814223b3675c45a284cc12/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:32:04.890469 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c98561-67f6-4d11-b813-b11860fc3be4 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:04.900483 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c98561-67f6-4d11-b813-b11860fc3be4 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:04.966979 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162eed5-d6da-44af-a00e-c7a2c2b5a96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:04.967668 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162eed5-d6da-44af-a00e-c7a2c2b5a96a admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:04.967955 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162eed5-d6da-44af-a00e-c7a2c2b5a96a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:04.968233 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162eed5-d6da-44af-a00e-c7a2c2b5a96a admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:04.969609 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162eed5-d6da-44af-a00e-c7a2c2b5a96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:04.973373 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162eed5-d6da-44af-a00e-c7a2c2b5a96a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:04.984310 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 950/1930] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:32:04 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:32:04.989217 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895149a-868a-452a-b25a-ba0083757c55 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:04.999933 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895149a-868a-452a-b25a-ba0083757c55 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:05.005818 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dba48-1ada-4301-b241-1a9123190cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:05.009548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dba48-1ada-4301-b241-1a9123190cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:05.009548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dba48-1ada-4301-b241-1a9123190cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:05.009548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dba48-1ada-4301-b241-1a9123190cf0 admin admin] PATH_INFO: `/v3/projects/bdd9a85d8a1b4b458862e2d7fa91b181/users/d5d26134c0814223b3675c45a284cc12/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:05.009548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48dba48-1ada-4301-b241-1a9123190cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd9a85d8a1b4b458862e2d7fa91b181, user_id=d5d26134c0814223b3675c45a284cc12, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:05.012055 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48dba48-1ada-4301-b241-1a9123190cf0 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:05.023873 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 981/1931] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:32:04 2021] PUT /identity/v3/projects/bdd9a85d8a1b4b458862e2d7fa91b181/users/d5d26134c0814223b3675c45a284cc12/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:32:05.034521 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072214a-597e-40f6-978b-74bcd711df29 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:05.034815 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072214a-597e-40f6-978b-74bcd711df29 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:05.035094 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072214a-597e-40f6-978b-74bcd711df29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:05.062223 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-d072214a-597e-40f6-978b-74bcd711df29 None None] MFA Rules not processed for user `d5d26134c0814223b3675c45a284cc12`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:05.064103 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d072214a-597e-40f6-978b-74bcd711df29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:05.137036 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 951/1932] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:05 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:32:05.148115 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dba48-1ada-4301-b241-1a9123190cf0 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:05.149860 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a48dba48-1ada-4301-b241-1a9123190cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:05.205822 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dba48-1ada-4301-b241-1a9123190cf0 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:05.209590 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada54cd-cf37-4fe2-8ca8-d8840d0b693a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:05.210236 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada54cd-cf37-4fe2-8ca8-d8840d0b693a service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:05.210552 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada54cd-cf37-4fe2-8ca8-d8840d0b693a service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:05.210824 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada54cd-cf37-4fe2-8ca8-d8840d0b693a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:05.220398 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada54cd-cf37-4fe2-8ca8-d8840d0b693a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:05.221904 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada54cd-cf37-4fe2-8ca8-d8840d0b693a service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:05.231484 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 982/1933] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:32:05 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:32:05.485623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072214a-597e-40f6-978b-74bcd711df29 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:05.495796 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072214a-597e-40f6-978b-74bcd711df29 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:05.499526 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d419f-0d09-4a6f-9ce0-a6718b24a0bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:05.500187 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d419f-0d09-4a6f-9ce0-a6718b24a0bb service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:05.500678 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d419f-0d09-4a6f-9ce0-a6718b24a0bb service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:05.501060 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d419f-0d09-4a6f-9ce0-a6718b24a0bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:05.565301 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d419f-0d09-4a6f-9ce0-a6718b24a0bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:05.566788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d419f-0d09-4a6f-9ce0-a6718b24a0bb service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:05.576147 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 952/1934] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:32:05 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:32:06.670747 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada54cd-cf37-4fe2-8ca8-d8840d0b693a service cinder] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:06.672311 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-4ada54cd-cf37-4fe2-8ca8-d8840d0b693a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:06.745216 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada54cd-cf37-4fe2-8ca8-d8840d0b693a service cinder] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:06.749908 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284b464-956d-462f-91eb-411135951748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:06.751416 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284b464-956d-462f-91eb-411135951748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:06.751762 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284b464-956d-462f-91eb-411135951748 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:06.752114 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284b464-956d-462f-91eb-411135951748 admin admin] PATH_INFO: `/v3/users/e5e1a7228ad4458fb768c168e2b669ef` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:06.753450 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284b464-956d-462f-91eb-411135951748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5e1a7228ad4458fb768c168e2b669ef)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:06.755426 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284b464-956d-462f-91eb-411135951748 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:06.961116 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3284b464-956d-462f-91eb-411135951748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5e1a7228ad4458fb768c168e2b669ef'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:06.975403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3284b464-956d-462f-91eb-411135951748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5e1a7228ad4458fb768c168e2b669ef'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:06.986011 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3284b464-956d-462f-91eb-411135951748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5e1a7228ad4458fb768c168e2b669ef'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:06.986770 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3284b464-956d-462f-91eb-411135951748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5e1a7228ad4458fb768c168e2b669ef'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:07.070038 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3284b464-956d-462f-91eb-411135951748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5e1a7228ad4458fb768c168e2b669ef'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:07.080899 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 983/1935] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:32:06 2021] DELETE /identity/v3/users/e5e1a7228ad4458fb768c168e2b669ef => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:32:07.085494 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16849562-88e5-407f-8129-087f0d8c1c2f None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:07.086524 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16849562-88e5-407f-8129-087f0d8c1c2f None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:07.087016 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16849562-88e5-407f-8129-087f0d8c1c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:07.107269 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-16849562-88e5-407f-8129-087f0d8c1c2f None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:07.108747 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-16849562-88e5-407f-8129-087f0d8c1c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:07.197850 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 953/1936] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:32:07.207966 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284b464-956d-462f-91eb-411135951748 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:07.209507 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-3284b464-956d-462f-91eb-411135951748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:07.266872 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284b464-956d-462f-91eb-411135951748 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:07.270668 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f9907-4e6d-498e-8e05-744e43e1ff9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:07.271325 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f9907-4e6d-498e-8e05-744e43e1ff9c service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:07.271611 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f9907-4e6d-498e-8e05-744e43e1ff9c service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:07.272068 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f9907-4e6d-498e-8e05-744e43e1ff9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:07.283482 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f9907-4e6d-498e-8e05-744e43e1ff9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:07.285967 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f9907-4e6d-498e-8e05-744e43e1ff9c service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:07.297636 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 984/1937] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:32:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:32:07.778919 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16849562-88e5-407f-8129-087f0d8c1c2f None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:07.780382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-16849562-88e5-407f-8129-087f0d8c1c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:07.794484 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16849562-88e5-407f-8129-087f0d8c1c2f None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:07.817111 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12f9c8-2035-4ebb-a302-2dadbf17a58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:07.817998 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12f9c8-2035-4ebb-a302-2dadbf17a58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:07.819635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12f9c8-2035-4ebb-a302-2dadbf17a58b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:07.820062 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12f9c8-2035-4ebb-a302-2dadbf17a58b admin admin] PATH_INFO: `/v3/projects/910c678b96e84ceb88998fca81ac97da` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:07.836196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12f9c8-2035-4ebb-a302-2dadbf17a58b admin admin] RBAC: Authorizing `identity:delete_project(project_id=910c678b96e84ceb88998fca81ac97da)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:07.836196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12f9c8-2035-4ebb-a302-2dadbf17a58b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:07.960501 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0e12f9c8-2035-4ebb-a302-2dadbf17a58b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '910c678b96e84ceb88998fca81ac97da', 'request_id': 'req-0e12f9c8-2035-4ebb-a302-2dadbf17a58b'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:07.966557 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0e12f9c8-2035-4ebb-a302-2dadbf17a58b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '910c678b96e84ceb88998fca81ac97da', 'request_id': 'req-0e12f9c8-2035-4ebb-a302-2dadbf17a58b'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:08.046370 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0e12f9c8-2035-4ebb-a302-2dadbf17a58b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '910c678b96e84ceb88998fca81ac97da', 'request_id': 'req-0e12f9c8-2035-4ebb-a302-2dadbf17a58b'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:08.058118 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0e12f9c8-2035-4ebb-a302-2dadbf17a58b admin admin] The token cache is being invalidate because project 910c678b96e84ceb88998fca81ac97da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:32:08.058404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0e12f9c8-2035-4ebb-a302-2dadbf17a58b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:08.059036 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0e12f9c8-2035-4ebb-a302-2dadbf17a58b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:08.060599 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 954/1938] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:32:07 2021] DELETE /identity/v3/projects/910c678b96e84ceb88998fca81ac97da => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:32:08.065382 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f9907-4e6d-498e-8e05-744e43e1ff9c service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:08.075254 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f9907-4e6d-498e-8e05-744e43e1ff9c service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:08.129788 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddf4aa-ec61-494c-9128-04222a71f772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:08.130706 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddf4aa-ec61-494c-9128-04222a71f772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:08.130990 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddf4aa-ec61-494c-9128-04222a71f772 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:08.131265 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddf4aa-ec61-494c-9128-04222a71f772 admin admin] PATH_INFO: `/v3/users/cfe52d9387ac48dfbfbb6b22a23242c0` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:08.132438 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddf4aa-ec61-494c-9128-04222a71f772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe52d9387ac48dfbfbb6b22a23242c0)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:08.134377 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddf4aa-ec61-494c-9128-04222a71f772 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:08.314105 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f8ddf4aa-ec61-494c-9128-04222a71f772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe52d9387ac48dfbfbb6b22a23242c0'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:08.328482 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f8ddf4aa-ec61-494c-9128-04222a71f772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe52d9387ac48dfbfbb6b22a23242c0'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:08.335484 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f8ddf4aa-ec61-494c-9128-04222a71f772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe52d9387ac48dfbfbb6b22a23242c0'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:08.336214 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f8ddf4aa-ec61-494c-9128-04222a71f772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe52d9387ac48dfbfbb6b22a23242c0'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:08.400668 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f8ddf4aa-ec61-494c-9128-04222a71f772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe52d9387ac48dfbfbb6b22a23242c0'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:08.407353 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 985/1939] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:32:08 2021] DELETE /identity/v3/users/cfe52d9387ac48dfbfbb6b22a23242c0 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:32:08.853437 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12f9c8-2035-4ebb-a302-2dadbf17a58b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:08.860377 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-0e12f9c8-2035-4ebb-a302-2dadbf17a58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:08.870061 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12f9c8-2035-4ebb-a302-2dadbf17a58b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:08.956944 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afe4ef-6a62-445d-8da4-96e8c27b4c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:08.957816 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afe4ef-6a62-445d-8da4-96e8c27b4c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:08.958089 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afe4ef-6a62-445d-8da4-96e8c27b4c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:08.958362 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afe4ef-6a62-445d-8da4-96e8c27b4c2e admin admin] PATH_INFO: `/v3/projects/cb6b78b2f6654e879c40a7d0b37cd015` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:08.959554 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afe4ef-6a62-445d-8da4-96e8c27b4c2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb6b78b2f6654e879c40a7d0b37cd015)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:08.961533 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afe4ef-6a62-445d-8da4-96e8c27b4c2e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:09.128327 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-51afe4ef-6a62-445d-8da4-96e8c27b4c2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb6b78b2f6654e879c40a7d0b37cd015', 'request_id': 'req-51afe4ef-6a62-445d-8da4-96e8c27b4c2e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:09.136407 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-51afe4ef-6a62-445d-8da4-96e8c27b4c2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb6b78b2f6654e879c40a7d0b37cd015', 'request_id': 'req-51afe4ef-6a62-445d-8da4-96e8c27b4c2e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:09.228961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-51afe4ef-6a62-445d-8da4-96e8c27b4c2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb6b78b2f6654e879c40a7d0b37cd015', 'request_id': 'req-51afe4ef-6a62-445d-8da4-96e8c27b4c2e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:09.239487 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-51afe4ef-6a62-445d-8da4-96e8c27b4c2e admin admin] The token cache is being invalidate because project cb6b78b2f6654e879c40a7d0b37cd015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:32:09.239776 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-51afe4ef-6a62-445d-8da4-96e8c27b4c2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:09.240398 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-51afe4ef-6a62-445d-8da4-96e8c27b4c2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:09.241983 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 955/1940] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:32:08 2021] DELETE /identity/v3/projects/cb6b78b2f6654e879c40a7d0b37cd015 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:32:09.247614 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146cf2f-4780-4145-acd2-a385f39836df None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:09.248117 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146cf2f-4780-4145-acd2-a385f39836df None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:09.248217 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146cf2f-4780-4145-acd2-a385f39836df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:09.267431 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-d146cf2f-4780-4145-acd2-a385f39836df None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:09.268929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-d146cf2f-4780-4145-acd2-a385f39836df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:09.335514 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 986/1941] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:32:09.337327 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b334dbc-4be6-47de-8aaa-b15455189ec1 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:09.337618 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b334dbc-4be6-47de-8aaa-b15455189ec1 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:09.337894 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b334dbc-4be6-47de-8aaa-b15455189ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:09.358008 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-2b334dbc-4be6-47de-8aaa-b15455189ec1 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:09.359326 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-2b334dbc-4be6-47de-8aaa-b15455189ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:09.372807 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 956/1942] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:32:09.373909 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146cf2f-4780-4145-acd2-a385f39836df None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:09.383878 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146cf2f-4780-4145-acd2-a385f39836df None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:09.388622 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c6916-3a1b-4e65-9c47-1dc9f1aa2281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:09.389423 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c6916-3a1b-4e65-9c47-1dc9f1aa2281 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:09.389594 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c6916-3a1b-4e65-9c47-1dc9f1aa2281 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:09.390094 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c6916-3a1b-4e65-9c47-1dc9f1aa2281 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:09.391143 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c6916-3a1b-4e65-9c47-1dc9f1aa2281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:32:09.391620 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c6916-3a1b-4e65-9c47-1dc9f1aa2281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:09.393312 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c6916-3a1b-4e65-9c47-1dc9f1aa2281 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:09.405669 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 987/1943] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:32:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:32:09.411532 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b334dbc-4be6-47de-8aaa-b15455189ec1 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:09.423593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b334dbc-4be6-47de-8aaa-b15455189ec1 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:09.428205 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec17f90-c4ff-4764-aff6-ec30161a31ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:09.429382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec17f90-c4ff-4764-aff6-ec30161a31ad admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:09.429635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec17f90-c4ff-4764-aff6-ec30161a31ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:09.429873 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec17f90-c4ff-4764-aff6-ec30161a31ad admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:09.430517 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec17f90-c4ff-4764-aff6-ec30161a31ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:09.432412 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec17f90-c4ff-4764-aff6-ec30161a31ad admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:09.517466 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 957/1944] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:32:09 2021] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:32:09.521718 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c6916-3a1b-4e65-9c47-1dc9f1aa2281 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:09.533290 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c6916-3a1b-4e65-9c47-1dc9f1aa2281 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:09.622428 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eceb641-17d3-410e-bbf9-729a5129d819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:09.622767 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceb641-17d3-410e-bbf9-729a5129d819 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:09.623142 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceb641-17d3-410e-bbf9-729a5129d819 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:09.623363 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceb641-17d3-410e-bbf9-729a5129d819 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:09.624062 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eceb641-17d3-410e-bbf9-729a5129d819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:09.630580 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eceb641-17d3-410e-bbf9-729a5129d819 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:09.722199 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 988/1945] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:32:09 2021] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:32:09.727211 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec17f90-c4ff-4764-aff6-ec30161a31ad admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:09.738516 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec17f90-c4ff-4764-aff6-ec30161a31ad admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:09.743354 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb5495-0df9-4831-a8f7-5e50ad0ee8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:09.744247 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb5495-0df9-4831-a8f7-5e50ad0ee8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:09.744531 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb5495-0df9-4831-a8f7-5e50ad0ee8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:09.744812 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb5495-0df9-4831-a8f7-5e50ad0ee8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:09.745597 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb5495-0df9-4831-a8f7-5e50ad0ee8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:09.747188 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb5495-0df9-4831-a8f7-5e50ad0ee8f4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:09.759862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 958/1946] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:32:09 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:32:09.763840 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eceb641-17d3-410e-bbf9-729a5129d819 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:09.775881 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eceb641-17d3-410e-bbf9-729a5129d819 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:09.780995 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8d207-b3e9-4c0d-bd41-3e52a407faa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:09.782385 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8d207-b3e9-4c0d-bd41-3e52a407faa5 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:09.782664 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8d207-b3e9-4c0d-bd41-3e52a407faa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:09.783198 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8d207-b3e9-4c0d-bd41-3e52a407faa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:09.784123 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8d207-b3e9-4c0d-bd41-3e52a407faa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:09.786581 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8d207-b3e9-4c0d-bd41-3e52a407faa5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:09.800592 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 989/1947] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:32:09 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:32:09.807470 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb5495-0df9-4831-a8f7-5e50ad0ee8f4 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:09.819160 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb5495-0df9-4831-a8f7-5e50ad0ee8f4 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:09.824101 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746de31-4496-4bd8-bb2c-8da0f9d8d31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:09.825028 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746de31-4496-4bd8-bb2c-8da0f9d8d31c admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:09.825339 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746de31-4496-4bd8-bb2c-8da0f9d8d31c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:09.825617 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746de31-4496-4bd8-bb2c-8da0f9d8d31c admin admin] PATH_INFO: `/v3/projects/124825bd579847e2aba916f432351abb/users/42a3598ef3dd46dcb298fe082260e7f0/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:09.845857 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746de31-4496-4bd8-bb2c-8da0f9d8d31c admin admin] RBAC: Authorizing `identity:create_grant(project_id=124825bd579847e2aba916f432351abb, user_id=42a3598ef3dd46dcb298fe082260e7f0, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:09.851495 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746de31-4496-4bd8-bb2c-8da0f9d8d31c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:09.966645 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 959/1948] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:32:09 2021] PUT /identity/v3/projects/124825bd579847e2aba916f432351abb/users/42a3598ef3dd46dcb298fe082260e7f0/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:32:09.979666 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c2822-4f99-4202-9c75-4a5a2b3aee26 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:09.980085 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c2822-4f99-4202-9c75-4a5a2b3aee26 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:09.980335 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c2822-4f99-4202-9c75-4a5a2b3aee26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:10.011036 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-894c2822-4f99-4202-9c75-4a5a2b3aee26 None None] MFA Rules not processed for user `42a3598ef3dd46dcb298fe082260e7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:10.012201 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-894c2822-4f99-4202-9c75-4a5a2b3aee26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:10.101783 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 990/1949] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:09 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:32:10.107631 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746de31-4496-4bd8-bb2c-8da0f9d8d31c admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:10.185637 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746de31-4496-4bd8-bb2c-8da0f9d8d31c admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:10.193544 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef09d8-c374-4d69-9740-52a41641eace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:10.194215 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef09d8-c374-4d69-9740-52a41641eace admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:10.194496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef09d8-c374-4d69-9740-52a41641eace admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:10.194769 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef09d8-c374-4d69-9740-52a41641eace admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:10.195478 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef09d8-c374-4d69-9740-52a41641eace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:10.197516 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef09d8-c374-4d69-9740-52a41641eace admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:10.288476 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 960/1950] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:32:10 2021] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:32:10.292650 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c2822-4f99-4202-9c75-4a5a2b3aee26 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:10.303422 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c2822-4f99-4202-9c75-4a5a2b3aee26 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:10.357699 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bf51d-dc66-4ce4-8cc5-fa9dc224b483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:10.358376 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bf51d-dc66-4ce4-8cc5-fa9dc224b483 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:10.358659 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bf51d-dc66-4ce4-8cc5-fa9dc224b483 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:10.358934 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bf51d-dc66-4ce4-8cc5-fa9dc224b483 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:10.359702 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bf51d-dc66-4ce4-8cc5-fa9dc224b483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:10.361653 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bf51d-dc66-4ce4-8cc5-fa9dc224b483 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:10.449530 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 991/1951] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:32:10 2021] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:32:10.454064 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef09d8-c374-4d69-9740-52a41641eace admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:10.464472 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef09d8-c374-4d69-9740-52a41641eace admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:10.469366 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832ce1c-daae-4ff7-bfb3-3beaa07b49ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:10.470033 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832ce1c-daae-4ff7-bfb3-3beaa07b49ed admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:10.470320 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832ce1c-daae-4ff7-bfb3-3beaa07b49ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:10.470597 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832ce1c-daae-4ff7-bfb3-3beaa07b49ed admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:10.471321 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832ce1c-daae-4ff7-bfb3-3beaa07b49ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:10.472924 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832ce1c-daae-4ff7-bfb3-3beaa07b49ed admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:10.483317 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 961/1952] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:32:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:32:10.488131 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bf51d-dc66-4ce4-8cc5-fa9dc224b483 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:10.497916 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bf51d-dc66-4ce4-8cc5-fa9dc224b483 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:10.503139 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db188a66-5cba-45a5-a5e8-6a4b92a57586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:10.504010 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db188a66-5cba-45a5-a5e8-6a4b92a57586 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:10.504287 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db188a66-5cba-45a5-a5e8-6a4b92a57586 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:10.504561 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db188a66-5cba-45a5-a5e8-6a4b92a57586 admin admin] PATH_INFO: `/v3/projects/5ee2218447b1487f9de8e4a810bfc13e/users/12323eb327fd4370a65c282a827820c6/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:10.519038 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db188a66-5cba-45a5-a5e8-6a4b92a57586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee2218447b1487f9de8e4a810bfc13e, user_id=12323eb327fd4370a65c282a827820c6, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:10.521728 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db188a66-5cba-45a5-a5e8-6a4b92a57586 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:10.624419 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 992/1953] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:32:10 2021] PUT /identity/v3/projects/5ee2218447b1487f9de8e4a810bfc13e/users/12323eb327fd4370a65c282a827820c6/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:32:10.624809 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832ce1c-daae-4ff7-bfb3-3beaa07b49ed admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:10.635580 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832ce1c-daae-4ff7-bfb3-3beaa07b49ed admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:10.699650 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce359f1-b9ef-4d1b-af3b-3fbed894779d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:10.700338 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce359f1-b9ef-4d1b-af3b-3fbed894779d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:10.700878 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce359f1-b9ef-4d1b-af3b-3fbed894779d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:10.701233 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce359f1-b9ef-4d1b-af3b-3fbed894779d admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:10.702483 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce359f1-b9ef-4d1b-af3b-3fbed894779d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:10.703759 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce359f1-b9ef-4d1b-af3b-3fbed894779d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:10.714347 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 962/1954] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:32:10 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:32:10.718545 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db188a66-5cba-45a5-a5e8-6a4b92a57586 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:10.730945 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db188a66-5cba-45a5-a5e8-6a4b92a57586 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:10.737683 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c4a3f-4d56-4a83-9dad-4f6f357b3bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:10.738586 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c4a3f-4d56-4a83-9dad-4f6f357b3bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:10.738870 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c4a3f-4d56-4a83-9dad-4f6f357b3bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:10.739148 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c4a3f-4d56-4a83-9dad-4f6f357b3bb0 admin admin] PATH_INFO: `/v3/projects/5ee2218447b1487f9de8e4a810bfc13e/users/12323eb327fd4370a65c282a827820c6/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:10.741273 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c4a3f-4d56-4a83-9dad-4f6f357b3bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee2218447b1487f9de8e4a810bfc13e, user_id=12323eb327fd4370a65c282a827820c6, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:10.743983 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c4a3f-4d56-4a83-9dad-4f6f357b3bb0 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:10.755229 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 993/1955] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:32:10 2021] PUT /identity/v3/projects/5ee2218447b1487f9de8e4a810bfc13e/users/12323eb327fd4370a65c282a827820c6/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:32:10.765192 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d1ff-f39b-4ab3-8d1f-57a98cb0fe65 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:10.765560 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d1ff-f39b-4ab3-8d1f-57a98cb0fe65 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:10.766868 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d1ff-f39b-4ab3-8d1f-57a98cb0fe65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:10.793768 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b4e1d1ff-f39b-4ab3-8d1f-57a98cb0fe65 None None] MFA Rules not processed for user `12323eb327fd4370a65c282a827820c6`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:10.795012 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b4e1d1ff-f39b-4ab3-8d1f-57a98cb0fe65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:10.864843 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 963/1956] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:10 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:32:10.874796 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c4a3f-4d56-4a83-9dad-4f6f357b3bb0 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:10.877364 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-e80c4a3f-4d56-4a83-9dad-4f6f357b3bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:10.938693 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c4a3f-4d56-4a83-9dad-4f6f357b3bb0 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:10.942436 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bb59c-1436-4b1d-93de-26c9224e030c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:10.943082 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bb59c-1436-4b1d-93de-26c9224e030c service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:10.943368 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bb59c-1436-4b1d-93de-26c9224e030c service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:10.943648 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bb59c-1436-4b1d-93de-26c9224e030c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:10.952710 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bb59c-1436-4b1d-93de-26c9224e030c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:10.955249 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bb59c-1436-4b1d-93de-26c9224e030c service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:10.964530 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 994/1957] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:32:10 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:32:11.995169 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1d1ff-f39b-4ab3-8d1f-57a98cb0fe65 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:12.054577 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1d1ff-f39b-4ab3-8d1f-57a98cb0fe65 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:12.059149 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae2b6e-bd8f-4459-b38f-c1fe316dd3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:12.060003 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2b6e-bd8f-4459-b38f-c1fe316dd3a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:12.060279 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2b6e-bd8f-4459-b38f-c1fe316dd3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:12.060548 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2b6e-bd8f-4459-b38f-c1fe316dd3a3 admin admin] PATH_INFO: `/v3/users/42a3598ef3dd46dcb298fe082260e7f0` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:12.061782 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae2b6e-bd8f-4459-b38f-c1fe316dd3a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a3598ef3dd46dcb298fe082260e7f0)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:12.063710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae2b6e-bd8f-4459-b38f-c1fe316dd3a3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:12.223666 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-7dae2b6e-bd8f-4459-b38f-c1fe316dd3a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a3598ef3dd46dcb298fe082260e7f0'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:12.224376 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-7dae2b6e-bd8f-4459-b38f-c1fe316dd3a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a3598ef3dd46dcb298fe082260e7f0'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:12.231625 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-7dae2b6e-bd8f-4459-b38f-c1fe316dd3a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a3598ef3dd46dcb298fe082260e7f0'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:12.232168 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-7dae2b6e-bd8f-4459-b38f-c1fe316dd3a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a3598ef3dd46dcb298fe082260e7f0'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:12.308475 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-7dae2b6e-bd8f-4459-b38f-c1fe316dd3a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a3598ef3dd46dcb298fe082260e7f0'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:12.326016 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 964/1958] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:32:11 2021] DELETE /identity/v3/users/42a3598ef3dd46dcb298fe082260e7f0 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:32:12.330577 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df235cd-b2ee-4bff-b450-2c8c39d410fc None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:12.331048 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df235cd-b2ee-4bff-b450-2c8c39d410fc None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:12.331156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df235cd-b2ee-4bff-b450-2c8c39d410fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:12.348881 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-4df235cd-b2ee-4bff-b450-2c8c39d410fc None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:12.350078 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-4df235cd-b2ee-4bff-b450-2c8c39d410fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:12.405810 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 995/1959] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:32:12.416006 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae2b6e-bd8f-4459-b38f-c1fe316dd3a3 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:12.417450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-7dae2b6e-bd8f-4459-b38f-c1fe316dd3a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:12.471587 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae2b6e-bd8f-4459-b38f-c1fe316dd3a3 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:12.475234 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724bd72-8df8-42f4-afad-4386351a2258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:12.475874 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724bd72-8df8-42f4-afad-4386351a2258 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:12.476157 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724bd72-8df8-42f4-afad-4386351a2258 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:12.476432 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724bd72-8df8-42f4-afad-4386351a2258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:12.485946 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724bd72-8df8-42f4-afad-4386351a2258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:12.487352 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724bd72-8df8-42f4-afad-4386351a2258 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:12.496445 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 965/1960] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:32:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:32:12.889076 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df235cd-b2ee-4bff-b450-2c8c39d410fc None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:12.898481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-4df235cd-b2ee-4bff-b450-2c8c39d410fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:12.909063 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df235cd-b2ee-4bff-b450-2c8c39d410fc None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:12.915006 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc1b28-c86b-4caf-9c2a-9db64c7760a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:12.916165 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc1b28-c86b-4caf-9c2a-9db64c7760a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:12.916543 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc1b28-c86b-4caf-9c2a-9db64c7760a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:12.917460 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc1b28-c86b-4caf-9c2a-9db64c7760a2 admin admin] PATH_INFO: `/v3/projects/124825bd579847e2aba916f432351abb` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:12.918114 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc1b28-c86b-4caf-9c2a-9db64c7760a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=124825bd579847e2aba916f432351abb)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:12.920083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc1b28-c86b-4caf-9c2a-9db64c7760a2 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:13.051271 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-e5dc1b28-c86b-4caf-9c2a-9db64c7760a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '124825bd579847e2aba916f432351abb', 'request_id': 'req-e5dc1b28-c86b-4caf-9c2a-9db64c7760a2'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:13.058533 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-e5dc1b28-c86b-4caf-9c2a-9db64c7760a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '124825bd579847e2aba916f432351abb', 'request_id': 'req-e5dc1b28-c86b-4caf-9c2a-9db64c7760a2'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:13.143346 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-e5dc1b28-c86b-4caf-9c2a-9db64c7760a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '124825bd579847e2aba916f432351abb', 'request_id': 'req-e5dc1b28-c86b-4caf-9c2a-9db64c7760a2'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:13.154711 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-e5dc1b28-c86b-4caf-9c2a-9db64c7760a2 admin admin] The token cache is being invalidate because project 124825bd579847e2aba916f432351abb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:32:13.154997 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-e5dc1b28-c86b-4caf-9c2a-9db64c7760a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:13.155639 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-e5dc1b28-c86b-4caf-9c2a-9db64c7760a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:13.157329 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 996/1961] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:32:12 2021] DELETE /identity/v3/projects/124825bd579847e2aba916f432351abb => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:32:13.161629 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724bd72-8df8-42f4-afad-4386351a2258 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:13.171080 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724bd72-8df8-42f4-afad-4386351a2258 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:13.225652 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02955d-5279-4429-b96a-a83f5af3e519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:13.226503 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02955d-5279-4429-b96a-a83f5af3e519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:13.226781 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02955d-5279-4429-b96a-a83f5af3e519 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:13.227062 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02955d-5279-4429-b96a-a83f5af3e519 admin admin] PATH_INFO: `/v3/users/12323eb327fd4370a65c282a827820c6` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:13.228217 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02955d-5279-4429-b96a-a83f5af3e519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12323eb327fd4370a65c282a827820c6)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:13.230129 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02955d-5279-4429-b96a-a83f5af3e519 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:13.448937 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ec02955d-5279-4429-b96a-a83f5af3e519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12323eb327fd4370a65c282a827820c6'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:13.449882 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ec02955d-5279-4429-b96a-a83f5af3e519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12323eb327fd4370a65c282a827820c6'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:13.457391 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ec02955d-5279-4429-b96a-a83f5af3e519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12323eb327fd4370a65c282a827820c6'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:13.458070 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ec02955d-5279-4429-b96a-a83f5af3e519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12323eb327fd4370a65c282a827820c6'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:13.543046 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ec02955d-5279-4429-b96a-a83f5af3e519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12323eb327fd4370a65c282a827820c6'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:13.561020 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 966/1962] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:32:13 2021] DELETE /identity/v3/users/12323eb327fd4370a65c282a827820c6 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:32:13.983289 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc1b28-c86b-4caf-9c2a-9db64c7760a2 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:13.986503 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-e5dc1b28-c86b-4caf-9c2a-9db64c7760a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:13.999727 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc1b28-c86b-4caf-9c2a-9db64c7760a2 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:14.062048 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eff3ab-784c-4955-ace0-d7d7e01adcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:14.063824 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eff3ab-784c-4955-ace0-d7d7e01adcee admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:14.064258 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eff3ab-784c-4955-ace0-d7d7e01adcee admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:14.064673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eff3ab-784c-4955-ace0-d7d7e01adcee admin admin] PATH_INFO: `/v3/projects/5ee2218447b1487f9de8e4a810bfc13e` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:14.066148 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eff3ab-784c-4955-ace0-d7d7e01adcee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee2218447b1487f9de8e4a810bfc13e)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:14.068169 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eff3ab-784c-4955-ace0-d7d7e01adcee admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:14.214051 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-87eff3ab-784c-4955-ace0-d7d7e01adcee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee2218447b1487f9de8e4a810bfc13e', 'request_id': 'req-87eff3ab-784c-4955-ace0-d7d7e01adcee'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:14.222713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-87eff3ab-784c-4955-ace0-d7d7e01adcee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee2218447b1487f9de8e4a810bfc13e', 'request_id': 'req-87eff3ab-784c-4955-ace0-d7d7e01adcee'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:14.307806 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-87eff3ab-784c-4955-ace0-d7d7e01adcee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee2218447b1487f9de8e4a810bfc13e', 'request_id': 'req-87eff3ab-784c-4955-ace0-d7d7e01adcee'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:14.321802 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-87eff3ab-784c-4955-ace0-d7d7e01adcee admin admin] The token cache is being invalidate because project 5ee2218447b1487f9de8e4a810bfc13e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:32:14.326375 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-87eff3ab-784c-4955-ace0-d7d7e01adcee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:14.326375 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-87eff3ab-784c-4955-ace0-d7d7e01adcee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:14.330273 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 997/1963] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:32:13 2021] DELETE /identity/v3/projects/5ee2218447b1487f9de8e4a810bfc13e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:32:14.331620 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdff39-4b84-4c9a-a24f-215c6b8eddd5 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:14.332106 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdff39-4b84-4c9a-a24f-215c6b8eddd5 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:14.332201 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdff39-4b84-4c9a-a24f-215c6b8eddd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:14.352161 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-27cdff39-4b84-4c9a-a24f-215c6b8eddd5 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:14.353421 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-27cdff39-4b84-4c9a-a24f-215c6b8eddd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:14.430983 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 967/1964] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:32:14.439427 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989a255-2b15-46df-891d-e0c3bc5663ae None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:14.439792 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989a255-2b15-46df-891d-e0c3bc5663ae None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:14.440137 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989a255-2b15-46df-891d-e0c3bc5663ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:14.459539 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f989a255-2b15-46df-891d-e0c3bc5663ae None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:14.460981 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f989a255-2b15-46df-891d-e0c3bc5663ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:14.469894 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 998/1965] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:32:14.473974 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdff39-4b84-4c9a-a24f-215c6b8eddd5 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:14.483477 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdff39-4b84-4c9a-a24f-215c6b8eddd5 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:14.488929 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386f238-2c87-4e30-bf24-5ff78fc192e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:14.489589 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386f238-2c87-4e30-bf24-5ff78fc192e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:14.489869 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386f238-2c87-4e30-bf24-5ff78fc192e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:14.490142 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386f238-2c87-4e30-bf24-5ff78fc192e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:14.490963 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386f238-2c87-4e30-bf24-5ff78fc192e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:32:14.491205 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386f238-2c87-4e30-bf24-5ff78fc192e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:14.493131 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386f238-2c87-4e30-bf24-5ff78fc192e1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:14.505222 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 968/1966] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:32:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:32:14.509595 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989a255-2b15-46df-891d-e0c3bc5663ae None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:14.518908 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989a255-2b15-46df-891d-e0c3bc5663ae None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:14.524199 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fd0a4-e04c-4dda-8b24-b2356e6e5041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:14.525061 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fd0a4-e04c-4dda-8b24-b2356e6e5041 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:14.525411 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fd0a4-e04c-4dda-8b24-b2356e6e5041 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:14.525759 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fd0a4-e04c-4dda-8b24-b2356e6e5041 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:14.526708 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fd0a4-e04c-4dda-8b24-b2356e6e5041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:14.528657 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fd0a4-e04c-4dda-8b24-b2356e6e5041 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:14.616514 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 999/1967] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:32:14 2021] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:32:14.617848 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386f238-2c87-4e30-bf24-5ff78fc192e1 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:14.628034 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386f238-2c87-4e30-bf24-5ff78fc192e1 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:14.683791 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639b3c3-e987-49ec-9b15-f0df74ba422e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:14.684505 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639b3c3-e987-49ec-9b15-f0df74ba422e admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:14.688030 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639b3c3-e987-49ec-9b15-f0df74ba422e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:14.688030 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639b3c3-e987-49ec-9b15-f0df74ba422e admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:14.688030 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639b3c3-e987-49ec-9b15-f0df74ba422e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:14.688030 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639b3c3-e987-49ec-9b15-f0df74ba422e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:14.783815 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 969/1968] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:32:14 2021] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:32:14.787981 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fd0a4-e04c-4dda-8b24-b2356e6e5041 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:14.799322 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fd0a4-e04c-4dda-8b24-b2356e6e5041 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:14.804383 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a67014-cd6f-46a5-8434-c0e40c30f658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:14.809461 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a67014-cd6f-46a5-8434-c0e40c30f658 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:14.809828 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a67014-cd6f-46a5-8434-c0e40c30f658 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:14.810120 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a67014-cd6f-46a5-8434-c0e40c30f658 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:14.810883 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a67014-cd6f-46a5-8434-c0e40c30f658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:14.812606 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a67014-cd6f-46a5-8434-c0e40c30f658 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:14.850545 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1000/1969] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:32:14 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:32:14.851902 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639b3c3-e987-49ec-9b15-f0df74ba422e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:14.865322 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639b3c3-e987-49ec-9b15-f0df74ba422e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:14.870433 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e696e-7f98-4109-a39d-c18617cc6fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:14.871254 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e696e-7f98-4109-a39d-c18617cc6fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:14.871738 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e696e-7f98-4109-a39d-c18617cc6fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:14.873236 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e696e-7f98-4109-a39d-c18617cc6fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:14.878813 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e696e-7f98-4109-a39d-c18617cc6fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:14.878813 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e696e-7f98-4109-a39d-c18617cc6fe0 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:14.891598 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 970/1970] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:32:14 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:32:14.892974 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a67014-cd6f-46a5-8434-c0e40c30f658 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:14.905322 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a67014-cd6f-46a5-8434-c0e40c30f658 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:14.915668 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501f74c-9d0f-4116-9091-ae34322de4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:14.917214 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501f74c-9d0f-4116-9091-ae34322de4b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:14.917778 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501f74c-9d0f-4116-9091-ae34322de4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:14.918128 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501f74c-9d0f-4116-9091-ae34322de4b1 admin admin] PATH_INFO: `/v3/projects/dc4abdf7e2de45e992cda601a4309831/users/5d950053b12644e49244c545b40f2c15/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:14.943722 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501f74c-9d0f-4116-9091-ae34322de4b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc4abdf7e2de45e992cda601a4309831, user_id=5d950053b12644e49244c545b40f2c15, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:14.948138 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501f74c-9d0f-4116-9091-ae34322de4b1 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:15.107596 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1001/1971] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:32:14 2021] PUT /identity/v3/projects/dc4abdf7e2de45e992cda601a4309831/users/5d950053b12644e49244c545b40f2c15/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:32:15.119052 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f03bfc-867a-4cc2-9c4a-23dd099cd1dd None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:15.119618 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f03bfc-867a-4cc2-9c4a-23dd099cd1dd None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:15.120073 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f03bfc-867a-4cc2-9c4a-23dd099cd1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:15.149107 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-47f03bfc-867a-4cc2-9c4a-23dd099cd1dd None None] MFA Rules not processed for user `5d950053b12644e49244c545b40f2c15`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:15.150883 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-47f03bfc-867a-4cc2-9c4a-23dd099cd1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:15.220361 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 971/1972] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:15 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:32:15.231397 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501f74c-9d0f-4116-9091-ae34322de4b1 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:15.233163 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-3501f74c-9d0f-4116-9091-ae34322de4b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:15.290734 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501f74c-9d0f-4116-9091-ae34322de4b1 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:15.294300 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b1f83-9b44-4d91-a1de-968ad9fbcc0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59679a5d71249fc8cd65fbcf84e7bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:15.294933 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b1f83-9b44-4d91-a1de-968ad9fbcc0b service glance] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:15.295210 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b1f83-9b44-4d91-a1de-968ad9fbcc0b service glance] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:15.295482 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b1f83-9b44-4d91-a1de-968ad9fbcc0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:15.305826 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b1f83-9b44-4d91-a1de-968ad9fbcc0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:15.307317 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b1f83-9b44-4d91-a1de-968ad9fbcc0b service glance] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:15.317232 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1002/1973] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:32:15 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:32:27.459484 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f03bfc-867a-4cc2-9c4a-23dd099cd1dd None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:27.461339 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-47f03bfc-867a-4cc2-9c4a-23dd099cd1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:27.545189 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f03bfc-867a-4cc2-9c4a-23dd099cd1dd None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:27.550839 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f2e25-806b-4b71-9f81-df55e32609c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:27.551795 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f2e25-806b-4b71-9f81-df55e32609c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:27.552215 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f2e25-806b-4b71-9f81-df55e32609c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:27.552497 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f2e25-806b-4b71-9f81-df55e32609c9 admin admin] PATH_INFO: `/v3/users/c25361f02052459c81e6b27299ab11be` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:27.556775 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f2e25-806b-4b71-9f81-df55e32609c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c25361f02052459c81e6b27299ab11be)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:27.559050 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f2e25-806b-4b71-9f81-df55e32609c9 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:27.784710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cc2f2e25-806b-4b71-9f81-df55e32609c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c25361f02052459c81e6b27299ab11be'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:27.785469 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cc2f2e25-806b-4b71-9f81-df55e32609c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c25361f02052459c81e6b27299ab11be'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:27.794223 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cc2f2e25-806b-4b71-9f81-df55e32609c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c25361f02052459c81e6b27299ab11be'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:27.794896 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cc2f2e25-806b-4b71-9f81-df55e32609c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c25361f02052459c81e6b27299ab11be'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:27.874372 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cc2f2e25-806b-4b71-9f81-df55e32609c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c25361f02052459c81e6b27299ab11be'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:27.893620 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 972/1974] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:32:27 2021] DELETE /identity/v3/users/c25361f02052459c81e6b27299ab11be => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:32:27.898077 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3caf7-4454-4bf0-972c-e625d829c273 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:27.898615 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3caf7-4454-4bf0-972c-e625d829c273 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:27.898615 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3caf7-4454-4bf0-972c-e625d829c273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:27.916551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-a1a3caf7-4454-4bf0-972c-e625d829c273 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:27.918150 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a1a3caf7-4454-4bf0-972c-e625d829c273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:27.980581 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1003/1975] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:32:27.992755 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f2e25-806b-4b71-9f81-df55e32609c9 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:27.994255 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-cc2f2e25-806b-4b71-9f81-df55e32609c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:28.060055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f2e25-806b-4b71-9f81-df55e32609c9 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:28.065831 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92f3b2-f413-4437-9205-2c00d81f799e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:28.068792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92f3b2-f413-4437-9205-2c00d81f799e service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:28.068792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92f3b2-f413-4437-9205-2c00d81f799e service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:28.068792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92f3b2-f413-4437-9205-2c00d81f799e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:28.077024 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92f3b2-f413-4437-9205-2c00d81f799e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:28.079087 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92f3b2-f413-4437-9205-2c00d81f799e service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:28.091733 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 973/1976] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:32:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:32:28.510732 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3caf7-4454-4bf0-972c-e625d829c273 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:28.512548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a1a3caf7-4454-4bf0-972c-e625d829c273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:28.524617 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3caf7-4454-4bf0-972c-e625d829c273 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:28.529436 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd062edd-a061-49ad-bbc2-41ccb5e95429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:28.530352 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd062edd-a061-49ad-bbc2-41ccb5e95429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:28.530638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd062edd-a061-49ad-bbc2-41ccb5e95429 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:28.531022 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd062edd-a061-49ad-bbc2-41ccb5e95429 admin admin] PATH_INFO: `/v3/projects/2a8e6cdbb0d64e80b58ff584ec68f27a` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:28.532261 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd062edd-a061-49ad-bbc2-41ccb5e95429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a8e6cdbb0d64e80b58ff584ec68f27a)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:28.534714 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd062edd-a061-49ad-bbc2-41ccb5e95429 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:28.629165 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-fd062edd-a061-49ad-bbc2-41ccb5e95429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a8e6cdbb0d64e80b58ff584ec68f27a', 'request_id': 'req-fd062edd-a061-49ad-bbc2-41ccb5e95429'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:28.635267 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-fd062edd-a061-49ad-bbc2-41ccb5e95429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a8e6cdbb0d64e80b58ff584ec68f27a', 'request_id': 'req-fd062edd-a061-49ad-bbc2-41ccb5e95429'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:28.719502 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-fd062edd-a061-49ad-bbc2-41ccb5e95429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a8e6cdbb0d64e80b58ff584ec68f27a', 'request_id': 'req-fd062edd-a061-49ad-bbc2-41ccb5e95429'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:28.731164 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-fd062edd-a061-49ad-bbc2-41ccb5e95429 admin admin] The token cache is being invalidate because project 2a8e6cdbb0d64e80b58ff584ec68f27a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:32:28.731456 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-fd062edd-a061-49ad-bbc2-41ccb5e95429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:28.732121 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-fd062edd-a061-49ad-bbc2-41ccb5e95429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:28.733779 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1004/1977] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:32:28 2021] DELETE /identity/v3/projects/2a8e6cdbb0d64e80b58ff584ec68f27a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:32:28.741367 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bbaf8-20b0-4254-92b7-601980c2ecdf None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:28.741844 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bbaf8-20b0-4254-92b7-601980c2ecdf None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:28.741949 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bbaf8-20b0-4254-92b7-601980c2ecdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:28.760865 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-4b4bbaf8-20b0-4254-92b7-601980c2ecdf None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:28.761973 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-4b4bbaf8-20b0-4254-92b7-601980c2ecdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:28.832881 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 974/1978] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:32:28.841882 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691aaaa9-933f-4772-9c53-ff892e95c7c5 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:28.842173 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691aaaa9-933f-4772-9c53-ff892e95c7c5 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:28.842454 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691aaaa9-933f-4772-9c53-ff892e95c7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:28.863468 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-691aaaa9-933f-4772-9c53-ff892e95c7c5 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:28.864787 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-691aaaa9-933f-4772-9c53-ff892e95c7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:28.875029 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1005/1979] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:32:28.879680 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bbaf8-20b0-4254-92b7-601980c2ecdf None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:28.889643 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bbaf8-20b0-4254-92b7-601980c2ecdf None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:28.894664 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096649b-5102-4ce3-9d75-95f0ff6f078c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:28.895323 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096649b-5102-4ce3-9d75-95f0ff6f078c admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:28.895606 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096649b-5102-4ce3-9d75-95f0ff6f078c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:28.895894 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096649b-5102-4ce3-9d75-95f0ff6f078c admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:28.896633 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096649b-5102-4ce3-9d75-95f0ff6f078c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:32:28.896943 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096649b-5102-4ce3-9d75-95f0ff6f078c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:28.898535 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096649b-5102-4ce3-9d75-95f0ff6f078c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:28.910643 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 975/1980] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:32:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:32:28.915193 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691aaaa9-933f-4772-9c53-ff892e95c7c5 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:28.925639 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691aaaa9-933f-4772-9c53-ff892e95c7c5 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:28.931481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d1ce4-da17-4b53-8ae2-5b84a984de5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:28.932138 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d1ce4-da17-4b53-8ae2-5b84a984de5c admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:28.932417 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d1ce4-da17-4b53-8ae2-5b84a984de5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:28.932722 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d1ce4-da17-4b53-8ae2-5b84a984de5c admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:28.933458 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d1ce4-da17-4b53-8ae2-5b84a984de5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:28.935350 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d1ce4-da17-4b53-8ae2-5b84a984de5c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:29.046251 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1006/1981] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:32:28 2021] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:32:29.050760 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096649b-5102-4ce3-9d75-95f0ff6f078c admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:29.060809 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096649b-5102-4ce3-9d75-95f0ff6f078c admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:29.119724 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebda54-0de9-4264-9bb2-955b854d97a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:29.120420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebda54-0de9-4264-9bb2-955b854d97a0 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:29.120708 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebda54-0de9-4264-9bb2-955b854d97a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:29.121069 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebda54-0de9-4264-9bb2-955b854d97a0 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:29.121780 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ebda54-0de9-4264-9bb2-955b854d97a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:29.123659 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ebda54-0de9-4264-9bb2-955b854d97a0 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:29.189003 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 976/1982] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:32:29 2021] POST /identity/v3/users => generated 296 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:32:29.193109 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d1ce4-da17-4b53-8ae2-5b84a984de5c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:29.203455 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d1ce4-da17-4b53-8ae2-5b84a984de5c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:29.208944 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2240c-2d27-4e0a-833b-97d62ebab3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:29.211418 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2240c-2d27-4e0a-833b-97d62ebab3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:29.211418 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2240c-2d27-4e0a-833b-97d62ebab3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:29.211418 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2240c-2d27-4e0a-833b-97d62ebab3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:29.211418 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2240c-2d27-4e0a-833b-97d62ebab3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:29.212604 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2240c-2d27-4e0a-833b-97d62ebab3f3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:29.223588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1007/1983] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:32:29 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:32:29.227701 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebda54-0de9-4264-9bb2-955b854d97a0 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:29.237589 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebda54-0de9-4264-9bb2-955b854d97a0 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:29.242760 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1fcfb-815f-4543-b3a9-cfea7a2c8469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:29.243431 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1fcfb-815f-4543-b3a9-cfea7a2c8469 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:29.243717 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1fcfb-815f-4543-b3a9-cfea7a2c8469 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:29.244873 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1fcfb-815f-4543-b3a9-cfea7a2c8469 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:29.244873 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1fcfb-815f-4543-b3a9-cfea7a2c8469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:29.246384 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1fcfb-815f-4543-b3a9-cfea7a2c8469 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:29.259866 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 977/1984] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:32:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:32:29.261284 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2240c-2d27-4e0a-833b-97d62ebab3f3 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:29.272444 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2240c-2d27-4e0a-833b-97d62ebab3f3 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:29.277756 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921d494-1866-4ea2-b3a6-46bde3916554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:29.278632 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921d494-1866-4ea2-b3a6-46bde3916554 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:29.278913 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921d494-1866-4ea2-b3a6-46bde3916554 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:29.280451 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921d494-1866-4ea2-b3a6-46bde3916554 admin admin] PATH_INFO: `/v3/projects/d55a749718d742299fae381c15ecd5d8/users/68fdc21785db4927a811ac42dd09e2f1/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:29.295316 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921d494-1866-4ea2-b3a6-46bde3916554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55a749718d742299fae381c15ecd5d8, user_id=68fdc21785db4927a811ac42dd09e2f1, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:29.298112 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921d494-1866-4ea2-b3a6-46bde3916554 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:29.360335 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1008/1985] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:32:29 2021] PUT /identity/v3/projects/d55a749718d742299fae381c15ecd5d8/users/68fdc21785db4927a811ac42dd09e2f1/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:32:29.370918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44e740-c202-4e0a-8fce-077202d318cb None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:29.371261 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44e740-c202-4e0a-8fce-077202d318cb None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:29.371539 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44e740-c202-4e0a-8fce-077202d318cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:29.398334 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-ef44e740-c202-4e0a-8fce-077202d318cb None None] MFA Rules not processed for user `68fdc21785db4927a811ac42dd09e2f1`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:29.399537 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ef44e740-c202-4e0a-8fce-077202d318cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:29.463053 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 978/1986] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:29 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:32:29.825669 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921d494-1866-4ea2-b3a6-46bde3916554 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:29.825669 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-b921d494-1866-4ea2-b3a6-46bde3916554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:29.923043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921d494-1866-4ea2-b3a6-46bde3916554 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:29.931527 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8574a8-2c29-4ff7-a289-64aac0fa0a11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:29.932453 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8574a8-2c29-4ff7-a289-64aac0fa0a11 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:29.933019 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8574a8-2c29-4ff7-a289-64aac0fa0a11 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:29.933509 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8574a8-2c29-4ff7-a289-64aac0fa0a11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:29.944412 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8574a8-2c29-4ff7-a289-64aac0fa0a11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:29.946588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8574a8-2c29-4ff7-a289-64aac0fa0a11 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:29.961013 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1009/1987] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:32:29 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:32:57.006063 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44e740-c202-4e0a-8fce-077202d318cb None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:57.112403 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44e740-c202-4e0a-8fce-077202d318cb None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:57.116940 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b95419-ee84-4770-adb6-47a8c2564562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:57.118382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b95419-ee84-4770-adb6-47a8c2564562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:57.118658 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b95419-ee84-4770-adb6-47a8c2564562 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:57.118926 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b95419-ee84-4770-adb6-47a8c2564562 admin admin] PATH_INFO: `/v3/users/68fdc21785db4927a811ac42dd09e2f1` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:57.120143 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b95419-ee84-4770-adb6-47a8c2564562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68fdc21785db4927a811ac42dd09e2f1)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:57.122052 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b95419-ee84-4770-adb6-47a8c2564562 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:57.314938 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-91b95419-ee84-4770-adb6-47a8c2564562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68fdc21785db4927a811ac42dd09e2f1'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:57.315585 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-91b95419-ee84-4770-adb6-47a8c2564562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68fdc21785db4927a811ac42dd09e2f1'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:57.322521 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-91b95419-ee84-4770-adb6-47a8c2564562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68fdc21785db4927a811ac42dd09e2f1'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:57.323136 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-91b95419-ee84-4770-adb6-47a8c2564562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68fdc21785db4927a811ac42dd09e2f1'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:57.392002 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-91b95419-ee84-4770-adb6-47a8c2564562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68fdc21785db4927a811ac42dd09e2f1'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:57.410151 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 979/1988] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:32:57 2021] DELETE /identity/v3/users/68fdc21785db4927a811ac42dd09e2f1 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:32:57.416625 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fa1a8-60b7-4fe0-8877-22857c51e822 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:57.416625 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fa1a8-60b7-4fe0-8877-22857c51e822 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:57.416625 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fa1a8-60b7-4fe0-8877-22857c51e822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:57.465049 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-7c4fa1a8-60b7-4fe0-8877-22857c51e822 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:57.466262 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-7c4fa1a8-60b7-4fe0-8877-22857c51e822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:57.525286 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1010/1989] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:32:57.535328 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b95419-ee84-4770-adb6-47a8c2564562 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:57.536730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-91b95419-ee84-4770-adb6-47a8c2564562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:57.633339 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b95419-ee84-4770-adb6-47a8c2564562 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:57.637087 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354e8ab-d513-41f4-b5f5-76cc510b2859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:57.637838 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354e8ab-d513-41f4-b5f5-76cc510b2859 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:57.638114 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354e8ab-d513-41f4-b5f5-76cc510b2859 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:57.638390 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354e8ab-d513-41f4-b5f5-76cc510b2859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:57.647514 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354e8ab-d513-41f4-b5f5-76cc510b2859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:57.649702 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354e8ab-d513-41f4-b5f5-76cc510b2859 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:57.659344 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 980/1990] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:32:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:32:58.075822 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fa1a8-60b7-4fe0-8877-22857c51e822 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:58.080469 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-7c4fa1a8-60b7-4fe0-8877-22857c51e822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:58.088816 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fa1a8-60b7-4fe0-8877-22857c51e822 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:58.095604 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a83852-bf5b-49e7-b013-41d7dd96a197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:58.096592 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a83852-bf5b-49e7-b013-41d7dd96a197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:58.096975 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a83852-bf5b-49e7-b013-41d7dd96a197 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:58.097324 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a83852-bf5b-49e7-b013-41d7dd96a197 admin admin] PATH_INFO: `/v3/projects/d55a749718d742299fae381c15ecd5d8` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:58.098665 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a83852-bf5b-49e7-b013-41d7dd96a197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d55a749718d742299fae381c15ecd5d8)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:58.107833 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a83852-bf5b-49e7-b013-41d7dd96a197 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:58.239026 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-57a83852-bf5b-49e7-b013-41d7dd96a197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd55a749718d742299fae381c15ecd5d8', 'request_id': 'req-57a83852-bf5b-49e7-b013-41d7dd96a197'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:58.240739 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-57a83852-bf5b-49e7-b013-41d7dd96a197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd55a749718d742299fae381c15ecd5d8', 'request_id': 'req-57a83852-bf5b-49e7-b013-41d7dd96a197'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:58.329632 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-57a83852-bf5b-49e7-b013-41d7dd96a197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd55a749718d742299fae381c15ecd5d8', 'request_id': 'req-57a83852-bf5b-49e7-b013-41d7dd96a197'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:58.341216 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-57a83852-bf5b-49e7-b013-41d7dd96a197 admin admin] The token cache is being invalidate because project d55a749718d742299fae381c15ecd5d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:32:58.342006 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-57a83852-bf5b-49e7-b013-41d7dd96a197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:58.342694 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-57a83852-bf5b-49e7-b013-41d7dd96a197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:32:58.346099 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1011/1991] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:32:58 2021] DELETE /identity/v3/projects/d55a749718d742299fae381c15ecd5d8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:32:58.352497 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d0fee-ab51-4454-b1a6-ceb0201841c1 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:58.353048 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d0fee-ab51-4454-b1a6-ceb0201841c1 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:58.353141 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d0fee-ab51-4454-b1a6-ceb0201841c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:58.389883 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-c81d0fee-ab51-4454-b1a6-ceb0201841c1 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:58.391220 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-c81d0fee-ab51-4454-b1a6-ceb0201841c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:58.452330 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 981/1992] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:32:58.460259 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae727c7-5cfc-49fc-90d6-dcc8c6adb3c8 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:58.460758 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae727c7-5cfc-49fc-90d6-dcc8c6adb3c8 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:58.461045 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae727c7-5cfc-49fc-90d6-dcc8c6adb3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:58.480064 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-eae727c7-5cfc-49fc-90d6-dcc8c6adb3c8 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:58.481296 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-eae727c7-5cfc-49fc-90d6-dcc8c6adb3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:58.489329 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1012/1993] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:32:58.494133 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d0fee-ab51-4454-b1a6-ceb0201841c1 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:58.504208 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d0fee-ab51-4454-b1a6-ceb0201841c1 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:58.509418 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddec33-08dd-4ffa-8217-9493181ffe10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:58.510121 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddec33-08dd-4ffa-8217-9493181ffe10 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:58.510400 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddec33-08dd-4ffa-8217-9493181ffe10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:58.510673 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddec33-08dd-4ffa-8217-9493181ffe10 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:58.511403 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddec33-08dd-4ffa-8217-9493181ffe10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:32:58.511751 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddec33-08dd-4ffa-8217-9493181ffe10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:58.513456 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddec33-08dd-4ffa-8217-9493181ffe10 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:58.525577 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 982/1994] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:32:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:32:58.530041 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae727c7-5cfc-49fc-90d6-dcc8c6adb3c8 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:58.539599 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae727c7-5cfc-49fc-90d6-dcc8c6adb3c8 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:58.544379 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266308e7-0399-4cb2-a4d2-12901319682d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:58.545059 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266308e7-0399-4cb2-a4d2-12901319682d admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:58.545343 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266308e7-0399-4cb2-a4d2-12901319682d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:58.545619 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266308e7-0399-4cb2-a4d2-12901319682d admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:58.546389 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266308e7-0399-4cb2-a4d2-12901319682d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:58.548284 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266308e7-0399-4cb2-a4d2-12901319682d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:58.647208 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1013/1995] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:32:58 2021] POST /identity/v3/projects => generated 397 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:32:58.651904 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddec33-08dd-4ffa-8217-9493181ffe10 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:58.663372 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddec33-08dd-4ffa-8217-9493181ffe10 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:58.728318 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f1e49-4529-4b9c-8081-c1de0da52789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:58.729044 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f1e49-4529-4b9c-8081-c1de0da52789 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:58.729333 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f1e49-4529-4b9c-8081-c1de0da52789 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:58.729619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f1e49-4529-4b9c-8081-c1de0da52789 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:58.730344 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f1e49-4529-4b9c-8081-c1de0da52789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:58.732359 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f1e49-4529-4b9c-8081-c1de0da52789 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:58.810209 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 983/1996] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:32:58 2021] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:32:58.814353 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266308e7-0399-4cb2-a4d2-12901319682d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:58.825747 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266308e7-0399-4cb2-a4d2-12901319682d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:58.830477 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e5594-be48-4026-89ca-6e3160cf140d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:58.831172 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e5594-be48-4026-89ca-6e3160cf140d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:58.831456 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e5594-be48-4026-89ca-6e3160cf140d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:58.831733 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e5594-be48-4026-89ca-6e3160cf140d admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:58.832467 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e5594-be48-4026-89ca-6e3160cf140d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:58.834102 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e5594-be48-4026-89ca-6e3160cf140d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:58.845355 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1014/1997] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:32:58 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:32:58.849536 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f1e49-4529-4b9c-8081-c1de0da52789 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:58.860358 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f1e49-4529-4b9c-8081-c1de0da52789 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:58.865328 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1f9ff-3d1c-46a3-9210-acaaebca6a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:58.866005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1f9ff-3d1c-46a3-9210-acaaebca6a80 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:58.866299 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1f9ff-3d1c-46a3-9210-acaaebca6a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:58.866564 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1f9ff-3d1c-46a3-9210-acaaebca6a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:58.867537 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1f9ff-3d1c-46a3-9210-acaaebca6a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:58.869231 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1f9ff-3d1c-46a3-9210-acaaebca6a80 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:58.879454 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 984/1998] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:32:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:32:58.883871 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e5594-be48-4026-89ca-6e3160cf140d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:58.894178 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e5594-be48-4026-89ca-6e3160cf140d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:58.899480 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbdff6-ad9a-4f92-b0bf-5a5af124eaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:58.900345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbdff6-ad9a-4f92-b0bf-5a5af124eaed admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:58.900669 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbdff6-ad9a-4f92-b0bf-5a5af124eaed admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:58.900986 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbdff6-ad9a-4f92-b0bf-5a5af124eaed admin admin] PATH_INFO: `/v3/projects/c232f10c131f48d6a4bfe07871aaec61/users/0853b01c6521469bbdfd380f1ae9092a/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:58.915820 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbdff6-ad9a-4f92-b0bf-5a5af124eaed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c232f10c131f48d6a4bfe07871aaec61, user_id=0853b01c6521469bbdfd380f1ae9092a, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:58.918621 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbdff6-ad9a-4f92-b0bf-5a5af124eaed admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:59.001057 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1015/1999] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:32:58 2021] PUT /identity/v3/projects/c232f10c131f48d6a4bfe07871aaec61/users/0853b01c6521469bbdfd380f1ae9092a/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:32:59.011674 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d35b26-bb74-4d5d-9bf2-ba140ccadbb4 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:59.011963 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d35b26-bb74-4d5d-9bf2-ba140ccadbb4 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:59.012246 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d35b26-bb74-4d5d-9bf2-ba140ccadbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:59.039136 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-e6d35b26-bb74-4d5d-9bf2-ba140ccadbb4 None None] MFA Rules not processed for user `0853b01c6521469bbdfd380f1ae9092a`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:32:59.040448 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e6d35b26-bb74-4d5d-9bf2-ba140ccadbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:59.110812 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 985/2000] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:32:59 2021] POST /identity/v3/auth/tokens => generated 3417 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:32:59.122126 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbdff6-ad9a-4f92-b0bf-5a5af124eaed admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:32:59.123850 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a4dbdff6-ad9a-4f92-b0bf-5a5af124eaed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:32:59.181997 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbdff6-ad9a-4f92-b0bf-5a5af124eaed admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:32:59.185589 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39cf27-426d-4f8b-a44c-84e272ea902c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:32:59.186374 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39cf27-426d-4f8b-a44c-84e272ea902c service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:32:59.186655 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39cf27-426d-4f8b-a44c-84e272ea902c service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:32:59.186931 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39cf27-426d-4f8b-a44c-84e272ea902c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:32:59.196078 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39cf27-426d-4f8b-a44c-84e272ea902c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:32:59.197631 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39cf27-426d-4f8b-a44c-84e272ea902c service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:32:59.207749 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1016/2001] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:32:59 2021] GET /identity/v3/auth/tokens => generated 3417 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:33:01.178364 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d35b26-bb74-4d5d-9bf2-ba140ccadbb4 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:01.180145 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e6d35b26-bb74-4d5d-9bf2-ba140ccadbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:01.263095 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d35b26-bb74-4d5d-9bf2-ba140ccadbb4 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:01.268012 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d49b4-5a84-4e46-afae-c960b29e6199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:01.268906 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d49b4-5a84-4e46-afae-c960b29e6199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:01.269194 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d49b4-5a84-4e46-afae-c960b29e6199 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:01.269472 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d49b4-5a84-4e46-afae-c960b29e6199 admin admin] PATH_INFO: `/v3/users/5d950053b12644e49244c545b40f2c15` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:01.270668 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d49b4-5a84-4e46-afae-c960b29e6199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d950053b12644e49244c545b40f2c15)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:01.272729 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d49b4-5a84-4e46-afae-c960b29e6199 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:01.473586 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ee6d49b4-5a84-4e46-afae-c960b29e6199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d950053b12644e49244c545b40f2c15'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:01.474319 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ee6d49b4-5a84-4e46-afae-c960b29e6199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d950053b12644e49244c545b40f2c15'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:01.485200 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ee6d49b4-5a84-4e46-afae-c960b29e6199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d950053b12644e49244c545b40f2c15'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:01.485200 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ee6d49b4-5a84-4e46-afae-c960b29e6199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d950053b12644e49244c545b40f2c15'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:01.559439 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ee6d49b4-5a84-4e46-afae-c960b29e6199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d950053b12644e49244c545b40f2c15'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:01.580617 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 986/2002] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:33:01 2021] DELETE /identity/v3/users/5d950053b12644e49244c545b40f2c15 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:33:01.584822 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f914772-0c1d-4210-9943-8781e589d0d2 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:01.585347 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f914772-0c1d-4210-9943-8781e589d0d2 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:01.586852 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f914772-0c1d-4210-9943-8781e589d0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:01.604648 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-6f914772-0c1d-4210-9943-8781e589d0d2 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:01.605960 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-6f914772-0c1d-4210-9943-8781e589d0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:01.665632 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1017/2003] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:33:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:33:01.676078 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d49b4-5a84-4e46-afae-c960b29e6199 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:01.677833 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ee6d49b4-5a84-4e46-afae-c960b29e6199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:01.738385 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d49b4-5a84-4e46-afae-c960b29e6199 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:01.743394 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636f203-84e2-4d8f-bd58-d142ff3ed9c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:01.744064 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636f203-84e2-4d8f-bd58-d142ff3ed9c1 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:01.744350 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636f203-84e2-4d8f-bd58-d142ff3ed9c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:01.744623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636f203-84e2-4d8f-bd58-d142ff3ed9c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:01.754966 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636f203-84e2-4d8f-bd58-d142ff3ed9c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:01.756422 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636f203-84e2-4d8f-bd58-d142ff3ed9c1 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:01.767593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 987/2004] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:33:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:33:02.283101 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f914772-0c1d-4210-9943-8781e589d0d2 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:02.284921 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-6f914772-0c1d-4210-9943-8781e589d0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:02.300257 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f914772-0c1d-4210-9943-8781e589d0d2 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:02.306782 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f919e94-b424-497d-a2cd-51f0fb90712e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:02.308258 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f919e94-b424-497d-a2cd-51f0fb90712e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:02.308957 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f919e94-b424-497d-a2cd-51f0fb90712e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:02.309255 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f919e94-b424-497d-a2cd-51f0fb90712e admin admin] PATH_INFO: `/v3/projects/dc4abdf7e2de45e992cda601a4309831` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:02.310510 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f919e94-b424-497d-a2cd-51f0fb90712e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc4abdf7e2de45e992cda601a4309831)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:02.313648 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f919e94-b424-497d-a2cd-51f0fb90712e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:02.437948 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-9f919e94-b424-497d-a2cd-51f0fb90712e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc4abdf7e2de45e992cda601a4309831', 'request_id': 'req-9f919e94-b424-497d-a2cd-51f0fb90712e'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:02.443898 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-9f919e94-b424-497d-a2cd-51f0fb90712e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc4abdf7e2de45e992cda601a4309831', 'request_id': 'req-9f919e94-b424-497d-a2cd-51f0fb90712e'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:02.530386 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-9f919e94-b424-497d-a2cd-51f0fb90712e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc4abdf7e2de45e992cda601a4309831', 'request_id': 'req-9f919e94-b424-497d-a2cd-51f0fb90712e'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:02.543046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-9f919e94-b424-497d-a2cd-51f0fb90712e admin admin] The token cache is being invalidate because project dc4abdf7e2de45e992cda601a4309831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:33:02.543628 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-9f919e94-b424-497d-a2cd-51f0fb90712e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:02.545763 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-9f919e94-b424-497d-a2cd-51f0fb90712e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:02.548697 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1018/2005] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:33:02 2021] DELETE /identity/v3/projects/dc4abdf7e2de45e992cda601a4309831 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:33:05.779445 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c3727-553e-45f6-9cbc-d0ec44022afb None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:05.779445 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c3727-553e-45f6-9cbc-d0ec44022afb None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:05.779445 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c3727-553e-45f6-9cbc-d0ec44022afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:05.795795 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-154c3727-553e-45f6-9cbc-d0ec44022afb None None] MFA Rules not processed for user `589eca6a184e4505a0c0f97efe65892e`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:05.797032 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-154c3727-553e-45f6-9cbc-d0ec44022afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:05.909370 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 988/2006] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:33:05 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:33:12.022607 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f919e94-b424-497d-a2cd-51f0fb90712e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:12.024109 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-9f919e94-b424-497d-a2cd-51f0fb90712e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:12.130589 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f919e94-b424-497d-a2cd-51f0fb90712e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:12.139751 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cabad2-08fa-4288-8032-57c245f0736b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:12.140697 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cabad2-08fa-4288-8032-57c245f0736b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:12.141015 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cabad2-08fa-4288-8032-57c245f0736b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:12.141296 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cabad2-08fa-4288-8032-57c245f0736b admin admin] PATH_INFO: `/v3/users/0853b01c6521469bbdfd380f1ae9092a` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:12.142929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cabad2-08fa-4288-8032-57c245f0736b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0853b01c6521469bbdfd380f1ae9092a)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:12.144927 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cabad2-08fa-4288-8032-57c245f0736b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:12.306582 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-e0cabad2-08fa-4288-8032-57c245f0736b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0853b01c6521469bbdfd380f1ae9092a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:12.321837 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-e0cabad2-08fa-4288-8032-57c245f0736b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0853b01c6521469bbdfd380f1ae9092a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:12.328551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-e0cabad2-08fa-4288-8032-57c245f0736b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0853b01c6521469bbdfd380f1ae9092a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:12.329290 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-e0cabad2-08fa-4288-8032-57c245f0736b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0853b01c6521469bbdfd380f1ae9092a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:12.410173 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-e0cabad2-08fa-4288-8032-57c245f0736b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0853b01c6521469bbdfd380f1ae9092a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:12.418148 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1019/2007] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:33:12 2021] DELETE /identity/v3/users/0853b01c6521469bbdfd380f1ae9092a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:33:12.423673 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ec3a-f0e1-4f56-b625-0ffbccaea890 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:12.424095 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ec3a-f0e1-4f56-b625-0ffbccaea890 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:12.424302 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ec3a-f0e1-4f56-b625-0ffbccaea890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:12.443797 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-ce67ec3a-f0e1-4f56-b625-0ffbccaea890 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:12.445085 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ce67ec3a-f0e1-4f56-b625-0ffbccaea890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:12.503113 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 989/2008] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:33:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:33:12.513613 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cabad2-08fa-4288-8032-57c245f0736b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:12.515090 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-e0cabad2-08fa-4288-8032-57c245f0736b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:12.571449 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cabad2-08fa-4288-8032-57c245f0736b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:12.576046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb06b95-8d31-4d87-ac35-1df97894a530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:12.576706 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb06b95-8d31-4d87-ac35-1df97894a530 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:12.577036 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb06b95-8d31-4d87-ac35-1df97894a530 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:12.577316 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb06b95-8d31-4d87-ac35-1df97894a530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:12.588508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb06b95-8d31-4d87-ac35-1df97894a530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:12.590159 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb06b95-8d31-4d87-ac35-1df97894a530 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:12.599974 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1020/2009] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:33:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:33:13.211426 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67ec3a-f0e1-4f56-b625-0ffbccaea890 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:13.213087 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ce67ec3a-f0e1-4f56-b625-0ffbccaea890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:13.224910 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67ec3a-f0e1-4f56-b625-0ffbccaea890 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:13.230202 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f0d33-cb3d-4760-87a0-a987a29c588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:13.231058 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f0d33-cb3d-4760-87a0-a987a29c588c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:13.231947 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f0d33-cb3d-4760-87a0-a987a29c588c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:13.231947 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f0d33-cb3d-4760-87a0-a987a29c588c admin admin] PATH_INFO: `/v3/projects/c232f10c131f48d6a4bfe07871aaec61` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:13.233272 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f0d33-cb3d-4760-87a0-a987a29c588c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c232f10c131f48d6a4bfe07871aaec61)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:13.235299 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f0d33-cb3d-4760-87a0-a987a29c588c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:13.343587 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-090f0d33-cb3d-4760-87a0-a987a29c588c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c232f10c131f48d6a4bfe07871aaec61', 'request_id': 'req-090f0d33-cb3d-4760-87a0-a987a29c588c'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:13.356771 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-090f0d33-cb3d-4760-87a0-a987a29c588c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c232f10c131f48d6a4bfe07871aaec61', 'request_id': 'req-090f0d33-cb3d-4760-87a0-a987a29c588c'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:13.444991 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-090f0d33-cb3d-4760-87a0-a987a29c588c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c232f10c131f48d6a4bfe07871aaec61', 'request_id': 'req-090f0d33-cb3d-4760-87a0-a987a29c588c'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:13.461339 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-090f0d33-cb3d-4760-87a0-a987a29c588c admin admin] The token cache is being invalidate because project c232f10c131f48d6a4bfe07871aaec61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:33:13.468546 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-090f0d33-cb3d-4760-87a0-a987a29c588c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:13.468546 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-090f0d33-cb3d-4760-87a0-a987a29c588c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:13.468546 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 990/2010] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:33:13 2021] DELETE /identity/v3/projects/c232f10c131f48d6a4bfe07871aaec61 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:33:15.775761 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb06b95-8d31-4d87-ac35-1df97894a530 service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:15.777208 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-ffb06b95-8d31-4d87-ac35-1df97894a530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:15.790091 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb06b95-8d31-4d87-ac35-1df97894a530 service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:15.847400 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe31c58-2505-49a4-8a76-29d503a26e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:15.848437 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe31c58-2505-49a4-8a76-29d503a26e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:15.848717 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe31c58-2505-49a4-8a76-29d503a26e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:15.849024 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe31c58-2505-49a4-8a76-29d503a26e8d admin admin] PATH_INFO: `/v3/users/1ff38ccec60c47a5aee0cd620d2c8c15` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:15.850204 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe31c58-2505-49a4-8a76-29d503a26e8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff38ccec60c47a5aee0cd620d2c8c15)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:15.853047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe31c58-2505-49a4-8a76-29d503a26e8d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:16.075635 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ffe31c58-2505-49a4-8a76-29d503a26e8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff38ccec60c47a5aee0cd620d2c8c15'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:16.088129 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ffe31c58-2505-49a4-8a76-29d503a26e8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff38ccec60c47a5aee0cd620d2c8c15'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:16.095261 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ffe31c58-2505-49a4-8a76-29d503a26e8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff38ccec60c47a5aee0cd620d2c8c15'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:16.095967 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ffe31c58-2505-49a4-8a76-29d503a26e8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff38ccec60c47a5aee0cd620d2c8c15'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:16.152590 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ffe31c58-2505-49a4-8a76-29d503a26e8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff38ccec60c47a5aee0cd620d2c8c15'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:16.158910 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1021/2011] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:33:15 2021] DELETE /identity/v3/users/1ff38ccec60c47a5aee0cd620d2c8c15 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:33:16.163524 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1088a4e-409b-4c23-881e-7127793d2305 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:16.163992 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1088a4e-409b-4c23-881e-7127793d2305 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:16.164081 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1088a4e-409b-4c23-881e-7127793d2305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:16.182872 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b1088a4e-409b-4c23-881e-7127793d2305 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:16.184077 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b1088a4e-409b-4c23-881e-7127793d2305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:16.244444 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 991/2012] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:33:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:33:16.254085 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe31c58-2505-49a4-8a76-29d503a26e8d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:16.255728 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-ffe31c58-2505-49a4-8a76-29d503a26e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:16.312106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe31c58-2505-49a4-8a76-29d503a26e8d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:16.315663 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fe16e-a883-4948-874a-dafee2287ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:16.316305 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fe16e-a883-4948-874a-dafee2287ccf service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:16.316880 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fe16e-a883-4948-874a-dafee2287ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:16.316880 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fe16e-a883-4948-874a-dafee2287ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:16.326278 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fe16e-a883-4948-874a-dafee2287ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:16.327688 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fe16e-a883-4948-874a-dafee2287ccf service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:16.337592 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1022/2013] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:33:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:33:16.759812 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1088a4e-409b-4c23-881e-7127793d2305 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:16.761243 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b1088a4e-409b-4c23-881e-7127793d2305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:16.773157 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1088a4e-409b-4c23-881e-7127793d2305 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:16.778883 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15234ea7-dd59-43d8-a8dd-cdb89d8f715e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:16.779845 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15234ea7-dd59-43d8-a8dd-cdb89d8f715e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:16.780115 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15234ea7-dd59-43d8-a8dd-cdb89d8f715e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:16.780393 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15234ea7-dd59-43d8-a8dd-cdb89d8f715e admin admin] PATH_INFO: `/v3/projects/6356696117f147108a8a29d46bfdc4c7` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:16.781612 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15234ea7-dd59-43d8-a8dd-cdb89d8f715e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6356696117f147108a8a29d46bfdc4c7)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:16.783504 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15234ea7-dd59-43d8-a8dd-cdb89d8f715e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:16.918467 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-15234ea7-dd59-43d8-a8dd-cdb89d8f715e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6356696117f147108a8a29d46bfdc4c7', 'request_id': 'req-15234ea7-dd59-43d8-a8dd-cdb89d8f715e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:16.924599 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-15234ea7-dd59-43d8-a8dd-cdb89d8f715e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6356696117f147108a8a29d46bfdc4c7', 'request_id': 'req-15234ea7-dd59-43d8-a8dd-cdb89d8f715e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:16.998352 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-15234ea7-dd59-43d8-a8dd-cdb89d8f715e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6356696117f147108a8a29d46bfdc4c7', 'request_id': 'req-15234ea7-dd59-43d8-a8dd-cdb89d8f715e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:17.009974 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-15234ea7-dd59-43d8-a8dd-cdb89d8f715e admin admin] The token cache is being invalidate because project 6356696117f147108a8a29d46bfdc4c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:33:17.010263 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-15234ea7-dd59-43d8-a8dd-cdb89d8f715e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:17.010916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-15234ea7-dd59-43d8-a8dd-cdb89d8f715e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:17.012719 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 992/2014] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:33:16 2021] DELETE /identity/v3/projects/6356696117f147108a8a29d46bfdc4c7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:33:17.016510 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fe16e-a883-4948-874a-dafee2287ccf service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:17.026702 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fe16e-a883-4948-874a-dafee2287ccf service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:17.082419 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51d1f3-ade9-4a31-9fa4-77a1c8fd3c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:17.083346 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51d1f3-ade9-4a31-9fa4-77a1c8fd3c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:17.083568 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51d1f3-ade9-4a31-9fa4-77a1c8fd3c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:17.083844 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51d1f3-ade9-4a31-9fa4-77a1c8fd3c0c admin admin] PATH_INFO: `/v3/users/d5d26134c0814223b3675c45a284cc12` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:17.085076 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51d1f3-ade9-4a31-9fa4-77a1c8fd3c0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5d26134c0814223b3675c45a284cc12)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:17.087774 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51d1f3-ade9-4a31-9fa4-77a1c8fd3c0c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:17.240742 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ac51d1f3-ade9-4a31-9fa4-77a1c8fd3c0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5d26134c0814223b3675c45a284cc12'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:17.253523 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ac51d1f3-ade9-4a31-9fa4-77a1c8fd3c0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5d26134c0814223b3675c45a284cc12'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:17.261595 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ac51d1f3-ade9-4a31-9fa4-77a1c8fd3c0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5d26134c0814223b3675c45a284cc12'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:17.262305 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ac51d1f3-ade9-4a31-9fa4-77a1c8fd3c0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5d26134c0814223b3675c45a284cc12'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:17.329053 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ac51d1f3-ade9-4a31-9fa4-77a1c8fd3c0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5d26134c0814223b3675c45a284cc12'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:17.335919 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1023/2015] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:33:17 2021] DELETE /identity/v3/users/d5d26134c0814223b3675c45a284cc12 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:33:18.024389 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15234ea7-dd59-43d8-a8dd-cdb89d8f715e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:18.024389 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-15234ea7-dd59-43d8-a8dd-cdb89d8f715e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:18.033773 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15234ea7-dd59-43d8-a8dd-cdb89d8f715e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:18.096637 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f2dde-e448-4952-93b1-06662612e849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:18.097546 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f2dde-e448-4952-93b1-06662612e849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:18.097832 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f2dde-e448-4952-93b1-06662612e849 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:18.098109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f2dde-e448-4952-93b1-06662612e849 admin admin] PATH_INFO: `/v3/projects/bdd9a85d8a1b4b458862e2d7fa91b181` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:18.099390 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f2dde-e448-4952-93b1-06662612e849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd9a85d8a1b4b458862e2d7fa91b181)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:18.101307 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f2dde-e448-4952-93b1-06662612e849 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:18.215961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-949f2dde-e448-4952-93b1-06662612e849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd9a85d8a1b4b458862e2d7fa91b181', 'request_id': 'req-949f2dde-e448-4952-93b1-06662612e849'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:18.222049 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-949f2dde-e448-4952-93b1-06662612e849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd9a85d8a1b4b458862e2d7fa91b181', 'request_id': 'req-949f2dde-e448-4952-93b1-06662612e849'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:18.285119 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-949f2dde-e448-4952-93b1-06662612e849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd9a85d8a1b4b458862e2d7fa91b181', 'request_id': 'req-949f2dde-e448-4952-93b1-06662612e849'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:18.304344 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-949f2dde-e448-4952-93b1-06662612e849 admin admin] The token cache is being invalidate because project bdd9a85d8a1b4b458862e2d7fa91b181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:33:18.304344 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-949f2dde-e448-4952-93b1-06662612e849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:18.304344 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-949f2dde-e448-4952-93b1-06662612e849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:18.304344 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 993/2016] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:33:18 2021] DELETE /identity/v3/projects/bdd9a85d8a1b4b458862e2d7fa91b181 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:33:18.307626 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c733a47-f677-4ca9-b779-e643e8c03032 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:18.308085 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c733a47-f677-4ca9-b779-e643e8c03032 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:18.308186 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c733a47-f677-4ca9-b779-e643e8c03032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:18.338313 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-7c733a47-f677-4ca9-b779-e643e8c03032 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:18.339551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-7c733a47-f677-4ca9-b779-e643e8c03032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:18.404665 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1024/2017] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:33:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:33:18.412176 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28f4f6-d2e1-4b1c-8608-ea9812bcf7b6 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:18.412472 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28f4f6-d2e1-4b1c-8608-ea9812bcf7b6 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:18.412755 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28f4f6-d2e1-4b1c-8608-ea9812bcf7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:18.438079 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-3e28f4f6-d2e1-4b1c-8608-ea9812bcf7b6 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:18.439362 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-3e28f4f6-d2e1-4b1c-8608-ea9812bcf7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:18.448993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 994/2018] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:33:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:33:18.452809 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c733a47-f677-4ca9-b779-e643e8c03032 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:18.463303 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c733a47-f677-4ca9-b779-e643e8c03032 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:18.467950 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e5a80-ba84-447d-8495-3f719cbde181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:18.468621 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e5a80-ba84-447d-8495-3f719cbde181 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:18.468910 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e5a80-ba84-447d-8495-3f719cbde181 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:18.469187 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e5a80-ba84-447d-8495-3f719cbde181 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:18.469954 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e5a80-ba84-447d-8495-3f719cbde181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:33:18.470207 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e5a80-ba84-447d-8495-3f719cbde181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:18.477262 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e5a80-ba84-447d-8495-3f719cbde181 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:18.483394 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1025/2019] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:33:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:33:18.487740 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28f4f6-d2e1-4b1c-8608-ea9812bcf7b6 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:18.497343 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28f4f6-d2e1-4b1c-8608-ea9812bcf7b6 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:18.502072 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00fe02-9fc0-417b-bac7-e8a083d4edb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:18.502737 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00fe02-9fc0-417b-bac7-e8a083d4edb8 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:18.503021 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00fe02-9fc0-417b-bac7-e8a083d4edb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:18.503299 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00fe02-9fc0-417b-bac7-e8a083d4edb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:18.503990 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00fe02-9fc0-417b-bac7-e8a083d4edb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:18.505939 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00fe02-9fc0-417b-bac7-e8a083d4edb8 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:18.597687 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 995/2020] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:33:18 2021] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:33:18.598806 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e5a80-ba84-447d-8495-3f719cbde181 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:18.609225 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e5a80-ba84-447d-8495-3f719cbde181 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:18.666247 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e63f6-9f2b-4f11-b799-72015e4059e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:18.666903 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e63f6-9f2b-4f11-b799-72015e4059e3 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:18.667183 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e63f6-9f2b-4f11-b799-72015e4059e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:18.667456 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e63f6-9f2b-4f11-b799-72015e4059e3 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:18.668195 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e63f6-9f2b-4f11-b799-72015e4059e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:18.670114 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e63f6-9f2b-4f11-b799-72015e4059e3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:18.804727 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1026/2021] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:33:18 2021] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:33:18.808814 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00fe02-9fc0-417b-bac7-e8a083d4edb8 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:18.818848 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00fe02-9fc0-417b-bac7-e8a083d4edb8 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:18.824069 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a11d1-1c5b-4ed8-9b8c-f0ffefd81f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:18.824725 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a11d1-1c5b-4ed8-9b8c-f0ffefd81f0d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:18.825036 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a11d1-1c5b-4ed8-9b8c-f0ffefd81f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:18.825316 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a11d1-1c5b-4ed8-9b8c-f0ffefd81f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:18.826035 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a11d1-1c5b-4ed8-9b8c-f0ffefd81f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:18.827620 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a11d1-1c5b-4ed8-9b8c-f0ffefd81f0d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:18.838567 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 996/2022] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:33:18 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:33:18.842569 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e63f6-9f2b-4f11-b799-72015e4059e3 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:18.852325 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e63f6-9f2b-4f11-b799-72015e4059e3 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:18.857010 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730e752-cbe2-441e-ba82-4af2a869f4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:18.857646 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730e752-cbe2-441e-ba82-4af2a869f4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:18.857925 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730e752-cbe2-441e-ba82-4af2a869f4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:18.858202 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730e752-cbe2-441e-ba82-4af2a869f4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:18.858932 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730e752-cbe2-441e-ba82-4af2a869f4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:18.860578 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730e752-cbe2-441e-ba82-4af2a869f4f5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:18.870842 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1027/2023] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:33:18 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:33:18.874993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a11d1-1c5b-4ed8-9b8c-f0ffefd81f0d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:18.885382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a11d1-1c5b-4ed8-9b8c-f0ffefd81f0d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:18.890135 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b573b38-1833-4ea2-8614-23528ae972af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:18.891003 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b573b38-1833-4ea2-8614-23528ae972af admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:18.891283 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b573b38-1833-4ea2-8614-23528ae972af admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:18.891554 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b573b38-1833-4ea2-8614-23528ae972af admin admin] PATH_INFO: `/v3/projects/bd4c5ef0ddeb4d388c4205190cabbed8/users/dbfa399954ee40c982104c62314878ed/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:18.907145 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b573b38-1833-4ea2-8614-23528ae972af admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd4c5ef0ddeb4d388c4205190cabbed8, user_id=dbfa399954ee40c982104c62314878ed, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:18.910350 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b573b38-1833-4ea2-8614-23528ae972af admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:19.003681 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 997/2024] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:33:18 2021] PUT /identity/v3/projects/bd4c5ef0ddeb4d388c4205190cabbed8/users/dbfa399954ee40c982104c62314878ed/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:33:19.015683 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccee7f-d83b-4fb4-b2b6-24217c969738 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:19.016122 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccee7f-d83b-4fb4-b2b6-24217c969738 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:19.016862 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccee7f-d83b-4fb4-b2b6-24217c969738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:19.046010 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-64ccee7f-d83b-4fb4-b2b6-24217c969738 None None] MFA Rules not processed for user `dbfa399954ee40c982104c62314878ed`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:19.047224 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-64ccee7f-d83b-4fb4-b2b6-24217c969738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:19.111641 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1028/2025] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:33:19 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:33:19.115961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b573b38-1833-4ea2-8614-23528ae972af admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:19.186270 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b573b38-1833-4ea2-8614-23528ae972af admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:19.191554 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54ee2f-a8bd-4856-b302-bce66fb9c83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:19.192241 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54ee2f-a8bd-4856-b302-bce66fb9c83f admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:19.192667 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54ee2f-a8bd-4856-b302-bce66fb9c83f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:19.192982 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54ee2f-a8bd-4856-b302-bce66fb9c83f admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:19.193691 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54ee2f-a8bd-4856-b302-bce66fb9c83f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:19.200918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54ee2f-a8bd-4856-b302-bce66fb9c83f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:19.295360 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 998/2026] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:33:19 2021] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:33:19.296812 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccee7f-d83b-4fb4-b2b6-24217c969738 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:19.309167 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccee7f-d83b-4fb4-b2b6-24217c969738 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:19.375847 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b844d72-3314-4cc9-a6b5-e4edd8e74e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:19.376551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b844d72-3314-4cc9-a6b5-e4edd8e74e1b admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:19.376857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b844d72-3314-4cc9-a6b5-e4edd8e74e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:19.377128 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b844d72-3314-4cc9-a6b5-e4edd8e74e1b admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:19.377879 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b844d72-3314-4cc9-a6b5-e4edd8e74e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:19.379952 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b844d72-3314-4cc9-a6b5-e4edd8e74e1b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:19.546213 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1029/2027] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:33:19 2021] POST /identity/v3/users => generated 300 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:33:19.547352 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54ee2f-a8bd-4856-b302-bce66fb9c83f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:19.559511 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54ee2f-a8bd-4856-b302-bce66fb9c83f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:19.564645 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bd6ee-91f0-4375-993e-73b3f9ab1a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:19.565393 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bd6ee-91f0-4375-993e-73b3f9ab1a8c admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:19.565680 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bd6ee-91f0-4375-993e-73b3f9ab1a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:19.565960 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bd6ee-91f0-4375-993e-73b3f9ab1a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:19.566687 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0bd6ee-91f0-4375-993e-73b3f9ab1a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:19.568286 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0bd6ee-91f0-4375-993e-73b3f9ab1a8c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:19.583331 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 999/2028] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:33:19 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:33:19.584787 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b844d72-3314-4cc9-a6b5-e4edd8e74e1b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:19.596456 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b844d72-3314-4cc9-a6b5-e4edd8e74e1b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:19.602783 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ce5e9-f059-44d9-a2f5-58f68ea76932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:19.604322 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce5e9-f059-44d9-a2f5-58f68ea76932 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:19.604322 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce5e9-f059-44d9-a2f5-58f68ea76932 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:19.604498 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce5e9-f059-44d9-a2f5-58f68ea76932 admin admin] PATH_INFO: `/v3/projects/b518079a8c9744fa801344dcd5b157a7/users/a34a43a923eb484d86fb843c95b09bda/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:19.619936 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ce5e9-f059-44d9-a2f5-58f68ea76932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b518079a8c9744fa801344dcd5b157a7, user_id=a34a43a923eb484d86fb843c95b09bda, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:19.622758 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ce5e9-f059-44d9-a2f5-58f68ea76932 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:19.679229 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1030/2029] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:33:19 2021] PUT /identity/v3/projects/b518079a8c9744fa801344dcd5b157a7/users/a34a43a923eb484d86fb843c95b09bda/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:33:19.683695 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bd6ee-91f0-4375-993e-73b3f9ab1a8c admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:19.693899 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bd6ee-91f0-4375-993e-73b3f9ab1a8c admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:19.748254 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fa9ef-5279-4b35-b0a9-a036530dcdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:19.748968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fa9ef-5279-4b35-b0a9-a036530dcdbe admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:19.749253 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fa9ef-5279-4b35-b0a9-a036530dcdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:19.749533 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fa9ef-5279-4b35-b0a9-a036530dcdbe admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:19.750281 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fa9ef-5279-4b35-b0a9-a036530dcdbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:19.751863 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fa9ef-5279-4b35-b0a9-a036530dcdbe admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:19.762469 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1000/2030] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:33:19 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:33:19.766603 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ce5e9-f059-44d9-a2f5-58f68ea76932 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:19.776755 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ce5e9-f059-44d9-a2f5-58f68ea76932 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:19.781346 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2b996-ee28-404b-818f-cfa8b45a8f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:19.782205 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2b996-ee28-404b-818f-cfa8b45a8f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:19.782481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2b996-ee28-404b-818f-cfa8b45a8f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:19.782751 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2b996-ee28-404b-818f-cfa8b45a8f27 admin admin] PATH_INFO: `/v3/projects/b518079a8c9744fa801344dcd5b157a7/users/a34a43a923eb484d86fb843c95b09bda/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:19.784693 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2b996-ee28-404b-818f-cfa8b45a8f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b518079a8c9744fa801344dcd5b157a7, user_id=a34a43a923eb484d86fb843c95b09bda, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:19.787315 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2b996-ee28-404b-818f-cfa8b45a8f27 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:19.797350 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1031/2031] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:33:19 2021] PUT /identity/v3/projects/b518079a8c9744fa801344dcd5b157a7/users/a34a43a923eb484d86fb843c95b09bda/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:33:19.808014 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f6a11-1429-4f03-af40-8f0a8fdb3666 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:19.808328 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f6a11-1429-4f03-af40-8f0a8fdb3666 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:19.808606 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f6a11-1429-4f03-af40-8f0a8fdb3666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:19.834998 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-fe6f6a11-1429-4f03-af40-8f0a8fdb3666 None None] MFA Rules not processed for user `a34a43a923eb484d86fb843c95b09bda`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:19.836126 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-fe6f6a11-1429-4f03-af40-8f0a8fdb3666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:19.904184 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1001/2032] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:33:19 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:33:19.914755 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2b996-ee28-404b-818f-cfa8b45a8f27 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:19.916495 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a6b2b996-ee28-404b-818f-cfa8b45a8f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:19.972951 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2b996-ee28-404b-818f-cfa8b45a8f27 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:19.977454 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1baf8-4536-44c2-bc43-7fed025b2340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:19.978100 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1baf8-4536-44c2-bc43-7fed025b2340 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:19.978377 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1baf8-4536-44c2-bc43-7fed025b2340 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:19.978820 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1baf8-4536-44c2-bc43-7fed025b2340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:19.988952 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1baf8-4536-44c2-bc43-7fed025b2340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:19.990390 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1baf8-4536-44c2-bc43-7fed025b2340 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:19.999694 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1032/2033] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:33:19 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:33:20.061240 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f6a11-1429-4f03-af40-8f0a8fdb3666 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:20.124980 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f6a11-1429-4f03-af40-8f0a8fdb3666 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:20.130172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ae419-059f-41ba-bf4a-7b9ffa0b5431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:20.131272 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ae419-059f-41ba-bf4a-7b9ffa0b5431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:20.131618 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ae419-059f-41ba-bf4a-7b9ffa0b5431 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:20.131966 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ae419-059f-41ba-bf4a-7b9ffa0b5431 admin admin] PATH_INFO: `/v3/users/dbfa399954ee40c982104c62314878ed` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:20.133785 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ae419-059f-41ba-bf4a-7b9ffa0b5431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbfa399954ee40c982104c62314878ed)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:20.136051 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ae419-059f-41ba-bf4a-7b9ffa0b5431 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:20.302900 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-7d8ae419-059f-41ba-bf4a-7b9ffa0b5431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbfa399954ee40c982104c62314878ed'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:20.303540 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-7d8ae419-059f-41ba-bf4a-7b9ffa0b5431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbfa399954ee40c982104c62314878ed'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:20.314409 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-7d8ae419-059f-41ba-bf4a-7b9ffa0b5431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbfa399954ee40c982104c62314878ed'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:20.315364 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-7d8ae419-059f-41ba-bf4a-7b9ffa0b5431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbfa399954ee40c982104c62314878ed'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:20.364268 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-7d8ae419-059f-41ba-bf4a-7b9ffa0b5431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbfa399954ee40c982104c62314878ed'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:20.382515 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1002/2034] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:33:20 2021] DELETE /identity/v3/users/dbfa399954ee40c982104c62314878ed => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:33:20.390129 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaec1eb-d7e2-4756-8db7-277a71ee794b None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:20.390129 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaec1eb-d7e2-4756-8db7-277a71ee794b None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:20.390129 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaec1eb-d7e2-4756-8db7-277a71ee794b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:20.408270 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-baaec1eb-d7e2-4756-8db7-277a71ee794b None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:20.409582 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-baaec1eb-d7e2-4756-8db7-277a71ee794b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:20.470357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1033/2035] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:33:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:33:20.480710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ae419-059f-41ba-bf4a-7b9ffa0b5431 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:20.482321 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-7d8ae419-059f-41ba-bf4a-7b9ffa0b5431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:20.546557 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ae419-059f-41ba-bf4a-7b9ffa0b5431 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:20.550317 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000382d2-d5a7-4a03-94a5-c1fb82ec4ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:20.550970 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000382d2-d5a7-4a03-94a5-c1fb82ec4ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:20.551255 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000382d2-d5a7-4a03-94a5-c1fb82ec4ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:20.551533 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000382d2-d5a7-4a03-94a5-c1fb82ec4ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:20.562523 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000382d2-d5a7-4a03-94a5-c1fb82ec4ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:20.564008 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000382d2-d5a7-4a03-94a5-c1fb82ec4ab8 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:20.575048 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1003/2036] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:33:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:33:21.029239 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaec1eb-d7e2-4756-8db7-277a71ee794b None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:21.030665 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-baaec1eb-d7e2-4756-8db7-277a71ee794b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:21.043485 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaec1eb-d7e2-4756-8db7-277a71ee794b None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:21.048151 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac8861-c6d2-439f-b159-e77b346db334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:21.049035 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac8861-c6d2-439f-b159-e77b346db334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:21.049317 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac8861-c6d2-439f-b159-e77b346db334 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:21.049615 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac8861-c6d2-439f-b159-e77b346db334 admin admin] PATH_INFO: `/v3/projects/bd4c5ef0ddeb4d388c4205190cabbed8` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:21.050776 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac8861-c6d2-439f-b159-e77b346db334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd4c5ef0ddeb4d388c4205190cabbed8)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:21.053031 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac8861-c6d2-439f-b159-e77b346db334 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:21.311071 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a1ac8861-c6d2-439f-b159-e77b346db334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd4c5ef0ddeb4d388c4205190cabbed8', 'request_id': 'req-a1ac8861-c6d2-439f-b159-e77b346db334'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:21.320160 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a1ac8861-c6d2-439f-b159-e77b346db334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd4c5ef0ddeb4d388c4205190cabbed8', 'request_id': 'req-a1ac8861-c6d2-439f-b159-e77b346db334'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:21.370021 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a1ac8861-c6d2-439f-b159-e77b346db334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd4c5ef0ddeb4d388c4205190cabbed8', 'request_id': 'req-a1ac8861-c6d2-439f-b159-e77b346db334'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:21.392979 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a1ac8861-c6d2-439f-b159-e77b346db334 admin admin] The token cache is being invalidate because project bd4c5ef0ddeb4d388c4205190cabbed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:33:21.392979 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a1ac8861-c6d2-439f-b159-e77b346db334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:21.392979 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-a1ac8861-c6d2-439f-b159-e77b346db334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:21.394525 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1034/2037] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:33:21 2021] DELETE /identity/v3/projects/bd4c5ef0ddeb4d388c4205190cabbed8 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:33:21.398357 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000382d2-d5a7-4a03-94a5-c1fb82ec4ab8 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:21.409786 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000382d2-d5a7-4a03-94a5-c1fb82ec4ab8 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:21.484168 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ce9a7-0065-4c75-adee-e8db7d078ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:21.485060 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ce9a7-0065-4c75-adee-e8db7d078ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:21.485337 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ce9a7-0065-4c75-adee-e8db7d078ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:21.485612 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ce9a7-0065-4c75-adee-e8db7d078ec0 admin admin] PATH_INFO: `/v3/users/a34a43a923eb484d86fb843c95b09bda` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:21.486788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ce9a7-0065-4c75-adee-e8db7d078ec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a34a43a923eb484d86fb843c95b09bda)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:21.488687 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ce9a7-0065-4c75-adee-e8db7d078ec0 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:21.665450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-214ce9a7-0065-4c75-adee-e8db7d078ec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a34a43a923eb484d86fb843c95b09bda'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:21.666129 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-214ce9a7-0065-4c75-adee-e8db7d078ec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a34a43a923eb484d86fb843c95b09bda'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:21.674315 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-214ce9a7-0065-4c75-adee-e8db7d078ec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a34a43a923eb484d86fb843c95b09bda'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:21.674315 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-214ce9a7-0065-4c75-adee-e8db7d078ec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a34a43a923eb484d86fb843c95b09bda'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:21.741569 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-214ce9a7-0065-4c75-adee-e8db7d078ec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a34a43a923eb484d86fb843c95b09bda'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:21.764033 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1004/2038] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:33:21 2021] DELETE /identity/v3/users/a34a43a923eb484d86fb843c95b09bda => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:33:22.331246 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac8861-c6d2-439f-b159-e77b346db334 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:22.340032 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a1ac8861-c6d2-439f-b159-e77b346db334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:22.350324 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac8861-c6d2-439f-b159-e77b346db334 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:22.407639 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07b4ee-1383-43ad-ac19-2f6075cc07e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:22.408499 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07b4ee-1383-43ad-ac19-2f6075cc07e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:22.408778 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07b4ee-1383-43ad-ac19-2f6075cc07e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:22.409087 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07b4ee-1383-43ad-ac19-2f6075cc07e2 admin admin] PATH_INFO: `/v3/projects/b518079a8c9744fa801344dcd5b157a7` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:22.410255 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07b4ee-1383-43ad-ac19-2f6075cc07e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b518079a8c9744fa801344dcd5b157a7)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:22.412189 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07b4ee-1383-43ad-ac19-2f6075cc07e2 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:22.508734 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-5a07b4ee-1383-43ad-ac19-2f6075cc07e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b518079a8c9744fa801344dcd5b157a7', 'request_id': 'req-5a07b4ee-1383-43ad-ac19-2f6075cc07e2'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:22.515836 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-5a07b4ee-1383-43ad-ac19-2f6075cc07e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b518079a8c9744fa801344dcd5b157a7', 'request_id': 'req-5a07b4ee-1383-43ad-ac19-2f6075cc07e2'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:22.590535 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-5a07b4ee-1383-43ad-ac19-2f6075cc07e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b518079a8c9744fa801344dcd5b157a7', 'request_id': 'req-5a07b4ee-1383-43ad-ac19-2f6075cc07e2'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:22.603420 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-5a07b4ee-1383-43ad-ac19-2f6075cc07e2 admin admin] The token cache is being invalidate because project b518079a8c9744fa801344dcd5b157a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:33:22.604038 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-5a07b4ee-1383-43ad-ac19-2f6075cc07e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:22.604931 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-5a07b4ee-1383-43ad-ac19-2f6075cc07e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:22.607056 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1035/2039] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:33:22 2021] DELETE /identity/v3/projects/b518079a8c9744fa801344dcd5b157a7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:33:22.614558 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6165546-f01d-4c96-9fcb-29d72e40849f None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:22.615098 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6165546-f01d-4c96-9fcb-29d72e40849f None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:22.615656 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6165546-f01d-4c96-9fcb-29d72e40849f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:22.637118 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-e6165546-f01d-4c96-9fcb-29d72e40849f None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:22.638493 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e6165546-f01d-4c96-9fcb-29d72e40849f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:22.699560 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1005/2040] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:33:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:33:22.707344 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbff16-9d92-4ec3-accc-32486b6e066f None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:22.707634 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbff16-9d92-4ec3-accc-32486b6e066f None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:22.707916 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbff16-9d92-4ec3-accc-32486b6e066f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:22.725959 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-22bbff16-9d92-4ec3-accc-32486b6e066f None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:22.727208 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-22bbff16-9d92-4ec3-accc-32486b6e066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:22.737106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1036/2041] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:33:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:33:22.746856 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6165546-f01d-4c96-9fcb-29d72e40849f None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:22.760019 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6165546-f01d-4c96-9fcb-29d72e40849f None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:22.764997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221248b-8153-4383-ad6a-e846a34555f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:22.765979 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221248b-8153-4383-ad6a-e846a34555f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:22.766263 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221248b-8153-4383-ad6a-e846a34555f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:22.766534 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221248b-8153-4383-ad6a-e846a34555f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:22.767258 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221248b-8153-4383-ad6a-e846a34555f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:33:22.767634 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221248b-8153-4383-ad6a-e846a34555f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:22.769252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221248b-8153-4383-ad6a-e846a34555f0 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:22.782463 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1006/2042] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:33:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:33:22.786417 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbff16-9d92-4ec3-accc-32486b6e066f None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:22.795922 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbff16-9d92-4ec3-accc-32486b6e066f None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:22.801279 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1492978-9974-47fe-b7fb-dd49344127c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:22.802229 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1492978-9974-47fe-b7fb-dd49344127c3 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:22.802547 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1492978-9974-47fe-b7fb-dd49344127c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:22.802831 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1492978-9974-47fe-b7fb-dd49344127c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:22.803537 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1492978-9974-47fe-b7fb-dd49344127c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:22.805994 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1492978-9974-47fe-b7fb-dd49344127c3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:22.892901 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1037/2043] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:33:22 2021] POST /identity/v3/projects => generated 407 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:33:22.897189 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221248b-8153-4383-ad6a-e846a34555f0 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:22.907239 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221248b-8153-4383-ad6a-e846a34555f0 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:22.962651 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92026e-c4c8-4e22-888f-40e7f5f003c4 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:22.965353 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92026e-c4c8-4e22-888f-40e7f5f003c4 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:22.965353 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92026e-c4c8-4e22-888f-40e7f5f003c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:22.966597 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fbdd9-1722-4050-ab50-0d224dada330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:22.967275 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fbdd9-1722-4050-ab50-0d224dada330 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:22.967553 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fbdd9-1722-4050-ab50-0d224dada330 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:22.967825 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fbdd9-1722-4050-ab50-0d224dada330 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:22.968655 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13fbdd9-1722-4050-ab50-0d224dada330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:22.970625 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13fbdd9-1722-4050-ab50-0d224dada330 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:22.992149 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-bd92026e-c4c8-4e22-888f-40e7f5f003c4 None None] MFA Rules not processed for user `3f65fb7e73db469f8b171c3126005427`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:22.994060 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-bd92026e-c4c8-4e22-888f-40e7f5f003c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:23.040873 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1007/2044] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:33:22 2021] POST /identity/v3/users => generated 304 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:33:23.043788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fbdd9-1722-4050-ab50-0d224dada330 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:23.069396 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fbdd9-1722-4050-ab50-0d224dada330 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:23.072671 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1038/2045] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 01:33:22 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:33:23.075302 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d19ae-3d54-4c84-b818-669ac2d6296b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:23.076117 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d19ae-3d54-4c84-b818-669ac2d6296b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:23.076400 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d19ae-3d54-4c84-b818-669ac2d6296b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:23.076998 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d19ae-3d54-4c84-b818-669ac2d6296b admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:23.077730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d19ae-3d54-4c84-b818-669ac2d6296b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:23.079460 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d19ae-3d54-4c84-b818-669ac2d6296b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:23.100102 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1008/2046] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:33:23 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:33:23.104983 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92026e-c4c8-4e22-888f-40e7f5f003c4 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:23.129224 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d19ae-3d54-4c84-b818-669ac2d6296b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:23.130045 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92026e-c4c8-4e22-888f-40e7f5f003c4 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:23.131713 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8e2d19ae-3d54-4c84-b818-669ac2d6296b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:23.136921 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573a1ad-c978-47eb-a94f-6b140fe4b276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:23.137608 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573a1ad-c978-47eb-a94f-6b140fe4b276 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:23.137887 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573a1ad-c978-47eb-a94f-6b140fe4b276 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:23.138168 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573a1ad-c978-47eb-a94f-6b140fe4b276 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:23.139146 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573a1ad-c978-47eb-a94f-6b140fe4b276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:23.140751 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573a1ad-c978-47eb-a94f-6b140fe4b276 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:23.154929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1039/2047] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:33:23 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:33:23.156327 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573a1ad-c978-47eb-a94f-6b140fe4b276 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:23.169638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573a1ad-c978-47eb-a94f-6b140fe4b276 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:23.180350 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd905073-e4c7-4b49-8728-ee0ac4f0a818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:23.180350 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd905073-e4c7-4b49-8728-ee0ac4f0a818 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:23.180350 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd905073-e4c7-4b49-8728-ee0ac4f0a818 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:23.180350 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd905073-e4c7-4b49-8728-ee0ac4f0a818 admin admin] PATH_INFO: `/v3/projects/51ef8c453fe94424a4bb29896d65d600/users/b0ee0eec63a8491f96e89c34ac9cf12c/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:23.196217 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd905073-e4c7-4b49-8728-ee0ac4f0a818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ef8c453fe94424a4bb29896d65d600, user_id=b0ee0eec63a8491f96e89c34ac9cf12c, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:23.200808 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd905073-e4c7-4b49-8728-ee0ac4f0a818 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:23.216164 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d19ae-3d54-4c84-b818-669ac2d6296b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:23.223673 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512d0c5-53ef-4306-8abc-283a249b541b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48536f4437240b79cf10961de9cc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:23.224336 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512d0c5-53ef-4306-8abc-283a249b541b service swift] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:23.224657 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512d0c5-53ef-4306-8abc-283a249b541b service swift] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:23.224960 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512d0c5-53ef-4306-8abc-283a249b541b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:23.235224 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512d0c5-53ef-4306-8abc-283a249b541b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:23.238120 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512d0c5-53ef-4306-8abc-283a249b541b service swift] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:23.255535 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1009/2048] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 01:33:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 01:33:23.288427 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1040/2049] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:33:23 2021] PUT /identity/v3/projects/51ef8c453fe94424a4bb29896d65d600/users/b0ee0eec63a8491f96e89c34ac9cf12c/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:33:23.294015 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890082d0-b27a-4bbb-9d64-2306afb12cd4 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:23.294538 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890082d0-b27a-4bbb-9d64-2306afb12cd4 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:23.294982 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890082d0-b27a-4bbb-9d64-2306afb12cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:23.332206 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-890082d0-b27a-4bbb-9d64-2306afb12cd4 None None] MFA Rules not processed for user `b0ee0eec63a8491f96e89c34ac9cf12c`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:23.333983 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-890082d0-b27a-4bbb-9d64-2306afb12cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:23.490684 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1010/2050] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:33:23 2021] POST /identity/v3/auth/tokens => generated 3427 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:33:23.495468 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd905073-e4c7-4b49-8728-ee0ac4f0a818 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:23.596431 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd905073-e4c7-4b49-8728-ee0ac4f0a818 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:23.601505 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b4d89-f59d-42ad-ab23-b2de5ba592cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:23.602472 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b4d89-f59d-42ad-ab23-b2de5ba592cf admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:23.602914 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b4d89-f59d-42ad-ab23-b2de5ba592cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:23.603339 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b4d89-f59d-42ad-ab23-b2de5ba592cf admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:23.606282 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b4d89-f59d-42ad-ab23-b2de5ba592cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:23.608437 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b4d89-f59d-42ad-ab23-b2de5ba592cf admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:23.717593 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1041/2051] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:33:23 2021] POST /identity/v3/projects => generated 409 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:33:23.721716 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890082d0-b27a-4bbb-9d64-2306afb12cd4 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:23.743840 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890082d0-b27a-4bbb-9d64-2306afb12cd4 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:23.829763 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed4e88-c65a-4c0c-9bc0-9cff8f64b0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:23.830905 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed4e88-c65a-4c0c-9bc0-9cff8f64b0cf admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:23.831336 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed4e88-c65a-4c0c-9bc0-9cff8f64b0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:23.834496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed4e88-c65a-4c0c-9bc0-9cff8f64b0cf admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:23.834496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed4e88-c65a-4c0c-9bc0-9cff8f64b0cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:23.835166 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed4e88-c65a-4c0c-9bc0-9cff8f64b0cf admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:23.939578 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1011/2052] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:33:23 2021] POST /identity/v3/users => generated 311 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:33:23.944945 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b4d89-f59d-42ad-ab23-b2de5ba592cf admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:23.960052 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b4d89-f59d-42ad-ab23-b2de5ba592cf admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:23.966057 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53094f-5d69-4cf9-8465-d9a58438c5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:23.966852 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53094f-5d69-4cf9-8465-d9a58438c5ff admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:23.967175 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53094f-5d69-4cf9-8465-d9a58438c5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:23.967454 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53094f-5d69-4cf9-8465-d9a58438c5ff admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:23.968333 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53094f-5d69-4cf9-8465-d9a58438c5ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:23.969996 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53094f-5d69-4cf9-8465-d9a58438c5ff admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:23.983525 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1042/2053] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:33:23 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:33:23.987401 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed4e88-c65a-4c0c-9bc0-9cff8f64b0cf admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:23.998964 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed4e88-c65a-4c0c-9bc0-9cff8f64b0cf admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:24.008655 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42dfc6-c75a-43de-af38-d125eff290a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:24.012441 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42dfc6-c75a-43de-af38-d125eff290a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:24.012441 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42dfc6-c75a-43de-af38-d125eff290a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:24.012441 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42dfc6-c75a-43de-af38-d125eff290a2 admin admin] PATH_INFO: `/v3/projects/6087daa59ad64312a3b4579e38c7e8d9/users/a594164968d841189105d7a6a0621531/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:24.027602 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42dfc6-c75a-43de-af38-d125eff290a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6087daa59ad64312a3b4579e38c7e8d9, user_id=a594164968d841189105d7a6a0621531, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:24.030473 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42dfc6-c75a-43de-af38-d125eff290a2 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:24.137132 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1012/2054] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:33:23 2021] PUT /identity/v3/projects/6087daa59ad64312a3b4579e38c7e8d9/users/a594164968d841189105d7a6a0621531/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:33:24.141206 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53094f-5d69-4cf9-8465-d9a58438c5ff admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:24.160292 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53094f-5d69-4cf9-8465-d9a58438c5ff admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:24.229075 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ef81b-92cc-4b61-94ac-fda1409a1848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:24.230194 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ef81b-92cc-4b61-94ac-fda1409a1848 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:24.230544 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ef81b-92cc-4b61-94ac-fda1409a1848 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:24.230946 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ef81b-92cc-4b61-94ac-fda1409a1848 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:24.231764 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ef81b-92cc-4b61-94ac-fda1409a1848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:24.233795 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ef81b-92cc-4b61-94ac-fda1409a1848 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:24.249204 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1043/2055] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:33:24 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:33:24.250253 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42dfc6-c75a-43de-af38-d125eff290a2 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:24.262247 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42dfc6-c75a-43de-af38-d125eff290a2 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:24.269013 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b14bdb-d70c-4373-987f-3204899f8078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:24.273454 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b14bdb-d70c-4373-987f-3204899f8078 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:24.273454 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b14bdb-d70c-4373-987f-3204899f8078 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:24.273454 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b14bdb-d70c-4373-987f-3204899f8078 admin admin] PATH_INFO: `/v3/projects/6087daa59ad64312a3b4579e38c7e8d9/users/a594164968d841189105d7a6a0621531/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:24.273454 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b14bdb-d70c-4373-987f-3204899f8078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6087daa59ad64312a3b4579e38c7e8d9, user_id=a594164968d841189105d7a6a0621531, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:24.276362 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b14bdb-d70c-4373-987f-3204899f8078 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:24.300123 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55e250-4302-453e-8270-4ae890f2258d None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:24.300477 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55e250-4302-453e-8270-4ae890f2258d None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:24.300892 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55e250-4302-453e-8270-4ae890f2258d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:24.311441 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1013/2056] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:33:24 2021] PUT /identity/v3/projects/6087daa59ad64312a3b4579e38c7e8d9/users/a594164968d841189105d7a6a0621531/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:33:24.337541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-1c55e250-4302-453e-8270-4ae890f2258d None None] MFA Rules not processed for user `a594164968d841189105d7a6a0621531`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:24.340149 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-1c55e250-4302-453e-8270-4ae890f2258d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:24.439381 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1044/2057] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:33:24 2021] POST /identity/v3/auth/tokens => generated 3496 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:33:24.474543 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b14bdb-d70c-4373-987f-3204899f8078 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:24.476567 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b0b14bdb-d70c-4373-987f-3204899f8078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:24.624441 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b14bdb-d70c-4373-987f-3204899f8078 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:24.638227 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b7c44-e294-41bf-aefb-7e7541144737 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:24.639312 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b7c44-e294-41bf-aefb-7e7541144737 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:24.639602 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b7c44-e294-41bf-aefb-7e7541144737 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:24.640367 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b7c44-e294-41bf-aefb-7e7541144737 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:24.654467 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b7c44-e294-41bf-aefb-7e7541144737 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:24.655930 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b7c44-e294-41bf-aefb-7e7541144737 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:24.698223 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1014/2058] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:33:24 2021] GET /identity/v3/auth/tokens => generated 3496 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:33:25.363638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55e250-4302-453e-8270-4ae890f2258d None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:25.378530 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55e250-4302-453e-8270-4ae890f2258d None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:25.379400 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10ce95-b957-4cea-976d-f9518773228c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:25.380249 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10ce95-b957-4cea-976d-f9518773228c service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:25.380356 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10ce95-b957-4cea-976d-f9518773228c service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:25.380632 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10ce95-b957-4cea-976d-f9518773228c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:25.505991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10ce95-b957-4cea-976d-f9518773228c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:25.510031 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10ce95-b957-4cea-976d-f9518773228c service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:25.520338 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1045/2059] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:33:25 2021] GET /identity/v3/auth/tokens => generated 3427 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:33:45.020393 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b7c44-e294-41bf-aefb-7e7541144737 service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:45.023451 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e74b7c44-e294-41bf-aefb-7e7541144737 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:45.112549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b7c44-e294-41bf-aefb-7e7541144737 service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:45.118117 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c832a7-6081-43bd-8407-1826e5f7db98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd67c0b68ca7349399d9ea9f4a0b2b564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:45.118754 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c832a7-6081-43bd-8407-1826e5f7db98 service placement] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:45.119031 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c832a7-6081-43bd-8407-1826e5f7db98 service placement] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:45.119302 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c832a7-6081-43bd-8407-1826e5f7db98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:45.121035 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d6c832a7-6081-43bd-8407-1826e5f7db98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:45.132391 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c832a7-6081-43bd-8407-1826e5f7db98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:45.134146 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c832a7-6081-43bd-8407-1826e5f7db98 service placement] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:45.144347 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1015/2060] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:33:45 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:33:45.741168 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10ce95-b957-4cea-976d-f9518773228c service cinder] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:45.808588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10ce95-b957-4cea-976d-f9518773228c service cinder] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:45.811920 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c761d0-a788-48e1-a386-ce8312d0120d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:45.812886 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c761d0-a788-48e1-a386-ce8312d0120d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:45.813250 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c761d0-a788-48e1-a386-ce8312d0120d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:45.813599 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c761d0-a788-48e1-a386-ce8312d0120d admin admin] PATH_INFO: `/v3/users/b0ee0eec63a8491f96e89c34ac9cf12c` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:45.814873 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c761d0-a788-48e1-a386-ce8312d0120d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ee0eec63a8491f96e89c34ac9cf12c)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:45.816947 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c761d0-a788-48e1-a386-ce8312d0120d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:45.988338 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-03c761d0-a788-48e1-a386-ce8312d0120d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ee0eec63a8491f96e89c34ac9cf12c'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:46.000182 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-03c761d0-a788-48e1-a386-ce8312d0120d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ee0eec63a8491f96e89c34ac9cf12c'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:46.008219 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-03c761d0-a788-48e1-a386-ce8312d0120d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ee0eec63a8491f96e89c34ac9cf12c'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:46.009991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-03c761d0-a788-48e1-a386-ce8312d0120d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ee0eec63a8491f96e89c34ac9cf12c'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:46.123103 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-03c761d0-a788-48e1-a386-ce8312d0120d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ee0eec63a8491f96e89c34ac9cf12c'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:46.129667 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1046/2061] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:33:45 2021] DELETE /identity/v3/users/b0ee0eec63a8491f96e89c34ac9cf12c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:33:46.135205 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb555a39-2519-4405-a31b-e444611dff3e None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:46.135687 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb555a39-2519-4405-a31b-e444611dff3e None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:46.135784 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb555a39-2519-4405-a31b-e444611dff3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:46.152882 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-eb555a39-2519-4405-a31b-e444611dff3e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:46.154218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-eb555a39-2519-4405-a31b-e444611dff3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:46.216551 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1016/2062] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:33:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:33:46.234225 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c761d0-a788-48e1-a386-ce8312d0120d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:46.235735 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-03c761d0-a788-48e1-a386-ce8312d0120d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:46.292850 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c761d0-a788-48e1-a386-ce8312d0120d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:46.296426 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ba681-5a6a-48d2-8b26-150579e3b288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:46.297119 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ba681-5a6a-48d2-8b26-150579e3b288 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:46.297402 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ba681-5a6a-48d2-8b26-150579e3b288 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:46.297676 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ba681-5a6a-48d2-8b26-150579e3b288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:46.307479 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ba681-5a6a-48d2-8b26-150579e3b288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:46.308937 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ba681-5a6a-48d2-8b26-150579e3b288 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:46.319029 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1047/2063] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:33:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:33:46.745974 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb555a39-2519-4405-a31b-e444611dff3e None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:46.748517 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-eb555a39-2519-4405-a31b-e444611dff3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:46.765484 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb555a39-2519-4405-a31b-e444611dff3e None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:46.770918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07fe2a-29d5-43a0-92ba-cf0eef0dc995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:46.771862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07fe2a-29d5-43a0-92ba-cf0eef0dc995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:46.772109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07fe2a-29d5-43a0-92ba-cf0eef0dc995 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:46.772395 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07fe2a-29d5-43a0-92ba-cf0eef0dc995 admin admin] PATH_INFO: `/v3/projects/51ef8c453fe94424a4bb29896d65d600` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:46.774784 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07fe2a-29d5-43a0-92ba-cf0eef0dc995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ef8c453fe94424a4bb29896d65d600)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:46.777026 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07fe2a-29d5-43a0-92ba-cf0eef0dc995 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:46.896739 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2d07fe2a-29d5-43a0-92ba-cf0eef0dc995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ef8c453fe94424a4bb29896d65d600', 'request_id': 'req-2d07fe2a-29d5-43a0-92ba-cf0eef0dc995'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:46.904513 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2d07fe2a-29d5-43a0-92ba-cf0eef0dc995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ef8c453fe94424a4bb29896d65d600', 'request_id': 'req-2d07fe2a-29d5-43a0-92ba-cf0eef0dc995'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:46.968876 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2d07fe2a-29d5-43a0-92ba-cf0eef0dc995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ef8c453fe94424a4bb29896d65d600', 'request_id': 'req-2d07fe2a-29d5-43a0-92ba-cf0eef0dc995'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:46.980893 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2d07fe2a-29d5-43a0-92ba-cf0eef0dc995 admin admin] The token cache is being invalidate because project 51ef8c453fe94424a4bb29896d65d600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:33:46.981177 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2d07fe2a-29d5-43a0-92ba-cf0eef0dc995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:46.981785 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2d07fe2a-29d5-43a0-92ba-cf0eef0dc995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:46.983304 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1017/2064] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:33:46 2021] DELETE /identity/v3/projects/51ef8c453fe94424a4bb29896d65d600 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:33:46.987186 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ba681-5a6a-48d2-8b26-150579e3b288 service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:46.997372 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ba681-5a6a-48d2-8b26-150579e3b288 service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:47.050431 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15fdaa-a567-4a9e-be28-d82a1bf75b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:47.052326 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15fdaa-a567-4a9e-be28-d82a1bf75b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:47.052326 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15fdaa-a567-4a9e-be28-d82a1bf75b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:47.052326 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15fdaa-a567-4a9e-be28-d82a1bf75b83 admin admin] PATH_INFO: `/v3/users/a594164968d841189105d7a6a0621531` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:47.053379 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15fdaa-a567-4a9e-be28-d82a1bf75b83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a594164968d841189105d7a6a0621531)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:47.055889 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15fdaa-a567-4a9e-be28-d82a1bf75b83 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:47.269120 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-dc15fdaa-a567-4a9e-be28-d82a1bf75b83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a594164968d841189105d7a6a0621531'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:47.281188 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-dc15fdaa-a567-4a9e-be28-d82a1bf75b83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a594164968d841189105d7a6a0621531'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:47.288525 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-dc15fdaa-a567-4a9e-be28-d82a1bf75b83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a594164968d841189105d7a6a0621531'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:47.289364 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-dc15fdaa-a567-4a9e-be28-d82a1bf75b83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a594164968d841189105d7a6a0621531'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:47.363541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-dc15fdaa-a567-4a9e-be28-d82a1bf75b83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a594164968d841189105d7a6a0621531'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:47.370543 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1048/2065] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:33:46 2021] DELETE /identity/v3/users/a594164968d841189105d7a6a0621531 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:33:47.772108 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07fe2a-29d5-43a0-92ba-cf0eef0dc995 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:47.773626 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-2d07fe2a-29d5-43a0-92ba-cf0eef0dc995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:47.792866 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07fe2a-29d5-43a0-92ba-cf0eef0dc995 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:47.830589 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fdd1a-c5c7-43ed-89b5-3f58eaa9f136 None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:47.830880 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fdd1a-c5c7-43ed-89b5-3f58eaa9f136 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:47.831158 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fdd1a-c5c7-43ed-89b5-3f58eaa9f136 None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:47.833176 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1049/2066] 10.222.0.25 () {54 vars in 921 bytes} [Fri Aug 27 01:33:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:33:47.843455 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e84fb-d5ce-4a77-8942-b399c52dc044 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:47.843747 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e84fb-d5ce-4a77-8942-b399c52dc044 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:47.844024 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e84fb-d5ce-4a77-8942-b399c52dc044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:47.882931 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236946f-5b1c-418e-870a-fa26f1c4c4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:47.884628 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236946f-5b1c-418e-870a-fa26f1c4c4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:47.885028 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236946f-5b1c-418e-870a-fa26f1c4c4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:47.885371 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236946f-5b1c-418e-870a-fa26f1c4c4a4 admin admin] PATH_INFO: `/v3/projects/6087daa59ad64312a3b4579e38c7e8d9` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:47.892569 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236946f-5b1c-418e-870a-fa26f1c4c4a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6087daa59ad64312a3b4579e38c7e8d9)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:47.894750 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236946f-5b1c-418e-870a-fa26f1c4c4a4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:47.914003 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-1f2e84fb-d5ce-4a77-8942-b399c52dc044 None None] MFA Rules not processed for user `249a7642a0284dde91a7719f732b2d70`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:47.915245 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-1f2e84fb-d5ce-4a77-8942-b399c52dc044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:47.987985 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0236946f-5b1c-418e-870a-fa26f1c4c4a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6087daa59ad64312a3b4579e38c7e8d9', 'request_id': 'req-0236946f-5b1c-418e-870a-fa26f1c4c4a4'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:47.989905 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1050/2067] 10.222.0.25 () {58 vars in 1019 bytes} [Fri Aug 27 01:33:47 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:33:47.997090 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0236946f-5b1c-418e-870a-fa26f1c4c4a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6087daa59ad64312a3b4579e38c7e8d9', 'request_id': 'req-0236946f-5b1c-418e-870a-fa26f1c4c4a4'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:48.004305 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e84fb-d5ce-4a77-8942-b399c52dc044 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:48.005215 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-1f2e84fb-d5ce-4a77-8942-b399c52dc044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:48.037678 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0236946f-5b1c-418e-870a-fa26f1c4c4a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6087daa59ad64312a3b4579e38c7e8d9', 'request_id': 'req-0236946f-5b1c-418e-870a-fa26f1c4c4a4'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:48.049240 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0236946f-5b1c-418e-870a-fa26f1c4c4a4 admin admin] The token cache is being invalidate because project 6087daa59ad64312a3b4579e38c7e8d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:33:48.049656 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0236946f-5b1c-418e-870a-fa26f1c4c4a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:48.050471 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0236946f-5b1c-418e-870a-fa26f1c4c4a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:33:48.056508 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1018/2068] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:33:47 2021] DELETE /identity/v3/projects/6087daa59ad64312a3b4579e38c7e8d9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:33:48.058473 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07423606-a9eb-4edf-894d-849739ad8d22 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:48.058835 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07423606-a9eb-4edf-894d-849739ad8d22 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:48.059272 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07423606-a9eb-4edf-894d-849739ad8d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:48.079068 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-07423606-a9eb-4edf-894d-849739ad8d22 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:48.080307 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-07423606-a9eb-4edf-894d-849739ad8d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:48.088377 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e84fb-d5ce-4a77-8942-b399c52dc044 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:48.140310 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace9ea2-0bfd-4f85-a8f8-912de57bb362 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59679a5d71249fc8cd65fbcf84e7bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:48.141171 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace9ea2-0bfd-4f85-a8f8-912de57bb362 service glance] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:48.141578 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace9ea2-0bfd-4f85-a8f8-912de57bb362 service glance] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:48.141956 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace9ea2-0bfd-4f85-a8f8-912de57bb362 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:48.143215 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1019/2069] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:33:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:33:48.150616 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-2ace9ea2-0bfd-4f85-a8f8-912de57bb362 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:48.151755 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f999fbd-3862-4790-9af9-1fcb6edb5e20 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:48.152114 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f999fbd-3862-4790-9af9-1fcb6edb5e20 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:48.152559 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f999fbd-3862-4790-9af9-1fcb6edb5e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:48.171699 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-2f999fbd-3862-4790-9af9-1fcb6edb5e20 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:48.172740 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-2f999fbd-3862-4790-9af9-1fcb6edb5e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:48.182288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1020/2070] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:33:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:33:48.186504 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f999fbd-3862-4790-9af9-1fcb6edb5e20 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:48.196707 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f999fbd-3862-4790-9af9-1fcb6edb5e20 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:48.207084 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195a478-e9be-438a-9937-6b96bc8d6b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:48.208205 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195a478-e9be-438a-9937-6b96bc8d6b13 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:48.208490 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195a478-e9be-438a-9937-6b96bc8d6b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:48.208791 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195a478-e9be-438a-9937-6b96bc8d6b13 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:48.209524 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195a478-e9be-438a-9937-6b96bc8d6b13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:33:48.211087 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195a478-e9be-438a-9937-6b96bc8d6b13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:48.213507 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195a478-e9be-438a-9937-6b96bc8d6b13 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:48.230168 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1021/2071] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:33:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:33:48.235784 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195a478-e9be-438a-9937-6b96bc8d6b13 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:48.237570 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace9ea2-0bfd-4f85-a8f8-912de57bb362 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:48.239097 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace9ea2-0bfd-4f85-a8f8-912de57bb362 service glance] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:48.246235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195a478-e9be-438a-9937-6b96bc8d6b13 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:48.251231 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab461ff0-e2ef-4de6-8fd2-d7422639049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:48.251408 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1051/2072] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:33:48 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:33:48.251714 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab461ff0-e2ef-4de6-8fd2-d7422639049c admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:48.251999 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab461ff0-e2ef-4de6-8fd2-d7422639049c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:48.252356 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab461ff0-e2ef-4de6-8fd2-d7422639049c admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:48.253092 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab461ff0-e2ef-4de6-8fd2-d7422639049c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:48.254982 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab461ff0-e2ef-4de6-8fd2-d7422639049c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:48.378847 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1022/2073] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:33:48 2021] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:33:48.380809 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace9ea2-0bfd-4f85-a8f8-912de57bb362 service glance] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:48.391848 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace9ea2-0bfd-4f85-a8f8-912de57bb362 service glance] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:48.452156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6bc3e3-20df-4bcf-ae40-3478dc1e6172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:48.452914 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bc3e3-20df-4bcf-ae40-3478dc1e6172 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:48.453231 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bc3e3-20df-4bcf-ae40-3478dc1e6172 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:48.453515 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bc3e3-20df-4bcf-ae40-3478dc1e6172 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:48.454218 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6bc3e3-20df-4bcf-ae40-3478dc1e6172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:48.456161 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6bc3e3-20df-4bcf-ae40-3478dc1e6172 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:48.491130 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085d2a0-0cbe-44e1-9e30-f4784246b1b5 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:48.491422 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085d2a0-0cbe-44e1-9e30-f4784246b1b5 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:48.491717 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085d2a0-0cbe-44e1-9e30-f4784246b1b5 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:48.494172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1023/2074] 10.222.0.25 () {54 vars in 921 bytes} [Fri Aug 27 01:33:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 01:33:48.504625 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278c5c9-7f4e-4872-89f1-bb48e6116c95 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:48.504625 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278c5c9-7f4e-4872-89f1-bb48e6116c95 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:48.504625 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278c5c9-7f4e-4872-89f1-bb48e6116c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:48.520893 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b278c5c9-7f4e-4872-89f1-bb48e6116c95 None None] MFA Rules not processed for user `2e2182e4d74047a399e7ffea63e7ce6e`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:48.522097 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b278c5c9-7f4e-4872-89f1-bb48e6116c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:48.568972 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1052/2075] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:33:48 2021] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:33:48.573463 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6bc3e3-20df-4bcf-ae40-3478dc1e6172 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:48.578198 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1024/2076] 10.222.0.25 () {58 vars in 1019 bytes} [Fri Aug 27 01:33:48 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:33:48.584957 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6bc3e3-20df-4bcf-ae40-3478dc1e6172 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:48.589777 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6f029-83d0-4b1c-97d5-8b2359f3afb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:48.590492 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6f029-83d0-4b1c-97d5-8b2359f3afb5 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:48.590713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6f029-83d0-4b1c-97d5-8b2359f3afb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:48.590989 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6f029-83d0-4b1c-97d5-8b2359f3afb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:48.591745 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6f029-83d0-4b1c-97d5-8b2359f3afb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:48.591855 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278c5c9-7f4e-4872-89f1-bb48e6116c95 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:48.593195 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b278c5c9-7f4e-4872-89f1-bb48e6116c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:48.593433 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6f029-83d0-4b1c-97d5-8b2359f3afb5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:48.603829 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278c5c9-7f4e-4872-89f1-bb48e6116c95 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:48.605745 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1053/2077] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:33:48 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:33:48.607790 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1948e26-bcd6-4558-8d0c-eda9ab142a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:48.608440 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1948e26-bcd6-4558-8d0c-eda9ab142a92 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:48.608722 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1948e26-bcd6-4558-8d0c-eda9ab142a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:48.609033 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1948e26-bcd6-4558-8d0c-eda9ab142a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:48.609682 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6f029-83d0-4b1c-97d5-8b2359f3afb5 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:48.616274 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1948e26-bcd6-4558-8d0c-eda9ab142a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:48.618317 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1948e26-bcd6-4558-8d0c-eda9ab142a92 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:48.619424 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6f029-83d0-4b1c-97d5-8b2359f3afb5 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:48.624372 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d88741-c616-4d50-a5a7-d8f67eba67be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:48.625044 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d88741-c616-4d50-a5a7-d8f67eba67be admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:48.625335 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d88741-c616-4d50-a5a7-d8f67eba67be admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:48.625615 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d88741-c616-4d50-a5a7-d8f67eba67be admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:48.626190 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1025/2078] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:33:48 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:33:48.626336 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d88741-c616-4d50-a5a7-d8f67eba67be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:48.627964 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d88741-c616-4d50-a5a7-d8f67eba67be admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:48.638694 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1054/2079] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:33:48 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:33:48.642942 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1948e26-bcd6-4558-8d0c-eda9ab142a92 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:48.653862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1948e26-bcd6-4558-8d0c-eda9ab142a92 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:48.658369 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832a9c1-bcc0-46c2-b048-0b1aa0a5ed01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:48.659271 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832a9c1-bcc0-46c2-b048-0b1aa0a5ed01 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:48.659551 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832a9c1-bcc0-46c2-b048-0b1aa0a5ed01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:48.659828 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832a9c1-bcc0-46c2-b048-0b1aa0a5ed01 admin admin] PATH_INFO: `/v3/projects/2fcebc7910554381970b1c8b98aeaa69/users/8cfdfbbbb85243489235d1b8e1002070/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:48.674429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832a9c1-bcc0-46c2-b048-0b1aa0a5ed01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fcebc7910554381970b1c8b98aeaa69, user_id=8cfdfbbbb85243489235d1b8e1002070, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:48.677391 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832a9c1-bcc0-46c2-b048-0b1aa0a5ed01 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:48.746748 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1026/2080] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:33:48 2021] PUT /identity/v3/projects/2fcebc7910554381970b1c8b98aeaa69/users/8cfdfbbbb85243489235d1b8e1002070/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:33:48.751970 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a581d5-4b1f-4197-a2be-fc30f66d7c2c None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:48.752262 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a581d5-4b1f-4197-a2be-fc30f66d7c2c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:48.752539 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a581d5-4b1f-4197-a2be-fc30f66d7c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:48.771212 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f2a581d5-4b1f-4197-a2be-fc30f66d7c2c None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:48.772428 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f2a581d5-4b1f-4197-a2be-fc30f66d7c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:48.835497 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1055/2081] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:33:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:33:48.846195 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832a9c1-bcc0-46c2-b048-0b1aa0a5ed01 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:48.902773 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832a9c1-bcc0-46c2-b048-0b1aa0a5ed01 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:48.908860 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94b805-66e6-4eac-b46f-217e27deb1e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:48.909522 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94b805-66e6-4eac-b46f-217e27deb1e9 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:48.909814 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94b805-66e6-4eac-b46f-217e27deb1e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:48.910460 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94b805-66e6-4eac-b46f-217e27deb1e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:48.921231 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94b805-66e6-4eac-b46f-217e27deb1e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:48.923607 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94b805-66e6-4eac-b46f-217e27deb1e9 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:48.934696 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1027/2082] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:33:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:33:50.261459 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26430080-0e75-4399-bc2b-cc529fefaa22 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:50.262034 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26430080-0e75-4399-bc2b-cc529fefaa22 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:50.262034 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26430080-0e75-4399-bc2b-cc529fefaa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:50.302723 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-26430080-0e75-4399-bc2b-cc529fefaa22 None None] MFA Rules not processed for user `8cfdfbbbb85243489235d1b8e1002070`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:50.303945 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-26430080-0e75-4399-bc2b-cc529fefaa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:50.376365 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1056/2083] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:33:50 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:33:50.381252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94b805-66e6-4eac-b46f-217e27deb1e9 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:50.395327 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94b805-66e6-4eac-b46f-217e27deb1e9 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:50.396376 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfbb5b-8527-4cc2-95a1-5ab716a46ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:50.397004 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfbb5b-8527-4cc2-95a1-5ab716a46ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:50.397288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfbb5b-8527-4cc2-95a1-5ab716a46ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:50.397566 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfbb5b-8527-4cc2-95a1-5ab716a46ba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:50.398267 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfbb5b-8527-4cc2-95a1-5ab716a46ba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:50.400777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfbb5b-8527-4cc2-95a1-5ab716a46ba2 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:50.496773 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1028/2084] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:33:50 2021] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:33:50.500729 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26430080-0e75-4399-bc2b-cc529fefaa22 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:50.512608 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26430080-0e75-4399-bc2b-cc529fefaa22 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:50.565891 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4dad1-c63d-4b33-918c-07e273925283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:50.566665 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4dad1-c63d-4b33-918c-07e273925283 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:50.566955 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4dad1-c63d-4b33-918c-07e273925283 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:50.567221 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4dad1-c63d-4b33-918c-07e273925283 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:50.567942 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4dad1-c63d-4b33-918c-07e273925283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:50.569878 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4dad1-c63d-4b33-918c-07e273925283 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:50.648513 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1057/2085] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:33:50 2021] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:33:50.653626 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfbb5b-8527-4cc2-95a1-5ab716a46ba2 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:50.664200 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfbb5b-8527-4cc2-95a1-5ab716a46ba2 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:50.669208 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4255c3-253a-4282-913c-85c566e3ca65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:50.669969 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4255c3-253a-4282-913c-85c566e3ca65 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:50.670278 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4255c3-253a-4282-913c-85c566e3ca65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:50.670606 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4255c3-253a-4282-913c-85c566e3ca65 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:50.671427 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4255c3-253a-4282-913c-85c566e3ca65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:50.673361 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4255c3-253a-4282-913c-85c566e3ca65 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:50.688590 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1029/2086] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:33:50 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:33:50.693967 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4dad1-c63d-4b33-918c-07e273925283 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:50.704677 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4dad1-c63d-4b33-918c-07e273925283 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:50.709415 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416d463-0f9f-4317-b02f-0db9257750ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:50.710294 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416d463-0f9f-4317-b02f-0db9257750ba admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:50.710574 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416d463-0f9f-4317-b02f-0db9257750ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:50.710851 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416d463-0f9f-4317-b02f-0db9257750ba admin admin] PATH_INFO: `/v3/projects/e9ba39023bd441b3b7549236b802349e/users/6ff2846b983048068a754d210f89b7f5/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:50.725378 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416d463-0f9f-4317-b02f-0db9257750ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ba39023bd441b3b7549236b802349e, user_id=6ff2846b983048068a754d210f89b7f5, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:50.729014 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416d463-0f9f-4317-b02f-0db9257750ba admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:50.837995 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1058/2087] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:33:50 2021] PUT /identity/v3/projects/e9ba39023bd441b3b7549236b802349e/users/6ff2846b983048068a754d210f89b7f5/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:33:50.842015 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4255c3-253a-4282-913c-85c566e3ca65 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:50.852263 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4255c3-253a-4282-913c-85c566e3ca65 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:50.907241 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b0e1f-4404-435b-aafb-9e39db98f6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:50.907829 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b0e1f-4404-435b-aafb-9e39db98f6db admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:50.908105 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b0e1f-4404-435b-aafb-9e39db98f6db admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:50.908377 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b0e1f-4404-435b-aafb-9e39db98f6db admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:50.909158 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b0e1f-4404-435b-aafb-9e39db98f6db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:50.910714 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b0e1f-4404-435b-aafb-9e39db98f6db admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:50.921105 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1030/2088] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:33:50 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:33:50.925319 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416d463-0f9f-4317-b02f-0db9257750ba admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:50.937383 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416d463-0f9f-4317-b02f-0db9257750ba admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:50.942593 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f42f1-2faf-4d8d-b762-86a27fa31534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:50.943481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f42f1-2faf-4d8d-b762-86a27fa31534 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:50.947241 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f42f1-2faf-4d8d-b762-86a27fa31534 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:50.947241 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f42f1-2faf-4d8d-b762-86a27fa31534 admin admin] PATH_INFO: `/v3/projects/e9ba39023bd441b3b7549236b802349e/users/6ff2846b983048068a754d210f89b7f5/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:50.947617 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f42f1-2faf-4d8d-b762-86a27fa31534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ba39023bd441b3b7549236b802349e, user_id=6ff2846b983048068a754d210f89b7f5, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:50.950186 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f42f1-2faf-4d8d-b762-86a27fa31534 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:50.960487 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1059/2089] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:33:50 2021] PUT /identity/v3/projects/e9ba39023bd441b3b7549236b802349e/users/6ff2846b983048068a754d210f89b7f5/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:33:52.243638 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b505a-57f1-4fa1-9623-325b1a56a5dd None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:52.244147 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b505a-57f1-4fa1-9623-325b1a56a5dd None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:52.244322 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b505a-57f1-4fa1-9623-325b1a56a5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:52.277674 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-eb0b505a-57f1-4fa1-9623-325b1a56a5dd None None] MFA Rules not processed for user `6ff2846b983048068a754d210f89b7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:52.278901 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-eb0b505a-57f1-4fa1-9623-325b1a56a5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:52.354411 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1031/2090] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:33:52 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:33:52.365275 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f42f1-2faf-4d8d-b762-86a27fa31534 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:52.368197 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-754f42f1-2faf-4d8d-b762-86a27fa31534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:52.440499 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f42f1-2faf-4d8d-b762-86a27fa31534 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:52.443992 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e4c39-4a94-49f7-98df-98dcc71febb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:52.444631 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e4c39-4a94-49f7-98df-98dcc71febb6 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:52.444941 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e4c39-4a94-49f7-98df-98dcc71febb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:52.445217 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e4c39-4a94-49f7-98df-98dcc71febb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:52.504897 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e4c39-4a94-49f7-98df-98dcc71febb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:52.506352 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e4c39-4a94-49f7-98df-98dcc71febb6 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:52.516787 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1060/2091] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:33:52 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:33:54.294055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b505a-57f1-4fa1-9623-325b1a56a5dd None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:54.308153 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b505a-57f1-4fa1-9623-325b1a56a5dd None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:54.312478 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209486ad-fd74-4218-a669-e712501e3547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:54.313256 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209486ad-fd74-4218-a669-e712501e3547 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:54.316150 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209486ad-fd74-4218-a669-e712501e3547 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:54.316150 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209486ad-fd74-4218-a669-e712501e3547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:54.323893 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209486ad-fd74-4218-a669-e712501e3547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:54.325371 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209486ad-fd74-4218-a669-e712501e3547 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:54.334622 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1032/2092] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:33:54 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:33:54.718623 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29567ed-073b-4045-9ce8-145ed4c60848 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:54.719131 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29567ed-073b-4045-9ce8-145ed4c60848 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:54.719344 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29567ed-073b-4045-9ce8-145ed4c60848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:54.775227 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-e29567ed-073b-4045-9ce8-145ed4c60848 None None] MFA Rules not processed for user `3f65fb7e73db469f8b171c3126005427`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:33:54.776984 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-e29567ed-073b-4045-9ce8-145ed4c60848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:54.841934 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1061/2093] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 01:33:54 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:33:54.854793 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209486ad-fd74-4218-a669-e712501e3547 service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:33:54.856163 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-209486ad-fd74-4218-a669-e712501e3547 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:33:54.960703 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209486ad-fd74-4218-a669-e712501e3547 service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:33:54.969609 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976955d-17aa-45b7-905f-4bf0faa89a30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48536f4437240b79cf10961de9cc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:33:54.970454 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976955d-17aa-45b7-905f-4bf0faa89a30 service swift] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:33:54.970735 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976955d-17aa-45b7-905f-4bf0faa89a30 service swift] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:33:54.975344 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976955d-17aa-45b7-905f-4bf0faa89a30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:33:54.980361 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976955d-17aa-45b7-905f-4bf0faa89a30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:33:54.981991 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976955d-17aa-45b7-905f-4bf0faa89a30 service swift] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:33:54.990576 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1033/2094] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 01:33:54 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 01:34:10.785579 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29567ed-073b-4045-9ce8-145ed4c60848 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:10.856128 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29567ed-073b-4045-9ce8-145ed4c60848 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:10.860599 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f628d23-d400-4d48-a1a0-e2c0011f808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:10.861522 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f628d23-d400-4d48-a1a0-e2c0011f808c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:10.861807 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f628d23-d400-4d48-a1a0-e2c0011f808c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:10.862079 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f628d23-d400-4d48-a1a0-e2c0011f808c admin admin] PATH_INFO: `/v3/users/8cfdfbbbb85243489235d1b8e1002070` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:10.863264 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f628d23-d400-4d48-a1a0-e2c0011f808c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cfdfbbbb85243489235d1b8e1002070)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:10.865273 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f628d23-d400-4d48-a1a0-e2c0011f808c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:11.055834 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4f628d23-d400-4d48-a1a0-e2c0011f808c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cfdfbbbb85243489235d1b8e1002070'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:11.067101 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4f628d23-d400-4d48-a1a0-e2c0011f808c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cfdfbbbb85243489235d1b8e1002070'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:11.074307 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4f628d23-d400-4d48-a1a0-e2c0011f808c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cfdfbbbb85243489235d1b8e1002070'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:11.074987 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4f628d23-d400-4d48-a1a0-e2c0011f808c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cfdfbbbb85243489235d1b8e1002070'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:11.139133 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4f628d23-d400-4d48-a1a0-e2c0011f808c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cfdfbbbb85243489235d1b8e1002070'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:11.145784 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1062/2095] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:34:10 2021] DELETE /identity/v3/users/8cfdfbbbb85243489235d1b8e1002070 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:34:11.380462 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976955d-17aa-45b7-905f-4bf0faa89a30 service swift] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:11.393990 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976955d-17aa-45b7-905f-4bf0faa89a30 service swift] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:11.453056 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2086cf7-be80-493f-8662-4f769b208917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:11.453906 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2086cf7-be80-493f-8662-4f769b208917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:11.454189 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2086cf7-be80-493f-8662-4f769b208917 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:11.454457 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2086cf7-be80-493f-8662-4f769b208917 admin admin] PATH_INFO: `/v3/projects/2fcebc7910554381970b1c8b98aeaa69` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:11.455618 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2086cf7-be80-493f-8662-4f769b208917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fcebc7910554381970b1c8b98aeaa69)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:11.457532 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2086cf7-be80-493f-8662-4f769b208917 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:11.568258 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d2086cf7-be80-493f-8662-4f769b208917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fcebc7910554381970b1c8b98aeaa69', 'request_id': 'req-d2086cf7-be80-493f-8662-4f769b208917'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:11.576120 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d2086cf7-be80-493f-8662-4f769b208917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fcebc7910554381970b1c8b98aeaa69', 'request_id': 'req-d2086cf7-be80-493f-8662-4f769b208917'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:11.722523 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d2086cf7-be80-493f-8662-4f769b208917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fcebc7910554381970b1c8b98aeaa69', 'request_id': 'req-d2086cf7-be80-493f-8662-4f769b208917'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:11.734361 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d2086cf7-be80-493f-8662-4f769b208917 admin admin] The token cache is being invalidate because project 2fcebc7910554381970b1c8b98aeaa69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:34:11.734653 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d2086cf7-be80-493f-8662-4f769b208917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:11.735311 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d2086cf7-be80-493f-8662-4f769b208917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:11.736879 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1034/2096] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:34:11 2021] DELETE /identity/v3/projects/2fcebc7910554381970b1c8b98aeaa69 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:34:11.740912 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f628d23-d400-4d48-a1a0-e2c0011f808c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:11.742367 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-4f628d23-d400-4d48-a1a0-e2c0011f808c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:11.756357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f628d23-d400-4d48-a1a0-e2c0011f808c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:11.821376 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78775ae-ba54-497d-867b-8ef0d81cbd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:11.822733 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78775ae-ba54-497d-867b-8ef0d81cbd4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:11.823023 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78775ae-ba54-497d-867b-8ef0d81cbd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:11.823299 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78775ae-ba54-497d-867b-8ef0d81cbd4c admin admin] PATH_INFO: `/v3/users/6ff2846b983048068a754d210f89b7f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:11.824671 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78775ae-ba54-497d-867b-8ef0d81cbd4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ff2846b983048068a754d210f89b7f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:11.826661 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78775ae-ba54-497d-867b-8ef0d81cbd4c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:12.051330 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f78775ae-ba54-497d-867b-8ef0d81cbd4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ff2846b983048068a754d210f89b7f5'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:12.065557 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f78775ae-ba54-497d-867b-8ef0d81cbd4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ff2846b983048068a754d210f89b7f5'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:12.079976 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f78775ae-ba54-497d-867b-8ef0d81cbd4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ff2846b983048068a754d210f89b7f5'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:12.080770 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f78775ae-ba54-497d-867b-8ef0d81cbd4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ff2846b983048068a754d210f89b7f5'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:12.150933 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f78775ae-ba54-497d-867b-8ef0d81cbd4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ff2846b983048068a754d210f89b7f5'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:12.157875 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1063/2097] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:34:11 2021] DELETE /identity/v3/users/6ff2846b983048068a754d210f89b7f5 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:34:12.398548 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2086cf7-be80-493f-8662-4f769b208917 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:12.400184 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d2086cf7-be80-493f-8662-4f769b208917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:12.413868 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2086cf7-be80-493f-8662-4f769b208917 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:12.469443 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3361a94-6e97-45e8-acfc-299ca9a1bf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:12.470332 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3361a94-6e97-45e8-acfc-299ca9a1bf9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:12.470607 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3361a94-6e97-45e8-acfc-299ca9a1bf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:12.470878 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3361a94-6e97-45e8-acfc-299ca9a1bf9f admin admin] PATH_INFO: `/v3/projects/e9ba39023bd441b3b7549236b802349e` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:12.472045 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3361a94-6e97-45e8-acfc-299ca9a1bf9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ba39023bd441b3b7549236b802349e)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:12.473961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3361a94-6e97-45e8-acfc-299ca9a1bf9f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:12.601268 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d3361a94-6e97-45e8-acfc-299ca9a1bf9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ba39023bd441b3b7549236b802349e', 'request_id': 'req-d3361a94-6e97-45e8-acfc-299ca9a1bf9f'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:12.602838 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d3361a94-6e97-45e8-acfc-299ca9a1bf9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ba39023bd441b3b7549236b802349e', 'request_id': 'req-d3361a94-6e97-45e8-acfc-299ca9a1bf9f'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:12.666184 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d3361a94-6e97-45e8-acfc-299ca9a1bf9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ba39023bd441b3b7549236b802349e', 'request_id': 'req-d3361a94-6e97-45e8-acfc-299ca9a1bf9f'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:12.676820 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d3361a94-6e97-45e8-acfc-299ca9a1bf9f admin admin] The token cache is being invalidate because project e9ba39023bd441b3b7549236b802349e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:34:12.677134 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d3361a94-6e97-45e8-acfc-299ca9a1bf9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:12.677748 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d3361a94-6e97-45e8-acfc-299ca9a1bf9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:12.679273 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1035/2098] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:34:12 2021] DELETE /identity/v3/projects/e9ba39023bd441b3b7549236b802349e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:34:20.487593 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfdc20-dd24-426b-a569-c86d69d71047 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:20.488120 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfdc20-dd24-426b-a569-c86d69d71047 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:20.488120 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfdc20-dd24-426b-a569-c86d69d71047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:20.506468 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-eadfdc20-dd24-426b-a569-c86d69d71047 None None] MFA Rules not processed for user `76bcad9416ea4ffd966b9827246ef936`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:34:20.507777 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-eadfdc20-dd24-426b-a569-c86d69d71047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:20.561891 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1064/2099] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:34:20 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:34:24.214298 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5d871-2d7f-41a7-8fb3-166a8377830e None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:24.214777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5d871-2d7f-41a7-8fb3-166a8377830e None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:24.214869 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5d871-2d7f-41a7-8fb3-166a8377830e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:24.232745 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-7da5d871-2d7f-41a7-8fb3-166a8377830e None None] MFA Rules not processed for user `3f65fb7e73db469f8b171c3126005427`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:34:24.235542 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-7da5d871-2d7f-41a7-8fb3-166a8377830e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:24.295304 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1036/2100] 10.222.0.25 () {58 vars in 968 bytes} [Fri Aug 27 01:34:24 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:34:24.324086 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfdc20-dd24-426b-a569-c86d69d71047 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:24.326100 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-eadfdc20-dd24-426b-a569-c86d69d71047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:24.395319 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfdc20-dd24-426b-a569-c86d69d71047 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:24.400244 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf7aac-27f1-4718-bfd5-3aa3a888c6a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48536f4437240b79cf10961de9cc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:24.401022 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf7aac-27f1-4718-bfd5-3aa3a888c6a9 service swift] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:24.401244 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf7aac-27f1-4718-bfd5-3aa3a888c6a9 service swift] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:24.401518 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf7aac-27f1-4718-bfd5-3aa3a888c6a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:24.410073 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf7aac-27f1-4718-bfd5-3aa3a888c6a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:24.411666 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf7aac-27f1-4718-bfd5-3aa3a888c6a9 service swift] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:24.421016 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1065/2101] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 01:34:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 01:34:38.417606 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5d871-2d7f-41a7-8fb3-166a8377830e None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:38.419620 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-7da5d871-2d7f-41a7-8fb3-166a8377830e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:38.486944 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5d871-2d7f-41a7-8fb3-166a8377830e None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:38.491574 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48820d-a571-4709-9c7b-a7140356c769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:38.495961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48820d-a571-4709-9c7b-a7140356c769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:38.495961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48820d-a571-4709-9c7b-a7140356c769 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:38.495961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48820d-a571-4709-9c7b-a7140356c769 admin admin] PATH_INFO: `/v3/users/589eca6a184e4505a0c0f97efe65892e` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:38.495961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48820d-a571-4709-9c7b-a7140356c769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=589eca6a184e4505a0c0f97efe65892e)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:38.496875 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48820d-a571-4709-9c7b-a7140356c769 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:38.684707 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0d48820d-a571-4709-9c7b-a7140356c769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '589eca6a184e4505a0c0f97efe65892e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:38.685398 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0d48820d-a571-4709-9c7b-a7140356c769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '589eca6a184e4505a0c0f97efe65892e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:38.692397 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0d48820d-a571-4709-9c7b-a7140356c769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '589eca6a184e4505a0c0f97efe65892e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:38.693056 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0d48820d-a571-4709-9c7b-a7140356c769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '589eca6a184e4505a0c0f97efe65892e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:38.774625 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-0d48820d-a571-4709-9c7b-a7140356c769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '589eca6a184e4505a0c0f97efe65892e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:38.793398 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1037/2102] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:34:38 2021] DELETE /identity/v3/users/589eca6a184e4505a0c0f97efe65892e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:34:39.102430 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf7aac-27f1-4718-bfd5-3aa3a888c6a9 service swift] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:39.112393 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf7aac-27f1-4718-bfd5-3aa3a888c6a9 service swift] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:39.167570 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cf767-a145-4280-a8d7-00d981f21006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:39.168434 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cf767-a145-4280-a8d7-00d981f21006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:39.168711 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cf767-a145-4280-a8d7-00d981f21006 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:39.169022 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cf767-a145-4280-a8d7-00d981f21006 admin admin] PATH_INFO: `/v3/projects/8c9439f7236d4228aea4ccc73e5d6c08` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:39.170200 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7cf767-a145-4280-a8d7-00d981f21006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9439f7236d4228aea4ccc73e5d6c08)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:39.172132 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7cf767-a145-4280-a8d7-00d981f21006 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:39.286831 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-1b7cf767-a145-4280-a8d7-00d981f21006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9439f7236d4228aea4ccc73e5d6c08', 'request_id': 'req-1b7cf767-a145-4280-a8d7-00d981f21006'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:39.293465 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-1b7cf767-a145-4280-a8d7-00d981f21006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9439f7236d4228aea4ccc73e5d6c08', 'request_id': 'req-1b7cf767-a145-4280-a8d7-00d981f21006'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:39.396513 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-1b7cf767-a145-4280-a8d7-00d981f21006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9439f7236d4228aea4ccc73e5d6c08', 'request_id': 'req-1b7cf767-a145-4280-a8d7-00d981f21006'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:39.407829 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-1b7cf767-a145-4280-a8d7-00d981f21006 admin admin] The token cache is being invalidate because project 8c9439f7236d4228aea4ccc73e5d6c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:34:39.408118 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-1b7cf767-a145-4280-a8d7-00d981f21006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:39.408750 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-1b7cf767-a145-4280-a8d7-00d981f21006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:39.410314 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1066/2103] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:34:39 2021] DELETE /identity/v3/projects/8c9439f7236d4228aea4ccc73e5d6c08 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:34:39.416039 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fcd59-3594-4736-97b6-6e63a4b4bfa8 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:39.416336 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fcd59-3594-4736-97b6-6e63a4b4bfa8 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:39.416648 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fcd59-3594-4736-97b6-6e63a4b4bfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:39.435412 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-5f1fcd59-3594-4736-97b6-6e63a4b4bfa8 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:34:39.436649 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-5f1fcd59-3594-4736-97b6-6e63a4b4bfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:39.496189 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1038/2104] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:34:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:34:39.503991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8887a7-f590-4828-a93e-3f7cc63a2de3 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:39.504307 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8887a7-f590-4828-a93e-3f7cc63a2de3 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:39.504549 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8887a7-f590-4828-a93e-3f7cc63a2de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:39.530412 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-4b8887a7-f590-4828-a93e-3f7cc63a2de3 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:34:39.531636 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-4b8887a7-f590-4828-a93e-3f7cc63a2de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:39.539753 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1067/2105] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:34:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:34:39.544822 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fcd59-3594-4736-97b6-6e63a4b4bfa8 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:39.554770 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fcd59-3594-4736-97b6-6e63a4b4bfa8 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:39.566163 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea26866-02c6-4bcc-b243-c6f8175fee88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:39.567025 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea26866-02c6-4bcc-b243-c6f8175fee88 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:39.567312 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea26866-02c6-4bcc-b243-c6f8175fee88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:39.567588 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea26866-02c6-4bcc-b243-c6f8175fee88 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:39.568316 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea26866-02c6-4bcc-b243-c6f8175fee88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:34:39.568628 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea26866-02c6-4bcc-b243-c6f8175fee88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:39.570320 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea26866-02c6-4bcc-b243-c6f8175fee88 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:39.585305 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1039/2106] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:34:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:34:39.591436 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8887a7-f590-4828-a93e-3f7cc63a2de3 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:39.601444 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8887a7-f590-4828-a93e-3f7cc63a2de3 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:39.607205 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13540f1-1309-4f58-9130-dd77f129402d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:39.621609 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13540f1-1309-4f58-9130-dd77f129402d admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:39.621609 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13540f1-1309-4f58-9130-dd77f129402d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:39.621609 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13540f1-1309-4f58-9130-dd77f129402d admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:39.621609 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13540f1-1309-4f58-9130-dd77f129402d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:39.621609 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13540f1-1309-4f58-9130-dd77f129402d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:39.678390 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1068/2107] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:34:39 2021] POST /identity/v3/projects => generated 365 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:34:39.682538 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea26866-02c6-4bcc-b243-c6f8175fee88 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:39.692822 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea26866-02c6-4bcc-b243-c6f8175fee88 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:39.747734 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc5f70-8a17-42af-bd75-3c13e9ad40f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:39.748410 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc5f70-8a17-42af-bd75-3c13e9ad40f4 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:39.748696 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc5f70-8a17-42af-bd75-3c13e9ad40f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:39.749009 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc5f70-8a17-42af-bd75-3c13e9ad40f4 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:39.749707 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc5f70-8a17-42af-bd75-3c13e9ad40f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:39.751626 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc5f70-8a17-42af-bd75-3c13e9ad40f4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:39.834569 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1040/2108] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:34:39 2021] POST /identity/v3/users => generated 283 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:34:39.835721 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13540f1-1309-4f58-9130-dd77f129402d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:39.846919 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13540f1-1309-4f58-9130-dd77f129402d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:39.854164 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858f0ca-3a93-4747-a31b-afe4503a049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:39.854889 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858f0ca-3a93-4747-a31b-afe4503a049c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:39.855174 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858f0ca-3a93-4747-a31b-afe4503a049c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:39.855570 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858f0ca-3a93-4747-a31b-afe4503a049c admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:39.856188 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858f0ca-3a93-4747-a31b-afe4503a049c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:39.857892 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858f0ca-3a93-4747-a31b-afe4503a049c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:39.868433 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1069/2109] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:34:39 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:34:39.873340 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc5f70-8a17-42af-bd75-3c13e9ad40f4 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:39.883755 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc5f70-8a17-42af-bd75-3c13e9ad40f4 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:39.889391 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6c3cd-b78f-4a0a-af38-1b3a98c64a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:39.890067 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6c3cd-b78f-4a0a-af38-1b3a98c64a2b admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:39.890349 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6c3cd-b78f-4a0a-af38-1b3a98c64a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:39.890742 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6c3cd-b78f-4a0a-af38-1b3a98c64a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:39.891468 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6c3cd-b78f-4a0a-af38-1b3a98c64a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:39.893103 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6c3cd-b78f-4a0a-af38-1b3a98c64a2b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:39.905597 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1041/2110] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:34:39 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:34:39.909539 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858f0ca-3a93-4747-a31b-afe4503a049c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:39.919747 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858f0ca-3a93-4747-a31b-afe4503a049c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:39.924517 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad2f52-cc69-43ad-b891-0d8d2ef7ce56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:39.925761 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad2f52-cc69-43ad-b891-0d8d2ef7ce56 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:39.926048 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad2f52-cc69-43ad-b891-0d8d2ef7ce56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:39.926349 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad2f52-cc69-43ad-b891-0d8d2ef7ce56 admin admin] PATH_INFO: `/v3/projects/240d66e06b9c4a3e91ab1a22e24d3ab9/users/063a6d692bf0429bbc4cc6c0c606a4a2/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:39.941117 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad2f52-cc69-43ad-b891-0d8d2ef7ce56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=240d66e06b9c4a3e91ab1a22e24d3ab9, user_id=063a6d692bf0429bbc4cc6c0c606a4a2, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:39.943680 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad2f52-cc69-43ad-b891-0d8d2ef7ce56 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:40.036668 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1070/2111] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:34:39 2021] PUT /identity/v3/projects/240d66e06b9c4a3e91ab1a22e24d3ab9/users/063a6d692bf0429bbc4cc6c0c606a4a2/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:34:40.047407 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69552f-84e9-4746-89fe-a24aee03a1d3 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:40.047721 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69552f-84e9-4746-89fe-a24aee03a1d3 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:40.048003 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69552f-84e9-4746-89fe-a24aee03a1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:40.075220 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-fc69552f-84e9-4746-89fe-a24aee03a1d3 None None] MFA Rules not processed for user `063a6d692bf0429bbc4cc6c0c606a4a2`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:34:40.076431 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-fc69552f-84e9-4746-89fe-a24aee03a1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:40.138199 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1042/2112] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:34:40 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:34:40.142748 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad2f52-cc69-43ad-b891-0d8d2ef7ce56 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:40.214790 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad2f52-cc69-43ad-b891-0d8d2ef7ce56 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:40.219382 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ab764-ed19-46e6-9570-b778c297beb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:40.220034 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ab764-ed19-46e6-9570-b778c297beb7 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:40.220311 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ab764-ed19-46e6-9570-b778c297beb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:40.220583 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ab764-ed19-46e6-9570-b778c297beb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:40.221376 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ab764-ed19-46e6-9570-b778c297beb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:40.223250 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ab764-ed19-46e6-9570-b778c297beb7 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:40.358259 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1071/2113] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:34:40 2021] POST /identity/v3/projects => generated 363 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:34:40.362652 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69552f-84e9-4746-89fe-a24aee03a1d3 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:40.373863 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69552f-84e9-4746-89fe-a24aee03a1d3 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:40.429821 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c1a12-b742-4aa0-8f06-ab9e62e8e757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:40.430494 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c1a12-b742-4aa0-8f06-ab9e62e8e757 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:40.430784 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c1a12-b742-4aa0-8f06-ab9e62e8e757 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:40.431060 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c1a12-b742-4aa0-8f06-ab9e62e8e757 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:40.431745 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c1a12-b742-4aa0-8f06-ab9e62e8e757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:40.434407 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c1a12-b742-4aa0-8f06-ab9e62e8e757 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:40.550858 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1043/2114] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:34:40 2021] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:34:40.554887 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ab764-ed19-46e6-9570-b778c297beb7 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:40.565568 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ab764-ed19-46e6-9570-b778c297beb7 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:40.570330 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512f396-7a9d-438c-b31f-6ad137862eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:40.570988 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512f396-7a9d-438c-b31f-6ad137862eef admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:40.571266 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512f396-7a9d-438c-b31f-6ad137862eef admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:40.571540 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512f396-7a9d-438c-b31f-6ad137862eef admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:40.572561 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512f396-7a9d-438c-b31f-6ad137862eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:40.573843 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512f396-7a9d-438c-b31f-6ad137862eef admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:40.584373 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1072/2115] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:34:40 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:34:40.588445 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c1a12-b742-4aa0-8f06-ab9e62e8e757 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:40.598566 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c1a12-b742-4aa0-8f06-ab9e62e8e757 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:40.603315 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239548f-2e90-4b0c-b2a4-18b5f4529715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:40.604178 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239548f-2e90-4b0c-b2a4-18b5f4529715 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:40.604453 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239548f-2e90-4b0c-b2a4-18b5f4529715 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:40.605527 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239548f-2e90-4b0c-b2a4-18b5f4529715 admin admin] PATH_INFO: `/v3/projects/10af626e742f495a803a168607b02051/users/833c16e7cba541b58549b98da3170eb8/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:40.624111 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239548f-2e90-4b0c-b2a4-18b5f4529715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10af626e742f495a803a168607b02051, user_id=833c16e7cba541b58549b98da3170eb8, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:40.626785 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239548f-2e90-4b0c-b2a4-18b5f4529715 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:40.786714 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1044/2116] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:34:40 2021] PUT /identity/v3/projects/10af626e742f495a803a168607b02051/users/833c16e7cba541b58549b98da3170eb8/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:34:40.790430 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512f396-7a9d-438c-b31f-6ad137862eef admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:40.801316 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512f396-7a9d-438c-b31f-6ad137862eef admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:40.856860 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf05e5-7be9-41dc-8c2c-3c0da5942e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:40.857521 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf05e5-7be9-41dc-8c2c-3c0da5942e72 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:40.857805 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf05e5-7be9-41dc-8c2c-3c0da5942e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:40.858081 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf05e5-7be9-41dc-8c2c-3c0da5942e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:40.858803 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf05e5-7be9-41dc-8c2c-3c0da5942e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:40.860401 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf05e5-7be9-41dc-8c2c-3c0da5942e72 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:40.869870 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1073/2117] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:34:40 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:34:40.874722 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239548f-2e90-4b0c-b2a4-18b5f4529715 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:40.884973 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239548f-2e90-4b0c-b2a4-18b5f4529715 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:40.889717 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b295a-ec1f-406a-8fb9-0ec1616d95e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:40.890578 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b295a-ec1f-406a-8fb9-0ec1616d95e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:40.890856 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b295a-ec1f-406a-8fb9-0ec1616d95e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:40.891124 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b295a-ec1f-406a-8fb9-0ec1616d95e6 admin admin] PATH_INFO: `/v3/projects/10af626e742f495a803a168607b02051/users/833c16e7cba541b58549b98da3170eb8/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:40.893140 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b295a-ec1f-406a-8fb9-0ec1616d95e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10af626e742f495a803a168607b02051, user_id=833c16e7cba541b58549b98da3170eb8, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:40.895725 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b295a-ec1f-406a-8fb9-0ec1616d95e6 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:40.906684 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1045/2118] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:34:40 2021] PUT /identity/v3/projects/10af626e742f495a803a168607b02051/users/833c16e7cba541b58549b98da3170eb8/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:34:40.924189 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4afa6-b61a-42c3-9828-10c1fd4054f9 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:40.924189 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4afa6-b61a-42c3-9828-10c1fd4054f9 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:40.924189 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4afa6-b61a-42c3-9828-10c1fd4054f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:40.943166 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-90f4afa6-b61a-42c3-9828-10c1fd4054f9 None None] MFA Rules not processed for user `833c16e7cba541b58549b98da3170eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:34:40.944376 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-90f4afa6-b61a-42c3-9828-10c1fd4054f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:41.012784 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1074/2119] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:34:40 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:34:41.051438 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b295a-ec1f-406a-8fb9-0ec1616d95e6 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:41.053466 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1c4b295a-ec1f-406a-8fb9-0ec1616d95e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:41.110798 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b295a-ec1f-406a-8fb9-0ec1616d95e6 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:41.114485 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77195c37-f792-420c-b8a4-5c754c99fc7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:41.115129 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77195c37-f792-420c-b8a4-5c754c99fc7f service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:41.115412 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77195c37-f792-420c-b8a4-5c754c99fc7f service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:41.115687 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77195c37-f792-420c-b8a4-5c754c99fc7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:41.125076 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77195c37-f792-420c-b8a4-5c754c99fc7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:41.126501 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77195c37-f792-420c-b8a4-5c754c99fc7f service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:41.136308 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1046/2120] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:34:41 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:34:41.520328 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4afa6-b61a-42c3-9828-10c1fd4054f9 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:41.581142 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4afa6-b61a-42c3-9828-10c1fd4054f9 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:41.585670 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed0868-6eda-4f19-83fe-896e3f7bc6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:41.586596 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed0868-6eda-4f19-83fe-896e3f7bc6d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:41.586876 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed0868-6eda-4f19-83fe-896e3f7bc6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:41.587149 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed0868-6eda-4f19-83fe-896e3f7bc6d6 admin admin] PATH_INFO: `/v3/users/063a6d692bf0429bbc4cc6c0c606a4a2` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:41.588331 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed0868-6eda-4f19-83fe-896e3f7bc6d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=063a6d692bf0429bbc4cc6c0c606a4a2)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:41.591040 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed0868-6eda-4f19-83fe-896e3f7bc6d6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:41.828788 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-71ed0868-6eda-4f19-83fe-896e3f7bc6d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063a6d692bf0429bbc4cc6c0c606a4a2'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:41.841698 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-71ed0868-6eda-4f19-83fe-896e3f7bc6d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063a6d692bf0429bbc4cc6c0c606a4a2'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:41.850219 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-71ed0868-6eda-4f19-83fe-896e3f7bc6d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063a6d692bf0429bbc4cc6c0c606a4a2'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:41.851029 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-71ed0868-6eda-4f19-83fe-896e3f7bc6d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063a6d692bf0429bbc4cc6c0c606a4a2'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:41.922221 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-71ed0868-6eda-4f19-83fe-896e3f7bc6d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063a6d692bf0429bbc4cc6c0c606a4a2'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:41.928638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1075/2121] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:34:41 2021] DELETE /identity/v3/users/063a6d692bf0429bbc4cc6c0c606a4a2 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:34:41.933831 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cab17e-dc03-4364-8e9e-ee5ec173363b None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:41.940289 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cab17e-dc03-4364-8e9e-ee5ec173363b None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:41.940289 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cab17e-dc03-4364-8e9e-ee5ec173363b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:41.952198 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-e4cab17e-dc03-4364-8e9e-ee5ec173363b None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:34:41.953407 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e4cab17e-dc03-4364-8e9e-ee5ec173363b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:42.008627 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1047/2122] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:34:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:34:42.019022 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed0868-6eda-4f19-83fe-896e3f7bc6d6 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:42.020468 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-71ed0868-6eda-4f19-83fe-896e3f7bc6d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:42.076743 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed0868-6eda-4f19-83fe-896e3f7bc6d6 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:42.080392 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b1c02-fb0f-413b-83c9-c50be4098f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:42.081073 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b1c02-fb0f-413b-83c9-c50be4098f43 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:42.081353 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b1c02-fb0f-413b-83c9-c50be4098f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:42.081633 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b1c02-fb0f-413b-83c9-c50be4098f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:42.090531 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b1c02-fb0f-413b-83c9-c50be4098f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:42.092019 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b1c02-fb0f-413b-83c9-c50be4098f43 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:42.101201 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1076/2123] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:34:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:34:42.541204 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cab17e-dc03-4364-8e9e-ee5ec173363b None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:42.543320 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e4cab17e-dc03-4364-8e9e-ee5ec173363b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:42.556128 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cab17e-dc03-4364-8e9e-ee5ec173363b None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:42.560964 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b1616-6772-41ff-b3c8-0b0351cdaf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:42.562235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b1616-6772-41ff-b3c8-0b0351cdaf39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:42.562235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b1616-6772-41ff-b3c8-0b0351cdaf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:42.562418 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b1616-6772-41ff-b3c8-0b0351cdaf39 admin admin] PATH_INFO: `/v3/projects/240d66e06b9c4a3e91ab1a22e24d3ab9` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:42.563587 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b1616-6772-41ff-b3c8-0b0351cdaf39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=240d66e06b9c4a3e91ab1a22e24d3ab9)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:42.565518 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b1616-6772-41ff-b3c8-0b0351cdaf39 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:42.660535 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ac7b1616-6772-41ff-b3c8-0b0351cdaf39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '240d66e06b9c4a3e91ab1a22e24d3ab9', 'request_id': 'req-ac7b1616-6772-41ff-b3c8-0b0351cdaf39'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:42.669386 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ac7b1616-6772-41ff-b3c8-0b0351cdaf39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '240d66e06b9c4a3e91ab1a22e24d3ab9', 'request_id': 'req-ac7b1616-6772-41ff-b3c8-0b0351cdaf39'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:42.774109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ac7b1616-6772-41ff-b3c8-0b0351cdaf39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '240d66e06b9c4a3e91ab1a22e24d3ab9', 'request_id': 'req-ac7b1616-6772-41ff-b3c8-0b0351cdaf39'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:42.786468 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ac7b1616-6772-41ff-b3c8-0b0351cdaf39 admin admin] The token cache is being invalidate because project 240d66e06b9c4a3e91ab1a22e24d3ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:34:42.786757 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ac7b1616-6772-41ff-b3c8-0b0351cdaf39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:42.788348 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ac7b1616-6772-41ff-b3c8-0b0351cdaf39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:42.789050 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1048/2124] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:34:42 2021] DELETE /identity/v3/projects/240d66e06b9c4a3e91ab1a22e24d3ab9 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:34:42.793163 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b1c02-fb0f-413b-83c9-c50be4098f43 service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:42.802802 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b1c02-fb0f-413b-83c9-c50be4098f43 service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:42.856365 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2f397-58df-4df1-9ad4-98fec361f635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:42.857280 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2f397-58df-4df1-9ad4-98fec361f635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:42.857559 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2f397-58df-4df1-9ad4-98fec361f635 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:42.857831 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2f397-58df-4df1-9ad4-98fec361f635 admin admin] PATH_INFO: `/v3/users/833c16e7cba541b58549b98da3170eb8` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:42.859045 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2f397-58df-4df1-9ad4-98fec361f635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=833c16e7cba541b58549b98da3170eb8)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:42.860967 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2f397-58df-4df1-9ad4-98fec361f635 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:43.095539 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d8c2f397-58df-4df1-9ad4-98fec361f635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '833c16e7cba541b58549b98da3170eb8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:43.106979 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d8c2f397-58df-4df1-9ad4-98fec361f635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '833c16e7cba541b58549b98da3170eb8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:43.113686 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d8c2f397-58df-4df1-9ad4-98fec361f635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '833c16e7cba541b58549b98da3170eb8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:43.114344 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d8c2f397-58df-4df1-9ad4-98fec361f635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '833c16e7cba541b58549b98da3170eb8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:43.179334 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d8c2f397-58df-4df1-9ad4-98fec361f635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '833c16e7cba541b58549b98da3170eb8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:43.185770 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1077/2125] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:34:42 2021] DELETE /identity/v3/users/833c16e7cba541b58549b98da3170eb8 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:34:43.626121 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b1616-6772-41ff-b3c8-0b0351cdaf39 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:43.627610 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ac7b1616-6772-41ff-b3c8-0b0351cdaf39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:43.647452 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b1616-6772-41ff-b3c8-0b0351cdaf39 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:43.701461 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6a212-e5a5-4df5-b670-7ac8f5633406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:43.702313 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6a212-e5a5-4df5-b670-7ac8f5633406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:43.702597 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6a212-e5a5-4df5-b670-7ac8f5633406 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:43.702875 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6a212-e5a5-4df5-b670-7ac8f5633406 admin admin] PATH_INFO: `/v3/projects/10af626e742f495a803a168607b02051` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:43.704051 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6a212-e5a5-4df5-b670-7ac8f5633406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10af626e742f495a803a168607b02051)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:43.705967 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6a212-e5a5-4df5-b670-7ac8f5633406 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:43.910783 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-bcb6a212-e5a5-4df5-b670-7ac8f5633406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10af626e742f495a803a168607b02051', 'request_id': 'req-bcb6a212-e5a5-4df5-b670-7ac8f5633406'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:43.917818 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-bcb6a212-e5a5-4df5-b670-7ac8f5633406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10af626e742f495a803a168607b02051', 'request_id': 'req-bcb6a212-e5a5-4df5-b670-7ac8f5633406'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:44.025566 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-bcb6a212-e5a5-4df5-b670-7ac8f5633406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10af626e742f495a803a168607b02051', 'request_id': 'req-bcb6a212-e5a5-4df5-b670-7ac8f5633406'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:44.036903 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-bcb6a212-e5a5-4df5-b670-7ac8f5633406 admin admin] The token cache is being invalidate because project 10af626e742f495a803a168607b02051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:34:44.037245 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-bcb6a212-e5a5-4df5-b670-7ac8f5633406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:44.037861 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-bcb6a212-e5a5-4df5-b670-7ac8f5633406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:44.039390 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1049/2126] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:34:43 2021] DELETE /identity/v3/projects/10af626e742f495a803a168607b02051 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:34:44.046311 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fed49-70c4-4e45-b83b-86524ed3159e None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:44.046860 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fed49-70c4-4e45-b83b-86524ed3159e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:44.046860 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fed49-70c4-4e45-b83b-86524ed3159e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:44.065407 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-e72fed49-70c4-4e45-b83b-86524ed3159e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:34:44.066619 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-e72fed49-70c4-4e45-b83b-86524ed3159e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:44.125349 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1078/2127] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:34:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:34:44.133442 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea6c05-f9c5-4262-90a1-90dd69f7d26f None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:44.133802 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea6c05-f9c5-4262-90a1-90dd69f7d26f None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:44.134143 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea6c05-f9c5-4262-90a1-90dd69f7d26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:44.152791 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-ccea6c05-f9c5-4262-90a1-90dd69f7d26f None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:34:44.154570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ccea6c05-f9c5-4262-90a1-90dd69f7d26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:44.161793 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1050/2128] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:34:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:34:44.165849 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fed49-70c4-4e45-b83b-86524ed3159e None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:44.175803 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fed49-70c4-4e45-b83b-86524ed3159e None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:44.180358 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86337b59-2c2c-4c36-bf3c-82790d62a5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:44.181071 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86337b59-2c2c-4c36-bf3c-82790d62a5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:44.181356 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86337b59-2c2c-4c36-bf3c-82790d62a5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:44.181634 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86337b59-2c2c-4c36-bf3c-82790d62a5b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:44.182384 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86337b59-2c2c-4c36-bf3c-82790d62a5b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:34:44.183178 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86337b59-2c2c-4c36-bf3c-82790d62a5b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:44.184864 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86337b59-2c2c-4c36-bf3c-82790d62a5b7 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:44.196092 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1079/2129] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:34:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:34:44.201140 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea6c05-f9c5-4262-90a1-90dd69f7d26f None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:44.210247 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea6c05-f9c5-4262-90a1-90dd69f7d26f None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:44.215569 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabc3a7-2351-4af1-84d7-a90b30f84613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:44.221619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabc3a7-2351-4af1-84d7-a90b30f84613 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:44.221619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabc3a7-2351-4af1-84d7-a90b30f84613 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:44.221619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabc3a7-2351-4af1-84d7-a90b30f84613 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:44.221619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabc3a7-2351-4af1-84d7-a90b30f84613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:44.221619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabc3a7-2351-4af1-84d7-a90b30f84613 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:44.335308 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1051/2130] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:34:44 2021] POST /identity/v3/projects => generated 355 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:34:44.340324 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86337b59-2c2c-4c36-bf3c-82790d62a5b7 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:44.350279 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86337b59-2c2c-4c36-bf3c-82790d62a5b7 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:44.406759 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e305d-a75d-4be9-92ae-bf240a943781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:44.407466 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e305d-a75d-4be9-92ae-bf240a943781 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:44.407767 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e305d-a75d-4be9-92ae-bf240a943781 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:44.408046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e305d-a75d-4be9-92ae-bf240a943781 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:44.408735 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e305d-a75d-4be9-92ae-bf240a943781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:44.410673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e305d-a75d-4be9-92ae-bf240a943781 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:44.511933 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1080/2131] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:34:44 2021] POST /identity/v3/users => generated 278 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:34:44.516404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabc3a7-2351-4af1-84d7-a90b30f84613 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:44.527251 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabc3a7-2351-4af1-84d7-a90b30f84613 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:44.531880 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e303d1-2a88-4e2e-aa29-d1ab694782c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:44.532530 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e303d1-2a88-4e2e-aa29-d1ab694782c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:44.532814 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e303d1-2a88-4e2e-aa29-d1ab694782c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:44.533121 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e303d1-2a88-4e2e-aa29-d1ab694782c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:44.533843 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e303d1-2a88-4e2e-aa29-d1ab694782c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:44.535429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e303d1-2a88-4e2e-aa29-d1ab694782c0 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:44.546657 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1052/2132] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:34:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:34:44.554881 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e305d-a75d-4be9-92ae-bf240a943781 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:44.565748 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e305d-a75d-4be9-92ae-bf240a943781 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:44.570723 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f185efe-2530-439c-9fe9-65492670a11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:44.571396 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f185efe-2530-439c-9fe9-65492670a11d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:44.571675 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f185efe-2530-439c-9fe9-65492670a11d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:44.571952 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f185efe-2530-439c-9fe9-65492670a11d admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:44.572720 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f185efe-2530-439c-9fe9-65492670a11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:44.574523 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f185efe-2530-439c-9fe9-65492670a11d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:44.587711 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1081/2133] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:34:44 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:34:44.588970 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e303d1-2a88-4e2e-aa29-d1ab694782c0 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:44.599897 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e303d1-2a88-4e2e-aa29-d1ab694782c0 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:44.605383 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17746f89-338c-4749-8c91-2fd4543f1313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:44.606151 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17746f89-338c-4749-8c91-2fd4543f1313 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:44.606428 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17746f89-338c-4749-8c91-2fd4543f1313 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:44.606774 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17746f89-338c-4749-8c91-2fd4543f1313 admin admin] PATH_INFO: `/v3/projects/55e751bd335549608acce0c3e5db5359/users/0302db6270aa4808ad620efb5261afa8/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:44.622117 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17746f89-338c-4749-8c91-2fd4543f1313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e751bd335549608acce0c3e5db5359, user_id=0302db6270aa4808ad620efb5261afa8, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:44.624808 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17746f89-338c-4749-8c91-2fd4543f1313 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:44.739130 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1053/2134] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:34:44 2021] PUT /identity/v3/projects/55e751bd335549608acce0c3e5db5359/users/0302db6270aa4808ad620efb5261afa8/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:34:44.750980 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72970533-7214-4977-8e37-3936258037ba None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:44.751267 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72970533-7214-4977-8e37-3936258037ba None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:44.751545 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72970533-7214-4977-8e37-3936258037ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:44.777229 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-72970533-7214-4977-8e37-3936258037ba None None] MFA Rules not processed for user `0302db6270aa4808ad620efb5261afa8`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:34:44.778421 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-72970533-7214-4977-8e37-3936258037ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:44.845277 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1082/2135] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:34:44 2021] POST /identity/v3/auth/tokens => generated 3375 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:34:44.857860 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17746f89-338c-4749-8c91-2fd4543f1313 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:44.921007 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17746f89-338c-4749-8c91-2fd4543f1313 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:44.926167 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2f2ce-29ca-4f42-a3c0-10fde476bc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:44.926905 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2f2ce-29ca-4f42-a3c0-10fde476bc19 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:44.927265 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2f2ce-29ca-4f42-a3c0-10fde476bc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:44.927616 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2f2ce-29ca-4f42-a3c0-10fde476bc19 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:44.928394 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2f2ce-29ca-4f42-a3c0-10fde476bc19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:44.930399 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2f2ce-29ca-4f42-a3c0-10fde476bc19 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:45.027352 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1054/2136] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:34:44 2021] POST /identity/v3/projects => generated 357 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:34:45.034004 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72970533-7214-4977-8e37-3936258037ba None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:45.045836 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72970533-7214-4977-8e37-3936258037ba None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:45.098978 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90faa9d6-05c9-4a30-a6aa-50f99bcaf8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:45.099694 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90faa9d6-05c9-4a30-a6aa-50f99bcaf8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:45.099909 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90faa9d6-05c9-4a30-a6aa-50f99bcaf8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:45.100187 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90faa9d6-05c9-4a30-a6aa-50f99bcaf8c8 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:45.100882 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90faa9d6-05c9-4a30-a6aa-50f99bcaf8c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:45.102771 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90faa9d6-05c9-4a30-a6aa-50f99bcaf8c8 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:45.208758 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1083/2137] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:34:45 2021] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:34:45.212647 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2f2ce-29ca-4f42-a3c0-10fde476bc19 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:45.223238 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2f2ce-29ca-4f42-a3c0-10fde476bc19 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:45.229248 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db008a73-9655-4ebb-9a9d-5f37a04bbc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:45.230597 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db008a73-9655-4ebb-9a9d-5f37a04bbc70 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:45.230882 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db008a73-9655-4ebb-9a9d-5f37a04bbc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:45.231156 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db008a73-9655-4ebb-9a9d-5f37a04bbc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:45.231877 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db008a73-9655-4ebb-9a9d-5f37a04bbc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:45.233582 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db008a73-9655-4ebb-9a9d-5f37a04bbc70 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:45.244056 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1055/2138] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:34:45 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:34:45.249710 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90faa9d6-05c9-4a30-a6aa-50f99bcaf8c8 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:45.259635 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90faa9d6-05c9-4a30-a6aa-50f99bcaf8c8 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:45.264472 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65c72e-168f-4fdb-9044-6572f0f880e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:45.265381 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65c72e-168f-4fdb-9044-6572f0f880e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:45.265667 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65c72e-168f-4fdb-9044-6572f0f880e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:45.265943 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65c72e-168f-4fdb-9044-6572f0f880e6 admin admin] PATH_INFO: `/v3/projects/3e9c65f74e064bfebf9a7bbf79be14e1/users/ca8f24b5ef2f48c59724a8c132f1567a/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:45.280286 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65c72e-168f-4fdb-9044-6572f0f880e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9c65f74e064bfebf9a7bbf79be14e1, user_id=ca8f24b5ef2f48c59724a8c132f1567a, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:45.283047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65c72e-168f-4fdb-9044-6572f0f880e6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:45.431719 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1084/2139] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:34:45 2021] PUT /identity/v3/projects/3e9c65f74e064bfebf9a7bbf79be14e1/users/ca8f24b5ef2f48c59724a8c132f1567a/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:34:45.441818 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db008a73-9655-4ebb-9a9d-5f37a04bbc70 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:45.452482 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db008a73-9655-4ebb-9a9d-5f37a04bbc70 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:45.505719 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807fdbd-59d4-4a99-b09c-ff0b3f14ebd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:45.506421 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807fdbd-59d4-4a99-b09c-ff0b3f14ebd2 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:45.506723 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807fdbd-59d4-4a99-b09c-ff0b3f14ebd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:45.507004 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807fdbd-59d4-4a99-b09c-ff0b3f14ebd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:45.507732 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807fdbd-59d4-4a99-b09c-ff0b3f14ebd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:45.509354 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807fdbd-59d4-4a99-b09c-ff0b3f14ebd2 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:45.519921 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1056/2140] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:34:45 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:34:45.524627 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65c72e-168f-4fdb-9044-6572f0f880e6 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:45.535903 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65c72e-168f-4fdb-9044-6572f0f880e6 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:45.540719 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d2e65-b02e-4633-8095-6bac9733abc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:45.541630 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d2e65-b02e-4633-8095-6bac9733abc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:45.541914 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d2e65-b02e-4633-8095-6bac9733abc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:45.542770 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d2e65-b02e-4633-8095-6bac9733abc5 admin admin] PATH_INFO: `/v3/projects/3e9c65f74e064bfebf9a7bbf79be14e1/users/ca8f24b5ef2f48c59724a8c132f1567a/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:45.544744 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d2e65-b02e-4633-8095-6bac9733abc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9c65f74e064bfebf9a7bbf79be14e1, user_id=ca8f24b5ef2f48c59724a8c132f1567a, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:45.547420 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d2e65-b02e-4633-8095-6bac9733abc5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:45.557840 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1085/2141] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:34:45 2021] PUT /identity/v3/projects/3e9c65f74e064bfebf9a7bbf79be14e1/users/ca8f24b5ef2f48c59724a8c132f1567a/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:34:45.568679 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1e450-1d21-4f1d-8e02-f61e3edb61cd None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:45.569019 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1e450-1d21-4f1d-8e02-f61e3edb61cd None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:45.569298 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1e450-1d21-4f1d-8e02-f61e3edb61cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:45.595723 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-e4f1e450-1d21-4f1d-8e02-f61e3edb61cd None None] MFA Rules not processed for user `ca8f24b5ef2f48c59724a8c132f1567a`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:34:45.596981 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e4f1e450-1d21-4f1d-8e02-f61e3edb61cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:45.664015 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1057/2142] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:34:45 2021] POST /identity/v3/auth/tokens => generated 3444 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:34:45.676205 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d2e65-b02e-4633-8095-6bac9733abc5 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:45.677930 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-108d2e65-b02e-4633-8095-6bac9733abc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:45.732172 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d2e65-b02e-4633-8095-6bac9733abc5 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:45.735817 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157b7c4-c3af-4276-840f-265ffe88bc63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:45.736447 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157b7c4-c3af-4276-840f-265ffe88bc63 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:45.736728 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157b7c4-c3af-4276-840f-265ffe88bc63 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:45.737037 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157b7c4-c3af-4276-840f-265ffe88bc63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:45.745753 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157b7c4-c3af-4276-840f-265ffe88bc63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:45.747172 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157b7c4-c3af-4276-840f-265ffe88bc63 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:45.756247 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1086/2143] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:34:45 2021] GET /identity/v3/auth/tokens => generated 3444 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:34:45.962923 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1e450-1d21-4f1d-8e02-f61e3edb61cd None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:45.973323 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1e450-1d21-4f1d-8e02-f61e3edb61cd None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:45.976926 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b2adc-1ea5-4e44-a070-8d33dbf265b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:45.977565 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b2adc-1ea5-4e44-a070-8d33dbf265b8 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:45.977870 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b2adc-1ea5-4e44-a070-8d33dbf265b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:45.978148 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b2adc-1ea5-4e44-a070-8d33dbf265b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:46.033167 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b2adc-1ea5-4e44-a070-8d33dbf265b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:46.034597 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b2adc-1ea5-4e44-a070-8d33dbf265b8 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:46.044062 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1058/2144] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:34:45 2021] GET /identity/v3/auth/tokens => generated 3375 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:34:57.614099 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157b7c4-c3af-4276-840f-265ffe88bc63 service cinder] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:57.615871 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-7157b7c4-c3af-4276-840f-265ffe88bc63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:57.692219 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157b7c4-c3af-4276-840f-265ffe88bc63 service cinder] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:57.703233 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806df69a-b898-4c43-aec4-ed810b9ea96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:57.704117 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806df69a-b898-4c43-aec4-ed810b9ea96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:57.704398 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806df69a-b898-4c43-aec4-ed810b9ea96d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:57.704666 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806df69a-b898-4c43-aec4-ed810b9ea96d admin admin] PATH_INFO: `/v3/users/5952a90abc5042f48c9caecd82a0c74a` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:57.705907 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806df69a-b898-4c43-aec4-ed810b9ea96d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5952a90abc5042f48c9caecd82a0c74a)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:57.707816 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806df69a-b898-4c43-aec4-ed810b9ea96d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:57.942525 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-806df69a-b898-4c43-aec4-ed810b9ea96d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5952a90abc5042f48c9caecd82a0c74a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:57.954590 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-806df69a-b898-4c43-aec4-ed810b9ea96d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5952a90abc5042f48c9caecd82a0c74a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:57.961157 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-806df69a-b898-4c43-aec4-ed810b9ea96d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5952a90abc5042f48c9caecd82a0c74a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:57.961850 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-806df69a-b898-4c43-aec4-ed810b9ea96d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5952a90abc5042f48c9caecd82a0c74a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:58.087734 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-806df69a-b898-4c43-aec4-ed810b9ea96d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5952a90abc5042f48c9caecd82a0c74a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:58.094950 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1087/2145] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:34:57 2021] DELETE /identity/v3/users/5952a90abc5042f48c9caecd82a0c74a => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:34:58.330005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b2adc-1ea5-4e44-a070-8d33dbf265b8 service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:58.341465 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b2adc-1ea5-4e44-a070-8d33dbf265b8 service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:58.403566 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4d6b0-5c35-41e7-a62c-04a23a474176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:58.404422 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4d6b0-5c35-41e7-a62c-04a23a474176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:58.404701 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4d6b0-5c35-41e7-a62c-04a23a474176 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:58.405008 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4d6b0-5c35-41e7-a62c-04a23a474176 admin admin] PATH_INFO: `/v3/projects/cc3b4bb0756249d19606e34fca91d4d5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:58.406757 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4d6b0-5c35-41e7-a62c-04a23a474176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc3b4bb0756249d19606e34fca91d4d5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:58.408795 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4d6b0-5c35-41e7-a62c-04a23a474176 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:58.499829 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-c1c4d6b0-5c35-41e7-a62c-04a23a474176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc3b4bb0756249d19606e34fca91d4d5', 'request_id': 'req-c1c4d6b0-5c35-41e7-a62c-04a23a474176'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:58.506092 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-c1c4d6b0-5c35-41e7-a62c-04a23a474176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc3b4bb0756249d19606e34fca91d4d5', 'request_id': 'req-c1c4d6b0-5c35-41e7-a62c-04a23a474176'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:58.550722 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-c1c4d6b0-5c35-41e7-a62c-04a23a474176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc3b4bb0756249d19606e34fca91d4d5', 'request_id': 'req-c1c4d6b0-5c35-41e7-a62c-04a23a474176'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:58.560797 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-c1c4d6b0-5c35-41e7-a62c-04a23a474176 admin admin] The token cache is being invalidate because project cc3b4bb0756249d19606e34fca91d4d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:34:58.561106 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-c1c4d6b0-5c35-41e7-a62c-04a23a474176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:58.562163 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-c1c4d6b0-5c35-41e7-a62c-04a23a474176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:34:58.563746 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1059/2146] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:34:58 2021] DELETE /identity/v3/projects/cc3b4bb0756249d19606e34fca91d4d5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:34:58.569700 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248b33b-a3f1-47e7-8e73-b878069a680a None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:58.569992 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248b33b-a3f1-47e7-8e73-b878069a680a None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:58.570275 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248b33b-a3f1-47e7-8e73-b878069a680a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:58.589118 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-c248b33b-a3f1-47e7-8e73-b878069a680a None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:34:58.590355 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c248b33b-a3f1-47e7-8e73-b878069a680a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:58.666543 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1088/2147] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:34:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:34:58.668249 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdeca0-9a16-4cb1-ac14-1db6502485cb None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:58.668610 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdeca0-9a16-4cb1-ac14-1db6502485cb None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:58.668957 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdeca0-9a16-4cb1-ac14-1db6502485cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:58.689996 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-24bdeca0-9a16-4cb1-ac14-1db6502485cb None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:34:58.691349 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-24bdeca0-9a16-4cb1-ac14-1db6502485cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:58.702377 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1060/2148] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:34:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:34:58.706604 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248b33b-a3f1-47e7-8e73-b878069a680a None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:58.716675 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248b33b-a3f1-47e7-8e73-b878069a680a None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:58.722873 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb74c8e-5d94-46f5-b9e6-5a536c017013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:58.723673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb74c8e-5d94-46f5-b9e6-5a536c017013 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:58.724155 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb74c8e-5d94-46f5-b9e6-5a536c017013 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:58.724512 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb74c8e-5d94-46f5-b9e6-5a536c017013 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:58.725405 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb74c8e-5d94-46f5-b9e6-5a536c017013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:34:58.725843 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb74c8e-5d94-46f5-b9e6-5a536c017013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:58.727931 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb74c8e-5d94-46f5-b9e6-5a536c017013 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:58.742441 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1089/2149] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:34:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:34:58.746725 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdeca0-9a16-4cb1-ac14-1db6502485cb None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:58.756194 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdeca0-9a16-4cb1-ac14-1db6502485cb None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:58.760914 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabd9af-0194-4378-bbf7-978c5a50dfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:58.761553 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabd9af-0194-4378-bbf7-978c5a50dfcc admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:58.761832 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabd9af-0194-4378-bbf7-978c5a50dfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:58.762103 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabd9af-0194-4378-bbf7-978c5a50dfcc admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:58.762793 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabd9af-0194-4378-bbf7-978c5a50dfcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:58.765271 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabd9af-0194-4378-bbf7-978c5a50dfcc admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:58.900808 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1061/2150] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:34:58 2021] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:34:58.905015 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb74c8e-5d94-46f5-b9e6-5a536c017013 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:58.915928 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb74c8e-5d94-46f5-b9e6-5a536c017013 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:58.973045 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed3328-72d3-4934-8797-fefdd2745c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:58.973706 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed3328-72d3-4934-8797-fefdd2745c87 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:58.973985 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed3328-72d3-4934-8797-fefdd2745c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:58.974256 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed3328-72d3-4934-8797-fefdd2745c87 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:58.974929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed3328-72d3-4934-8797-fefdd2745c87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:58.976805 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed3328-72d3-4934-8797-fefdd2745c87 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:59.063109 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1090/2151] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:34:58 2021] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:34:59.064776 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabd9af-0194-4378-bbf7-978c5a50dfcc admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:59.075020 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabd9af-0194-4378-bbf7-978c5a50dfcc admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:59.080957 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c7241-d018-4365-92ad-7c3e24fd477d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:59.081693 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c7241-d018-4365-92ad-7c3e24fd477d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:59.081973 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c7241-d018-4365-92ad-7c3e24fd477d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:59.082305 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c7241-d018-4365-92ad-7c3e24fd477d admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:59.083110 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c7241-d018-4365-92ad-7c3e24fd477d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:59.084936 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c7241-d018-4365-92ad-7c3e24fd477d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:59.097068 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1062/2152] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:34:59 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:34:59.100961 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed3328-72d3-4934-8797-fefdd2745c87 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:59.110805 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed3328-72d3-4934-8797-fefdd2745c87 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:59.115662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6c92a-9923-4e7e-960e-66d328490cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:59.116323 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6c92a-9923-4e7e-960e-66d328490cdd admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:59.116608 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6c92a-9923-4e7e-960e-66d328490cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:59.116919 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6c92a-9923-4e7e-960e-66d328490cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:59.117648 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6c92a-9923-4e7e-960e-66d328490cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:59.119268 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6c92a-9923-4e7e-960e-66d328490cdd admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:59.129893 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1091/2153] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:34:59 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:34:59.134025 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c7241-d018-4365-92ad-7c3e24fd477d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:59.145022 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c7241-d018-4365-92ad-7c3e24fd477d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:59.150539 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be8c2c-61a2-4962-b01e-3bf75af968e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:59.153968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be8c2c-61a2-4962-b01e-3bf75af968e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:59.153968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be8c2c-61a2-4962-b01e-3bf75af968e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:59.153968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be8c2c-61a2-4962-b01e-3bf75af968e6 admin admin] PATH_INFO: `/v3/projects/70fb241eb18549d58ae81e5ff7995d5a/users/5e074204c44d48589c6ee0e0097b0533/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:59.168033 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be8c2c-61a2-4962-b01e-3bf75af968e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70fb241eb18549d58ae81e5ff7995d5a, user_id=5e074204c44d48589c6ee0e0097b0533, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:59.171219 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be8c2c-61a2-4962-b01e-3bf75af968e6 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:59.288173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1063/2154] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:34:59 2021] PUT /identity/v3/projects/70fb241eb18549d58ae81e5ff7995d5a/users/5e074204c44d48589c6ee0e0097b0533/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:34:59.302099 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b51460-191a-49be-ac9d-1bff6a8d9fba None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:59.302099 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b51460-191a-49be-ac9d-1bff6a8d9fba None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:59.302099 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b51460-191a-49be-ac9d-1bff6a8d9fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:59.329898 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-c0b51460-191a-49be-ac9d-1bff6a8d9fba None None] MFA Rules not processed for user `5e074204c44d48589c6ee0e0097b0533`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:34:59.331112 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c0b51460-191a-49be-ac9d-1bff6a8d9fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:59.396134 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1092/2155] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:34:59 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:34:59.406841 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be8c2c-61a2-4962-b01e-3bf75af968e6 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:34:59.408665 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-67be8c2c-61a2-4962-b01e-3bf75af968e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:34:59.488761 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be8c2c-61a2-4962-b01e-3bf75af968e6 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:34:59.494738 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10b7f2-4f9a-4479-9be3-0cf4f57c2e57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:34:59.495509 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10b7f2-4f9a-4479-9be3-0cf4f57c2e57 service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:34:59.495791 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10b7f2-4f9a-4479-9be3-0cf4f57c2e57 service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:34:59.496070 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10b7f2-4f9a-4479-9be3-0cf4f57c2e57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:34:59.505319 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10b7f2-4f9a-4479-9be3-0cf4f57c2e57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:34:59.506934 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10b7f2-4f9a-4479-9be3-0cf4f57c2e57 service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:34:59.517436 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1064/2156] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:34:59 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:02.629786 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b51460-191a-49be-ac9d-1bff6a8d9fba None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:02.690212 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b51460-191a-49be-ac9d-1bff6a8d9fba None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:02.694799 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26adbf6-e3d6-4337-8e38-929be91e59ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:02.695654 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26adbf6-e3d6-4337-8e38-929be91e59ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:02.695958 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26adbf6-e3d6-4337-8e38-929be91e59ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:02.699101 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26adbf6-e3d6-4337-8e38-929be91e59ef admin admin] PATH_INFO: `/v3/users/5e074204c44d48589c6ee0e0097b0533` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:02.699101 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26adbf6-e3d6-4337-8e38-929be91e59ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e074204c44d48589c6ee0e0097b0533)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:02.699478 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26adbf6-e3d6-4337-8e38-929be91e59ef admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:02.873210 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f26adbf6-e3d6-4337-8e38-929be91e59ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e074204c44d48589c6ee0e0097b0533'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:02.885998 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f26adbf6-e3d6-4337-8e38-929be91e59ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e074204c44d48589c6ee0e0097b0533'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:02.893572 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f26adbf6-e3d6-4337-8e38-929be91e59ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e074204c44d48589c6ee0e0097b0533'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:02.894383 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f26adbf6-e3d6-4337-8e38-929be91e59ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e074204c44d48589c6ee0e0097b0533'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:02.962425 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f26adbf6-e3d6-4337-8e38-929be91e59ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e074204c44d48589c6ee0e0097b0533'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:02.969607 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1093/2157] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:02 2021] DELETE /identity/v3/users/5e074204c44d48589c6ee0e0097b0533 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:02.974409 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a953e-91c2-485f-9132-fd8fc0e62d75 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:02.974875 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a953e-91c2-485f-9132-fd8fc0e62d75 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:02.974969 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a953e-91c2-485f-9132-fd8fc0e62d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:02.992979 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-d56a953e-91c2-485f-9132-fd8fc0e62d75 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:02.994206 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d56a953e-91c2-485f-9132-fd8fc0e62d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:03.054772 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1065/2158] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:03.065422 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26adbf6-e3d6-4337-8e38-929be91e59ef admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:03.066988 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f26adbf6-e3d6-4337-8e38-929be91e59ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:03.130500 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26adbf6-e3d6-4337-8e38-929be91e59ef admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:03.134305 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2ff0b-0527-4a48-9321-c32b2dab865c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:03.135193 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2ff0b-0527-4a48-9321-c32b2dab865c service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:03.135548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2ff0b-0527-4a48-9321-c32b2dab865c service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:03.135894 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2ff0b-0527-4a48-9321-c32b2dab865c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:03.146285 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2ff0b-0527-4a48-9321-c32b2dab865c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:03.150145 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2ff0b-0527-4a48-9321-c32b2dab865c service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:03.158259 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1094/2159] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:03.718355 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a953e-91c2-485f-9132-fd8fc0e62d75 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:03.719995 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d56a953e-91c2-485f-9132-fd8fc0e62d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:03.735885 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a953e-91c2-485f-9132-fd8fc0e62d75 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:03.740582 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4b860-e6a6-463c-bd36-f01ed580cf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:03.741468 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4b860-e6a6-463c-bd36-f01ed580cf6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:03.741753 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4b860-e6a6-463c-bd36-f01ed580cf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:03.742029 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4b860-e6a6-463c-bd36-f01ed580cf6d admin admin] PATH_INFO: `/v3/projects/70fb241eb18549d58ae81e5ff7995d5a` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:03.743211 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4b860-e6a6-463c-bd36-f01ed580cf6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=70fb241eb18549d58ae81e5ff7995d5a)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:03.745148 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4b860-e6a6-463c-bd36-f01ed580cf6d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:03.864643 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-89b4b860-e6a6-463c-bd36-f01ed580cf6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70fb241eb18549d58ae81e5ff7995d5a', 'request_id': 'req-89b4b860-e6a6-463c-bd36-f01ed580cf6d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:03.870638 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-89b4b860-e6a6-463c-bd36-f01ed580cf6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70fb241eb18549d58ae81e5ff7995d5a', 'request_id': 'req-89b4b860-e6a6-463c-bd36-f01ed580cf6d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:03.967543 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-89b4b860-e6a6-463c-bd36-f01ed580cf6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70fb241eb18549d58ae81e5ff7995d5a', 'request_id': 'req-89b4b860-e6a6-463c-bd36-f01ed580cf6d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:03.978119 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-89b4b860-e6a6-463c-bd36-f01ed580cf6d admin admin] The token cache is being invalidate because project 70fb241eb18549d58ae81e5ff7995d5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:03.978743 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-89b4b860-e6a6-463c-bd36-f01ed580cf6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:03.979064 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-89b4b860-e6a6-463c-bd36-f01ed580cf6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:03.980597 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1066/2160] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:03 2021] DELETE /identity/v3/projects/70fb241eb18549d58ae81e5ff7995d5a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:03.986900 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82218d5a-ed0b-4a43-a5c2-505552ec91fc None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:03.987339 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82218d5a-ed0b-4a43-a5c2-505552ec91fc None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:03.990832 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82218d5a-ed0b-4a43-a5c2-505552ec91fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:04.005884 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-82218d5a-ed0b-4a43-a5c2-505552ec91fc None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:04.007080 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-82218d5a-ed0b-4a43-a5c2-505552ec91fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:04.065053 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1095/2161] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:04.072631 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a1f3f-180a-41c2-817f-6802833b18aa None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:04.072959 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a1f3f-180a-41c2-817f-6802833b18aa None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:04.073235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a1f3f-180a-41c2-817f-6802833b18aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:04.090907 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-204a1f3f-180a-41c2-817f-6802833b18aa None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:04.092109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-204a1f3f-180a-41c2-817f-6802833b18aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:04.100667 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1067/2162] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:04.104808 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82218d5a-ed0b-4a43-a5c2-505552ec91fc None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:04.115127 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82218d5a-ed0b-4a43-a5c2-505552ec91fc None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:04.120933 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461da85-baa9-4519-b7b1-cd2f054d4694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:04.121588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461da85-baa9-4519-b7b1-cd2f054d4694 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:04.121869 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461da85-baa9-4519-b7b1-cd2f054d4694 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:04.122142 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461da85-baa9-4519-b7b1-cd2f054d4694 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:04.122885 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461da85-baa9-4519-b7b1-cd2f054d4694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:35:04.123188 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461da85-baa9-4519-b7b1-cd2f054d4694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:04.124808 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461da85-baa9-4519-b7b1-cd2f054d4694 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:04.136047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1096/2163] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:35:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:35:04.141353 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a1f3f-180a-41c2-817f-6802833b18aa None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:04.154434 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a1f3f-180a-41c2-817f-6802833b18aa None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:04.162189 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af5c96-e677-4f42-a4b7-4a5f1fe2b2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:04.163085 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af5c96-e677-4f42-a4b7-4a5f1fe2b2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:04.163445 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af5c96-e677-4f42-a4b7-4a5f1fe2b2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:04.163928 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af5c96-e677-4f42-a4b7-4a5f1fe2b2a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:04.164824 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af5c96-e677-4f42-a4b7-4a5f1fe2b2a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:04.167615 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af5c96-e677-4f42-a4b7-4a5f1fe2b2a4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:04.258692 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1068/2164] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:04 2021] POST /identity/v3/projects => generated 403 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:04.259956 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461da85-baa9-4519-b7b1-cd2f054d4694 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:04.271145 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461da85-baa9-4519-b7b1-cd2f054d4694 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:04.329074 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ea612-3402-426d-9901-a0be0fb1a121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:04.329749 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ea612-3402-426d-9901-a0be0fb1a121 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:04.330026 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ea612-3402-426d-9901-a0be0fb1a121 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:04.330301 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ea612-3402-426d-9901-a0be0fb1a121 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:04.333014 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ea612-3402-426d-9901-a0be0fb1a121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:04.333014 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ea612-3402-426d-9901-a0be0fb1a121 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:04.416306 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1097/2165] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:35:04 2021] POST /identity/v3/users => generated 302 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:04.418397 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af5c96-e677-4f42-a4b7-4a5f1fe2b2a4 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:04.429217 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af5c96-e677-4f42-a4b7-4a5f1fe2b2a4 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:04.434007 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9a74b-de6e-4aea-b2f8-39b9816428dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:04.434682 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9a74b-de6e-4aea-b2f8-39b9816428dd admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:04.434987 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9a74b-de6e-4aea-b2f8-39b9816428dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:04.435309 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9a74b-de6e-4aea-b2f8-39b9816428dd admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:04.436034 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9a74b-de6e-4aea-b2f8-39b9816428dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:04.437762 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9a74b-de6e-4aea-b2f8-39b9816428dd admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:04.448178 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1069/2166] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:04 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:04.452575 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ea612-3402-426d-9901-a0be0fb1a121 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:04.466708 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ea612-3402-426d-9901-a0be0fb1a121 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:04.472156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b99e82-ca07-4935-8745-ed7116d23d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:04.477617 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b99e82-ca07-4935-8745-ed7116d23d15 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:04.477617 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b99e82-ca07-4935-8745-ed7116d23d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:04.477617 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b99e82-ca07-4935-8745-ed7116d23d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:04.477617 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b99e82-ca07-4935-8745-ed7116d23d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:04.477617 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b99e82-ca07-4935-8745-ed7116d23d15 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:04.486610 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1098/2167] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:04 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:04.490704 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9a74b-de6e-4aea-b2f8-39b9816428dd admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:04.500966 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9a74b-de6e-4aea-b2f8-39b9816428dd admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:04.505902 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa9251-7606-4279-87fe-a69a9c0028a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:04.506769 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa9251-7606-4279-87fe-a69a9c0028a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:04.507053 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa9251-7606-4279-87fe-a69a9c0028a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:04.507327 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa9251-7606-4279-87fe-a69a9c0028a4 admin admin] PATH_INFO: `/v3/projects/a7bc0f20fc8e41aea86f81d970c2f55a/users/c8702bd36a0747d5b539c3cee653a26c/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:04.522723 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa9251-7606-4279-87fe-a69a9c0028a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7bc0f20fc8e41aea86f81d970c2f55a, user_id=c8702bd36a0747d5b539c3cee653a26c, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:04.525331 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa9251-7606-4279-87fe-a69a9c0028a4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:04.585064 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1070/2168] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:04 2021] PUT /identity/v3/projects/a7bc0f20fc8e41aea86f81d970c2f55a/users/c8702bd36a0747d5b539c3cee653a26c/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:04.590366 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a20b0a-3073-450f-b062-0a0c60928115 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:04.590654 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a20b0a-3073-450f-b062-0a0c60928115 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:04.590961 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a20b0a-3073-450f-b062-0a0c60928115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:04.608955 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f9a20b0a-3073-450f-b062-0a0c60928115 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:04.610153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f9a20b0a-3073-450f-b062-0a0c60928115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:04.666632 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1099/2169] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:04.678401 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa9251-7606-4279-87fe-a69a9c0028a4 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:04.680128 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a9fa9251-7606-4279-87fe-a69a9c0028a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:04.740849 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa9251-7606-4279-87fe-a69a9c0028a4 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:04.744775 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84dcb3-7fe0-444f-9814-ddaa60a40e25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:04.745648 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84dcb3-7fe0-444f-9814-ddaa60a40e25 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:04.745916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84dcb3-7fe0-444f-9814-ddaa60a40e25 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:04.746119 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84dcb3-7fe0-444f-9814-ddaa60a40e25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:04.756335 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84dcb3-7fe0-444f-9814-ddaa60a40e25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:04.757839 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84dcb3-7fe0-444f-9814-ddaa60a40e25 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:04.767153 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1071/2170] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:06.036917 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813427e2-f289-4448-a042-3fa05412cfe3 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:06.037440 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813427e2-f289-4448-a042-3fa05412cfe3 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:06.037532 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813427e2-f289-4448-a042-3fa05412cfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:06.077789 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-813427e2-f289-4448-a042-3fa05412cfe3 None None] MFA Rules not processed for user `c8702bd36a0747d5b539c3cee653a26c`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:06.079226 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-813427e2-f289-4448-a042-3fa05412cfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:06.151375 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1100/2171] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:06 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:06.156685 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84dcb3-7fe0-444f-9814-ddaa60a40e25 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:06.169804 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84dcb3-7fe0-444f-9814-ddaa60a40e25 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:06.175251 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dc3ec-ccde-4e7f-ada7-43eb80217e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:06.175914 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dc3ec-ccde-4e7f-ada7-43eb80217e88 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:06.176197 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dc3ec-ccde-4e7f-ada7-43eb80217e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:06.176468 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dc3ec-ccde-4e7f-ada7-43eb80217e88 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:06.177383 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44dc3ec-ccde-4e7f-ada7-43eb80217e88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:06.179332 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44dc3ec-ccde-4e7f-ada7-43eb80217e88 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:06.287558 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1072/2172] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:06 2021] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:06.288780 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813427e2-f289-4448-a042-3fa05412cfe3 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:06.299457 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813427e2-f289-4448-a042-3fa05412cfe3 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:06.356412 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06ee69-2ae7-4502-982d-ef0e8e3c68b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:06.357123 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06ee69-2ae7-4502-982d-ef0e8e3c68b5 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:06.357407 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06ee69-2ae7-4502-982d-ef0e8e3c68b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:06.357692 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06ee69-2ae7-4502-982d-ef0e8e3c68b5 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:06.358986 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06ee69-2ae7-4502-982d-ef0e8e3c68b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:06.360989 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06ee69-2ae7-4502-982d-ef0e8e3c68b5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:06.476984 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1101/2173] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:35:06 2021] POST /identity/v3/users => generated 309 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:06.481307 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dc3ec-ccde-4e7f-ada7-43eb80217e88 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:06.491378 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dc3ec-ccde-4e7f-ada7-43eb80217e88 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:06.495965 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71857b7f-deba-4e67-a391-0651759869f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:06.496618 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71857b7f-deba-4e67-a391-0651759869f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:06.497013 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71857b7f-deba-4e67-a391-0651759869f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:06.497293 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71857b7f-deba-4e67-a391-0651759869f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:06.498019 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71857b7f-deba-4e67-a391-0651759869f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:06.500324 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71857b7f-deba-4e67-a391-0651759869f2 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:06.512149 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1073/2174] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:35:06.521702 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06ee69-2ae7-4502-982d-ef0e8e3c68b5 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:06.533594 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06ee69-2ae7-4502-982d-ef0e8e3c68b5 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:06.539231 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96582c7e-16d9-4ac8-b7ef-75a79554ae6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:06.540400 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96582c7e-16d9-4ac8-b7ef-75a79554ae6d admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:06.540758 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96582c7e-16d9-4ac8-b7ef-75a79554ae6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:06.541093 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96582c7e-16d9-4ac8-b7ef-75a79554ae6d admin admin] PATH_INFO: `/v3/projects/5ae6b75201ce4526aff18448a1699b9b/users/c6fee8505c1c4eb19bd09ebf4cabbae2/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:06.557904 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96582c7e-16d9-4ac8-b7ef-75a79554ae6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae6b75201ce4526aff18448a1699b9b, user_id=c6fee8505c1c4eb19bd09ebf4cabbae2, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:06.561895 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96582c7e-16d9-4ac8-b7ef-75a79554ae6d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:06.647871 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1102/2175] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:06 2021] PUT /identity/v3/projects/5ae6b75201ce4526aff18448a1699b9b/users/c6fee8505c1c4eb19bd09ebf4cabbae2/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:06.652187 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71857b7f-deba-4e67-a391-0651759869f2 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:06.667216 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71857b7f-deba-4e67-a391-0651759869f2 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:06.727752 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc267332-00e2-4137-985c-d519a6e561f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:06.728420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc267332-00e2-4137-985c-d519a6e561f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:06.728704 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc267332-00e2-4137-985c-d519a6e561f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:06.729013 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc267332-00e2-4137-985c-d519a6e561f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:06.729734 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc267332-00e2-4137-985c-d519a6e561f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:06.731319 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc267332-00e2-4137-985c-d519a6e561f2 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:06.741762 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1074/2176] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:06 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:06.746263 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96582c7e-16d9-4ac8-b7ef-75a79554ae6d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:06.757817 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96582c7e-16d9-4ac8-b7ef-75a79554ae6d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:06.762587 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542f6d8-716b-428c-9438-b2b457bf65ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:06.763460 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542f6d8-716b-428c-9438-b2b457bf65ed admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:06.763743 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542f6d8-716b-428c-9438-b2b457bf65ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:06.764021 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542f6d8-716b-428c-9438-b2b457bf65ed admin admin] PATH_INFO: `/v3/projects/5ae6b75201ce4526aff18448a1699b9b/users/c6fee8505c1c4eb19bd09ebf4cabbae2/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:06.766566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542f6d8-716b-428c-9438-b2b457bf65ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae6b75201ce4526aff18448a1699b9b, user_id=c6fee8505c1c4eb19bd09ebf4cabbae2, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:06.770386 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542f6d8-716b-428c-9438-b2b457bf65ed admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:06.779472 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1103/2177] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:06 2021] PUT /identity/v3/projects/5ae6b75201ce4526aff18448a1699b9b/users/c6fee8505c1c4eb19bd09ebf4cabbae2/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:08.047799 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca234a4-4548-4a28-9059-9d4c62786b3c None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:08.054402 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca234a4-4548-4a28-9059-9d4c62786b3c None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:08.054402 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca234a4-4548-4a28-9059-9d4c62786b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:08.075171 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-9ca234a4-4548-4a28-9059-9d4c62786b3c None None] MFA Rules not processed for user `c6fee8505c1c4eb19bd09ebf4cabbae2`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:08.076392 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-9ca234a4-4548-4a28-9059-9d4c62786b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:08.143500 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1075/2178] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:08 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:09.226758 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542f6d8-716b-428c-9438-b2b457bf65ed admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:09.228515 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-6542f6d8-716b-428c-9438-b2b457bf65ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:09.291661 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542f6d8-716b-428c-9438-b2b457bf65ed admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:09.299566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae8356-8b5e-40ec-880a-298e5e45e8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:09.299566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae8356-8b5e-40ec-880a-298e5e45e8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:09.299566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae8356-8b5e-40ec-880a-298e5e45e8af admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:09.299566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae8356-8b5e-40ec-880a-298e5e45e8af admin admin] PATH_INFO: `/v3/users/0302db6270aa4808ad620efb5261afa8` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:09.300307 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae8356-8b5e-40ec-880a-298e5e45e8af admin admin] RBAC: Authorizing `identity:delete_user(user_id=0302db6270aa4808ad620efb5261afa8)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:09.301853 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae8356-8b5e-40ec-880a-298e5e45e8af admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:09.422545 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca234a4-4548-4a28-9059-9d4c62786b3c None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:09.433880 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca234a4-4548-4a28-9059-9d4c62786b3c None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:09.438814 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0fb1c-9800-4f21-85b8-b565cc5bb12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:09.439737 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0fb1c-9800-4f21-85b8-b565cc5bb12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:09.440012 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0fb1c-9800-4f21-85b8-b565cc5bb12e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:09.440285 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0fb1c-9800-4f21-85b8-b565cc5bb12e admin admin] PATH_INFO: `/v3/users/c8702bd36a0747d5b539c3cee653a26c` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:09.441473 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0fb1c-9800-4f21-85b8-b565cc5bb12e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8702bd36a0747d5b539c3cee653a26c)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:09.443374 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0fb1c-9800-4f21-85b8-b565cc5bb12e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:09.517974 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-0aae8356-8b5e-40ec-880a-298e5e45e8af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0302db6270aa4808ad620efb5261afa8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:09.529450 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-0aae8356-8b5e-40ec-880a-298e5e45e8af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0302db6270aa4808ad620efb5261afa8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:09.536541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-0aae8356-8b5e-40ec-880a-298e5e45e8af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0302db6270aa4808ad620efb5261afa8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:09.537385 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-0aae8356-8b5e-40ec-880a-298e5e45e8af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0302db6270aa4808ad620efb5261afa8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:09.621207 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-97c0fb1c-9800-4f21-85b8-b565cc5bb12e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8702bd36a0747d5b539c3cee653a26c'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:09.621788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-97c0fb1c-9800-4f21-85b8-b565cc5bb12e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8702bd36a0747d5b539c3cee653a26c'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:09.628571 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-97c0fb1c-9800-4f21-85b8-b565cc5bb12e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8702bd36a0747d5b539c3cee653a26c'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:09.629465 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-97c0fb1c-9800-4f21-85b8-b565cc5bb12e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8702bd36a0747d5b539c3cee653a26c'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:09.636263 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-0aae8356-8b5e-40ec-880a-298e5e45e8af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0302db6270aa4808ad620efb5261afa8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:09.643485 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1104/2179] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:09 2021] DELETE /identity/v3/users/0302db6270aa4808ad620efb5261afa8 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:09.647756 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff5e5d-ff12-4e8c-ae76-bf1bdc5fc1bc None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:09.648043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff5e5d-ff12-4e8c-ae76-bf1bdc5fc1bc None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:09.648325 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff5e5d-ff12-4e8c-ae76-bf1bdc5fc1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:09.665542 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-91ff5e5d-ff12-4e8c-ae76-bf1bdc5fc1bc None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:09.666732 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-91ff5e5d-ff12-4e8c-ae76-bf1bdc5fc1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:09.722137 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1105/2180] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:09.731804 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff5e5d-ff12-4e8c-ae76-bf1bdc5fc1bc None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:09.733316 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-91ff5e5d-ff12-4e8c-ae76-bf1bdc5fc1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:09.733926 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-97c0fb1c-9800-4f21-85b8-b565cc5bb12e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8702bd36a0747d5b539c3cee653a26c'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:09.751354 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1076/2181] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:09 2021] DELETE /identity/v3/users/c8702bd36a0747d5b539c3cee653a26c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:35:09.790290 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff5e5d-ff12-4e8c-ae76-bf1bdc5fc1bc None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:09.839474 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efa301-7b67-4424-b8c0-a1ffea1a62d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:09.840128 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efa301-7b67-4424-b8c0-a1ffea1a62d9 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:09.840410 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efa301-7b67-4424-b8c0-a1ffea1a62d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:09.840686 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efa301-7b67-4424-b8c0-a1ffea1a62d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:09.902370 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efa301-7b67-4424-b8c0-a1ffea1a62d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:09.903819 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efa301-7b67-4424-b8c0-a1ffea1a62d9 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:09.914141 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1106/2182] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:35:10.071965 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0fb1c-9800-4f21-85b8-b565cc5bb12e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:10.073416 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-97c0fb1c-9800-4f21-85b8-b565cc5bb12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:10.087374 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0fb1c-9800-4f21-85b8-b565cc5bb12e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:10.092011 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01514580-7717-4943-86e7-d52d3916546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:10.093020 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01514580-7717-4943-86e7-d52d3916546e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:10.093306 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01514580-7717-4943-86e7-d52d3916546e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:10.093584 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01514580-7717-4943-86e7-d52d3916546e admin admin] PATH_INFO: `/v3/projects/a7bc0f20fc8e41aea86f81d970c2f55a` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:10.094842 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01514580-7717-4943-86e7-d52d3916546e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7bc0f20fc8e41aea86f81d970c2f55a)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:10.096693 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01514580-7717-4943-86e7-d52d3916546e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:10.203726 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-01514580-7717-4943-86e7-d52d3916546e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7bc0f20fc8e41aea86f81d970c2f55a', 'request_id': 'req-01514580-7717-4943-86e7-d52d3916546e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:10.209899 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-01514580-7717-4943-86e7-d52d3916546e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7bc0f20fc8e41aea86f81d970c2f55a', 'request_id': 'req-01514580-7717-4943-86e7-d52d3916546e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:10.270627 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-01514580-7717-4943-86e7-d52d3916546e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7bc0f20fc8e41aea86f81d970c2f55a', 'request_id': 'req-01514580-7717-4943-86e7-d52d3916546e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:10.281664 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-01514580-7717-4943-86e7-d52d3916546e admin admin] The token cache is being invalidate because project a7bc0f20fc8e41aea86f81d970c2f55a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:10.281958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-01514580-7717-4943-86e7-d52d3916546e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:10.282607 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-01514580-7717-4943-86e7-d52d3916546e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:10.284191 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1077/2183] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:10 2021] DELETE /identity/v3/projects/a7bc0f20fc8e41aea86f81d970c2f55a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:10.288165 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efa301-7b67-4424-b8c0-a1ffea1a62d9 service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:10.289634 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-d2efa301-7b67-4424-b8c0-a1ffea1a62d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:10.302421 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efa301-7b67-4424-b8c0-a1ffea1a62d9 service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:10.329967 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01514580-7717-4943-86e7-d52d3916546e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:10.331438 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-01514580-7717-4943-86e7-d52d3916546e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:10.363912 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81f8ba-1b28-4fbf-81a6-e9ba9d53aeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:10.364992 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81f8ba-1b28-4fbf-81a6-e9ba9d53aeb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:10.365388 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81f8ba-1b28-4fbf-81a6-e9ba9d53aeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:10.365762 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81f8ba-1b28-4fbf-81a6-e9ba9d53aeb1 admin admin] PATH_INFO: `/v3/users/c6fee8505c1c4eb19bd09ebf4cabbae2` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:10.367102 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81f8ba-1b28-4fbf-81a6-e9ba9d53aeb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6fee8505c1c4eb19bd09ebf4cabbae2)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:10.369202 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81f8ba-1b28-4fbf-81a6-e9ba9d53aeb1 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:10.411984 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01514580-7717-4943-86e7-d52d3916546e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:10.416710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56f77f-a3b3-4a65-a33e-ddabdaee1937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:10.417596 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56f77f-a3b3-4a65-a33e-ddabdaee1937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:10.417874 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56f77f-a3b3-4a65-a33e-ddabdaee1937 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:10.418284 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56f77f-a3b3-4a65-a33e-ddabdaee1937 admin admin] PATH_INFO: `/v3/projects/55e751bd335549608acce0c3e5db5359` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:10.419461 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56f77f-a3b3-4a65-a33e-ddabdaee1937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55e751bd335549608acce0c3e5db5359)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:10.421929 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56f77f-a3b3-4a65-a33e-ddabdaee1937 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:10.577351 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3f56f77f-a3b3-4a65-a33e-ddabdaee1937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55e751bd335549608acce0c3e5db5359', 'request_id': 'req-3f56f77f-a3b3-4a65-a33e-ddabdaee1937'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:10.578966 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-cb81f8ba-1b28-4fbf-81a6-e9ba9d53aeb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6fee8505c1c4eb19bd09ebf4cabbae2'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:10.584159 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3f56f77f-a3b3-4a65-a33e-ddabdaee1937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55e751bd335549608acce0c3e5db5359', 'request_id': 'req-3f56f77f-a3b3-4a65-a33e-ddabdaee1937'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:10.591501 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-cb81f8ba-1b28-4fbf-81a6-e9ba9d53aeb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6fee8505c1c4eb19bd09ebf4cabbae2'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:10.599423 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-cb81f8ba-1b28-4fbf-81a6-e9ba9d53aeb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6fee8505c1c4eb19bd09ebf4cabbae2'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:10.599423 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-cb81f8ba-1b28-4fbf-81a6-e9ba9d53aeb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6fee8505c1c4eb19bd09ebf4cabbae2'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:10.636205 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3f56f77f-a3b3-4a65-a33e-ddabdaee1937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55e751bd335549608acce0c3e5db5359', 'request_id': 'req-3f56f77f-a3b3-4a65-a33e-ddabdaee1937'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:10.649552 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3f56f77f-a3b3-4a65-a33e-ddabdaee1937 admin admin] The token cache is being invalidate because project 55e751bd335549608acce0c3e5db5359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:10.649837 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3f56f77f-a3b3-4a65-a33e-ddabdaee1937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:10.650499 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3f56f77f-a3b3-4a65-a33e-ddabdaee1937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:10.652488 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1078/2184] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:10 2021] DELETE /identity/v3/projects/55e751bd335549608acce0c3e5db5359 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:35:10.657054 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56f77f-a3b3-4a65-a33e-ddabdaee1937 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:10.658725 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-3f56f77f-a3b3-4a65-a33e-ddabdaee1937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:10.693678 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-cb81f8ba-1b28-4fbf-81a6-e9ba9d53aeb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6fee8505c1c4eb19bd09ebf4cabbae2'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:10.705401 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1107/2185] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:10 2021] DELETE /identity/v3/users/c6fee8505c1c4eb19bd09ebf4cabbae2 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:35:10.722471 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56f77f-a3b3-4a65-a33e-ddabdaee1937 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:10.779122 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff43b7-a432-41ac-b415-9068dd3ebdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:10.780225 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff43b7-a432-41ac-b415-9068dd3ebdda admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:10.780617 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff43b7-a432-41ac-b415-9068dd3ebdda admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:10.780989 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff43b7-a432-41ac-b415-9068dd3ebdda admin admin] PATH_INFO: `/v3/users/ca8f24b5ef2f48c59724a8c132f1567a` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:10.782219 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff43b7-a432-41ac-b415-9068dd3ebdda admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca8f24b5ef2f48c59724a8c132f1567a)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:10.784507 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff43b7-a432-41ac-b415-9068dd3ebdda admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:10.958847 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81f8ba-1b28-4fbf-81a6-e9ba9d53aeb1 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:10.960815 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-cb81f8ba-1b28-4fbf-81a6-e9ba9d53aeb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:10.975669 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81f8ba-1b28-4fbf-81a6-e9ba9d53aeb1 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:10.981005 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347655f-8fb8-46ba-9d9d-926981c968b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:10.982169 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347655f-8fb8-46ba-9d9d-926981c968b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:10.982515 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347655f-8fb8-46ba-9d9d-926981c968b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:10.984334 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347655f-8fb8-46ba-9d9d-926981c968b7 admin admin] PATH_INFO: `/v3/projects/5ae6b75201ce4526aff18448a1699b9b` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:10.984334 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347655f-8fb8-46ba-9d9d-926981c968b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae6b75201ce4526aff18448a1699b9b)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:10.988744 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347655f-8fb8-46ba-9d9d-926981c968b7 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:10.997927 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-27ff43b7-a432-41ac-b415-9068dd3ebdda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca8f24b5ef2f48c59724a8c132f1567a'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:10.999495 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-27ff43b7-a432-41ac-b415-9068dd3ebdda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca8f24b5ef2f48c59724a8c132f1567a'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:11.007900 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-27ff43b7-a432-41ac-b415-9068dd3ebdda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca8f24b5ef2f48c59724a8c132f1567a'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:11.008589 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-27ff43b7-a432-41ac-b415-9068dd3ebdda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca8f24b5ef2f48c59724a8c132f1567a'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:11.093816 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-27ff43b7-a432-41ac-b415-9068dd3ebdda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca8f24b5ef2f48c59724a8c132f1567a'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:11.111781 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1079/2186] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:10 2021] DELETE /identity/v3/users/ca8f24b5ef2f48c59724a8c132f1567a => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:11.122094 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-9347655f-8fb8-46ba-9d9d-926981c968b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae6b75201ce4526aff18448a1699b9b', 'request_id': 'req-9347655f-8fb8-46ba-9d9d-926981c968b7'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:11.129425 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-9347655f-8fb8-46ba-9d9d-926981c968b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae6b75201ce4526aff18448a1699b9b', 'request_id': 'req-9347655f-8fb8-46ba-9d9d-926981c968b7'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:11.213771 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-9347655f-8fb8-46ba-9d9d-926981c968b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae6b75201ce4526aff18448a1699b9b', 'request_id': 'req-9347655f-8fb8-46ba-9d9d-926981c968b7'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:11.225129 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-9347655f-8fb8-46ba-9d9d-926981c968b7 admin admin] The token cache is being invalidate because project 5ae6b75201ce4526aff18448a1699b9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:11.225419 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-9347655f-8fb8-46ba-9d9d-926981c968b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:11.226082 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-9347655f-8fb8-46ba-9d9d-926981c968b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:11.227626 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1108/2187] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:10 2021] DELETE /identity/v3/projects/5ae6b75201ce4526aff18448a1699b9b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:35:11.234446 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62733b2-06c0-488e-bbc1-26887b23a3ba None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:11.234733 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62733b2-06c0-488e-bbc1-26887b23a3ba None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:11.235011 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62733b2-06c0-488e-bbc1-26887b23a3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:11.253531 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-f62733b2-06c0-488e-bbc1-26887b23a3ba None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:11.254742 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-f62733b2-06c0-488e-bbc1-26887b23a3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:11.312985 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1080/2188] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:11.320771 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c0b4a-eaef-4316-b53c-b1d318c80c6d None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:11.321305 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c0b4a-eaef-4316-b53c-b1d318c80c6d None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:11.321400 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c0b4a-eaef-4316-b53c-b1d318c80c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:11.339680 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-2b6c0b4a-eaef-4316-b53c-b1d318c80c6d None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:11.342504 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-2b6c0b4a-eaef-4316-b53c-b1d318c80c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:11.352399 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1109/2189] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:11.353824 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62733b2-06c0-488e-bbc1-26887b23a3ba None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:11.364384 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62733b2-06c0-488e-bbc1-26887b23a3ba None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:11.369149 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28275c45-d2e0-48b8-828b-a7ce2a86b8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:11.369808 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275c45-d2e0-48b8-828b-a7ce2a86b8db admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:11.370091 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275c45-d2e0-48b8-828b-a7ce2a86b8db admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:11.370364 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275c45-d2e0-48b8-828b-a7ce2a86b8db admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:11.371082 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28275c45-d2e0-48b8-828b-a7ce2a86b8db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:35:11.371382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28275c45-d2e0-48b8-828b-a7ce2a86b8db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:11.372985 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28275c45-d2e0-48b8-828b-a7ce2a86b8db admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:11.385593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1081/2190] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:35:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:35:11.389855 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c0b4a-eaef-4316-b53c-b1d318c80c6d None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:11.400885 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c0b4a-eaef-4316-b53c-b1d318c80c6d None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:11.406331 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa30423-5cd5-4ede-89d8-623c027dcd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:11.407223 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa30423-5cd5-4ede-89d8-623c027dcd21 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:11.407506 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa30423-5cd5-4ede-89d8-623c027dcd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:11.408086 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa30423-5cd5-4ede-89d8-623c027dcd21 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:11.408623 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa30423-5cd5-4ede-89d8-623c027dcd21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:11.410701 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa30423-5cd5-4ede-89d8-623c027dcd21 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:11.547301 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1110/2191] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:11 2021] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:35:11.551918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28275c45-d2e0-48b8-828b-a7ce2a86b8db admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:11.561994 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28275c45-d2e0-48b8-828b-a7ce2a86b8db admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:11.592085 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa30423-5cd5-4ede-89d8-623c027dcd21 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:11.596212 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-dfa30423-5cd5-4ede-89d8-623c027dcd21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:11.620980 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabc282-37f6-411a-b9b4-aaa3948b623a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:11.621661 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabc282-37f6-411a-b9b4-aaa3948b623a admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:11.621955 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabc282-37f6-411a-b9b4-aaa3948b623a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:11.623441 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabc282-37f6-411a-b9b4-aaa3948b623a admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:11.623441 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabc282-37f6-411a-b9b4-aaa3948b623a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:11.624864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabc282-37f6-411a-b9b4-aaa3948b623a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:11.664597 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa30423-5cd5-4ede-89d8-623c027dcd21 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:11.669238 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9917cd-90da-4bda-b82d-f2860ccffb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:11.670147 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9917cd-90da-4bda-b82d-f2860ccffb33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:11.670429 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9917cd-90da-4bda-b82d-f2860ccffb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:11.671652 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9917cd-90da-4bda-b82d-f2860ccffb33 admin admin] PATH_INFO: `/v3/projects/3e9c65f74e064bfebf9a7bbf79be14e1` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:11.672540 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9917cd-90da-4bda-b82d-f2860ccffb33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e9c65f74e064bfebf9a7bbf79be14e1)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:11.674463 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9917cd-90da-4bda-b82d-f2860ccffb33 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:11.780185 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1082/2192] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:35:11 2021] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:35:11.784379 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabc282-37f6-411a-b9b4-aaa3948b623a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:11.793834 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabc282-37f6-411a-b9b4-aaa3948b623a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:11.799146 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d560b07-03c6-4af4-bd7a-f37bec4fbc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:11.799781 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d560b07-03c6-4af4-bd7a-f37bec4fbc60 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:11.800318 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d560b07-03c6-4af4-bd7a-f37bec4fbc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:11.800590 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d560b07-03c6-4af4-bd7a-f37bec4fbc60 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:11.801339 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d560b07-03c6-4af4-bd7a-f37bec4fbc60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:11.802904 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d560b07-03c6-4af4-bd7a-f37bec4fbc60 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:11.812955 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1083/2193] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:11 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:35:11.816803 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d560b07-03c6-4af4-bd7a-f37bec4fbc60 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:11.826061 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d560b07-03c6-4af4-bd7a-f37bec4fbc60 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:11.830826 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7badd4-05f2-48ad-8ca0-b7a380638725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:11.831447 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7badd4-05f2-48ad-8ca0-b7a380638725 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:11.831730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7badd4-05f2-48ad-8ca0-b7a380638725 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:11.832007 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7badd4-05f2-48ad-8ca0-b7a380638725 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:11.832711 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7badd4-05f2-48ad-8ca0-b7a380638725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:11.834293 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7badd4-05f2-48ad-8ca0-b7a380638725 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:11.845448 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1084/2194] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:11 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:35:11.854557 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-1c9917cd-90da-4bda-b82d-f2860ccffb33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e9c65f74e064bfebf9a7bbf79be14e1', 'request_id': 'req-1c9917cd-90da-4bda-b82d-f2860ccffb33'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:11.861559 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-1c9917cd-90da-4bda-b82d-f2860ccffb33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e9c65f74e064bfebf9a7bbf79be14e1', 'request_id': 'req-1c9917cd-90da-4bda-b82d-f2860ccffb33'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:11.866094 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7badd4-05f2-48ad-8ca0-b7a380638725 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:11.875756 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7badd4-05f2-48ad-8ca0-b7a380638725 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:11.931209 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c91eea-031d-4aab-98f1-7897830a1758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:11.932143 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c91eea-031d-4aab-98f1-7897830a1758 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:11.932419 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c91eea-031d-4aab-98f1-7897830a1758 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:11.932691 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c91eea-031d-4aab-98f1-7897830a1758 admin admin] PATH_INFO: `/v3/projects/e0fb466cf1cf48679410851466601fe8/users/7813027404a14301a5210ef58e262357/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:11.946722 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c91eea-031d-4aab-98f1-7897830a1758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0fb466cf1cf48679410851466601fe8, user_id=7813027404a14301a5210ef58e262357, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:11.965811 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c91eea-031d-4aab-98f1-7897830a1758 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:12.065213 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-1c9917cd-90da-4bda-b82d-f2860ccffb33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e9c65f74e064bfebf9a7bbf79be14e1', 'request_id': 'req-1c9917cd-90da-4bda-b82d-f2860ccffb33'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:12.077843 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-1c9917cd-90da-4bda-b82d-f2860ccffb33 admin admin] The token cache is being invalidate because project 3e9c65f74e064bfebf9a7bbf79be14e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:12.078153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-1c9917cd-90da-4bda-b82d-f2860ccffb33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:12.078805 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-1c9917cd-90da-4bda-b82d-f2860ccffb33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:12.080702 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1111/2195] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:11 2021] DELETE /identity/v3/projects/3e9c65f74e064bfebf9a7bbf79be14e1 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:12.085952 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e467f-2529-47a9-a6d0-3bda2a428700 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:12.086282 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e467f-2529-47a9-a6d0-3bda2a428700 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:12.086523 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e467f-2529-47a9-a6d0-3bda2a428700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:12.105205 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-102e467f-2529-47a9-a6d0-3bda2a428700 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:12.106408 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-102e467f-2529-47a9-a6d0-3bda2a428700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:12.114235 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1112/2196] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:12.123040 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316d914-95c7-4427-86ce-a3e0d20b33f9 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:12.123952 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316d914-95c7-4427-86ce-a3e0d20b33f9 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:12.124269 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316d914-95c7-4427-86ce-a3e0d20b33f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:12.145769 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-a316d914-95c7-4427-86ce-a3e0d20b33f9 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:12.147014 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a316d914-95c7-4427-86ce-a3e0d20b33f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:12.156067 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1113/2197] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:12.167019 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316d914-95c7-4427-86ce-a3e0d20b33f9 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:12.167325 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1085/2198] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:11 2021] PUT /identity/v3/projects/e0fb466cf1cf48679410851466601fe8/users/7813027404a14301a5210ef58e262357/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:35:12.170176 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316d914-95c7-4427-86ce-a3e0d20b33f9 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:12.175918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa54345-2319-42fc-8cde-19fe048f200c None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:12.176413 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa54345-2319-42fc-8cde-19fe048f200c None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:12.176689 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa54345-2319-42fc-8cde-19fe048f200c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:12.205177 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-8aa54345-2319-42fc-8cde-19fe048f200c None None] MFA Rules not processed for user `7813027404a14301a5210ef58e262357`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:12.206547 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8aa54345-2319-42fc-8cde-19fe048f200c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:12.228356 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701dcd95-0606-43e1-aac1-b32de828eb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:12.229368 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701dcd95-0606-43e1-aac1-b32de828eb4e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:12.229827 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701dcd95-0606-43e1-aac1-b32de828eb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:12.230273 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701dcd95-0606-43e1-aac1-b32de828eb4e admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:12.231148 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701dcd95-0606-43e1-aac1-b32de828eb4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:35:12.231611 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701dcd95-0606-43e1-aac1-b32de828eb4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:12.234162 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701dcd95-0606-43e1-aac1-b32de828eb4e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:12.246115 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1114/2199] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:35:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:35:12.251255 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701dcd95-0606-43e1-aac1-b32de828eb4e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:12.260565 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701dcd95-0606-43e1-aac1-b32de828eb4e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:12.265332 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd87c61-82f0-42ab-9fa5-ddeafe50e2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:12.265972 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd87c61-82f0-42ab-9fa5-ddeafe50e2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:12.266253 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd87c61-82f0-42ab-9fa5-ddeafe50e2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:12.266528 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd87c61-82f0-42ab-9fa5-ddeafe50e2d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:12.267210 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd87c61-82f0-42ab-9fa5-ddeafe50e2d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:12.269195 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd87c61-82f0-42ab-9fa5-ddeafe50e2d0 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:12.270737 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1086/2200] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:12 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:12.275098 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa54345-2319-42fc-8cde-19fe048f200c None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:12.276392 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8aa54345-2319-42fc-8cde-19fe048f200c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:12.291624 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa54345-2319-42fc-8cde-19fe048f200c None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:12.297408 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffd869-ba26-48a9-a851-29c09d20bbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:12.298235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffd869-ba26-48a9-a851-29c09d20bbef admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:12.298596 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffd869-ba26-48a9-a851-29c09d20bbef admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:12.299136 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffd869-ba26-48a9-a851-29c09d20bbef admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:12.300204 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffd869-ba26-48a9-a851-29c09d20bbef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:12.302233 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffd869-ba26-48a9-a851-29c09d20bbef admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:12.380978 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1115/2201] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:12 2021] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:35:12.389229 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd87c61-82f0-42ab-9fa5-ddeafe50e2d0 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:12.429454 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1087/2202] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:12 2021] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:35:12.437257 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffd869-ba26-48a9-a851-29c09d20bbef admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:12.455631 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd87c61-82f0-42ab-9fa5-ddeafe50e2d0 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:12.497673 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffd869-ba26-48a9-a851-29c09d20bbef admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:12.502494 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905b60f-4be4-4b13-80a1-ea9aadc29231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:12.503156 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905b60f-4be4-4b13-80a1-ea9aadc29231 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:12.503482 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905b60f-4be4-4b13-80a1-ea9aadc29231 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:12.503742 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905b60f-4be4-4b13-80a1-ea9aadc29231 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:12.504419 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905b60f-4be4-4b13-80a1-ea9aadc29231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:12.506337 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905b60f-4be4-4b13-80a1-ea9aadc29231 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:12.510793 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fac89-6886-418c-b30c-cc03e7844c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:12.518325 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fac89-6886-418c-b30c-cc03e7844c01 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:12.518325 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fac89-6886-418c-b30c-cc03e7844c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:12.518325 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fac89-6886-418c-b30c-cc03e7844c01 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:12.518325 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fac89-6886-418c-b30c-cc03e7844c01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:12.518325 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fac89-6886-418c-b30c-cc03e7844c01 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:12.599637 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1088/2204] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:35:12 2021] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:12.600130 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1116/2204] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:35:12 2021] POST /identity/v3/users => generated 285 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:35:12.604447 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fac89-6886-418c-b30c-cc03e7844c01 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:12.604585 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905b60f-4be4-4b13-80a1-ea9aadc29231 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:12.614940 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905b60f-4be4-4b13-80a1-ea9aadc29231 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:12.615119 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fac89-6886-418c-b30c-cc03e7844c01 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:12.619573 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b67a2-93be-43e6-9d6e-fecef3e67a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:12.619734 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09457458-3e67-4c47-aef5-21db6edb8e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:12.620240 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b67a2-93be-43e6-9d6e-fecef3e67a94 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:12.620385 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09457458-3e67-4c47-aef5-21db6edb8e3d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:12.620522 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b67a2-93be-43e6-9d6e-fecef3e67a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:12.620681 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09457458-3e67-4c47-aef5-21db6edb8e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:12.620799 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b67a2-93be-43e6-9d6e-fecef3e67a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:12.621082 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09457458-3e67-4c47-aef5-21db6edb8e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:12.621540 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b67a2-93be-43e6-9d6e-fecef3e67a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:12.622006 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09457458-3e67-4c47-aef5-21db6edb8e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:12.623122 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b67a2-93be-43e6-9d6e-fecef3e67a94 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:12.623481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09457458-3e67-4c47-aef5-21db6edb8e3d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:12.632941 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1089/2205] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:12 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:12.636496 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1117/2206] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:12 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:12.637265 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b67a2-93be-43e6-9d6e-fecef3e67a94 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:12.641017 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09457458-3e67-4c47-aef5-21db6edb8e3d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:12.648169 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b67a2-93be-43e6-9d6e-fecef3e67a94 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:12.650840 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09457458-3e67-4c47-aef5-21db6edb8e3d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:12.653175 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e26776-c497-422b-87fa-0158cec0aa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:12.654038 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e26776-c497-422b-87fa-0158cec0aa60 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:12.654321 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e26776-c497-422b-87fa-0158cec0aa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:12.654595 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e26776-c497-422b-87fa-0158cec0aa60 admin admin] PATH_INFO: `/v3/projects/7fc62dd77d2b493d89ecc4cb2efa1c22/users/04454cd21cd44498aa17180cc39d5cb5/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:12.656279 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c025547-0b40-4571-8657-49a1754ed40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:12.656955 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c025547-0b40-4571-8657-49a1754ed40e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:12.657238 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c025547-0b40-4571-8657-49a1754ed40e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:12.657533 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c025547-0b40-4571-8657-49a1754ed40e admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:12.658254 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c025547-0b40-4571-8657-49a1754ed40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:12.659827 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c025547-0b40-4571-8657-49a1754ed40e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:12.670269 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1118/2207] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:12 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:35:12.673756 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e26776-c497-422b-87fa-0158cec0aa60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc62dd77d2b493d89ecc4cb2efa1c22, user_id=04454cd21cd44498aa17180cc39d5cb5, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:12.673873 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e26776-c497-422b-87fa-0158cec0aa60 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:12.674551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c025547-0b40-4571-8657-49a1754ed40e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:12.684373 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c025547-0b40-4571-8657-49a1754ed40e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:12.689249 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca62c8f-25f5-4bd5-a6cc-151527b8e2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:12.690109 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca62c8f-25f5-4bd5-a6cc-151527b8e2b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:12.690389 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca62c8f-25f5-4bd5-a6cc-151527b8e2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:12.690662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca62c8f-25f5-4bd5-a6cc-151527b8e2b1 admin admin] PATH_INFO: `/v3/projects/9438f3d285374de99810fc04fb296826/users/5dd8c7ea39e145b39a820fdc2876c0e5/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:12.706269 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca62c8f-25f5-4bd5-a6cc-151527b8e2b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9438f3d285374de99810fc04fb296826, user_id=5dd8c7ea39e145b39a820fdc2876c0e5, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:12.709294 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca62c8f-25f5-4bd5-a6cc-151527b8e2b1 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:12.733781 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1090/2208] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:12 2021] PUT /identity/v3/projects/7fc62dd77d2b493d89ecc4cb2efa1c22/users/04454cd21cd44498aa17180cc39d5cb5/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:35:12.737609 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e26776-c497-422b-87fa-0158cec0aa60 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:12.779276 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1119/2209] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:12 2021] PUT /identity/v3/projects/9438f3d285374de99810fc04fb296826/users/5dd8c7ea39e145b39a820fdc2876c0e5/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:35:12.789911 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020a335-5352-440f-8c5b-fdeeafd35876 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:12.790201 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020a335-5352-440f-8c5b-fdeeafd35876 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:12.790482 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020a335-5352-440f-8c5b-fdeeafd35876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:12.797104 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e26776-c497-422b-87fa-0158cec0aa60 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:12.816463 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f020a335-5352-440f-8c5b-fdeeafd35876 None None] MFA Rules not processed for user `5dd8c7ea39e145b39a820fdc2876c0e5`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:12.817782 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f020a335-5352-440f-8c5b-fdeeafd35876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:12.853825 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4defae1-4fdc-481b-862b-4cf175e78524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:12.854411 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4defae1-4fdc-481b-862b-4cf175e78524 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:12.854701 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4defae1-4fdc-481b-862b-4cf175e78524 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:12.854976 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4defae1-4fdc-481b-862b-4cf175e78524 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:12.855699 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4defae1-4fdc-481b-862b-4cf175e78524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:12.857332 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4defae1-4fdc-481b-862b-4cf175e78524 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:12.870561 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1091/2210] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:12 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:35:12.871540 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4defae1-4fdc-481b-862b-4cf175e78524 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:12.880795 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1120/2211] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:12 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:12.881302 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4defae1-4fdc-481b-862b-4cf175e78524 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:12.885091 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020a335-5352-440f-8c5b-fdeeafd35876 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:12.886120 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e6195-0503-4989-a3c2-7c3fa7b3bc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:12.887015 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e6195-0503-4989-a3c2-7c3fa7b3bc10 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:12.887293 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e6195-0503-4989-a3c2-7c3fa7b3bc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:12.887566 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e6195-0503-4989-a3c2-7c3fa7b3bc10 admin admin] PATH_INFO: `/v3/projects/7fc62dd77d2b493d89ecc4cb2efa1c22/users/04454cd21cd44498aa17180cc39d5cb5/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:12.890146 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e6195-0503-4989-a3c2-7c3fa7b3bc10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc62dd77d2b493d89ecc4cb2efa1c22, user_id=04454cd21cd44498aa17180cc39d5cb5, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:12.892845 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e6195-0503-4989-a3c2-7c3fa7b3bc10 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:12.895705 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020a335-5352-440f-8c5b-fdeeafd35876 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:12.900359 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4fdc4-1dbb-45d3-9fb0-84a716c9a995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:12.901030 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4fdc4-1dbb-45d3-9fb0-84a716c9a995 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:12.901316 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4fdc4-1dbb-45d3-9fb0-84a716c9a995 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:12.901592 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4fdc4-1dbb-45d3-9fb0-84a716c9a995 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:12.902275 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4fdc4-1dbb-45d3-9fb0-84a716c9a995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:12.903061 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1092/2212] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:12 2021] PUT /identity/v3/projects/7fc62dd77d2b493d89ecc4cb2efa1c22/users/04454cd21cd44498aa17180cc39d5cb5/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:12.909160 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4fdc4-1dbb-45d3-9fb0-84a716c9a995 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:12.913980 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcf031-86f0-4714-aaf2-c8beaae70b54 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:12.914264 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcf031-86f0-4714-aaf2-c8beaae70b54 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:12.914538 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcf031-86f0-4714-aaf2-c8beaae70b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:12.940635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-04fcf031-86f0-4714-aaf2-c8beaae70b54 None None] MFA Rules not processed for user `04454cd21cd44498aa17180cc39d5cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:12.941868 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-04fcf031-86f0-4714-aaf2-c8beaae70b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:13.009214 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1093/2213] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:12 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:13.016459 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1121/2214] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:12 2021] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:35:13.021864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcf031-86f0-4714-aaf2-c8beaae70b54 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:13.022020 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4fdc4-1dbb-45d3-9fb0-84a716c9a995 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:13.023588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f2c4fdc4-1dbb-45d3-9fb0-84a716c9a995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:13.084425 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4fdc4-1dbb-45d3-9fb0-84a716c9a995 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:13.088169 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064fede-d4f2-40e6-a458-cbea89caf960 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:13.089318 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064fede-d4f2-40e6-a458-cbea89caf960 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:13.089318 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064fede-d4f2-40e6-a458-cbea89caf960 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:13.089496 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064fede-d4f2-40e6-a458-cbea89caf960 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:13.094670 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcf031-86f0-4714-aaf2-c8beaae70b54 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:13.161241 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064fede-d4f2-40e6-a458-cbea89caf960 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:13.162722 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064fede-d4f2-40e6-a458-cbea89caf960 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:13.164250 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff7fa7-f883-4fe8-a55f-aaa8e3bbce2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:13.165162 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff7fa7-f883-4fe8-a55f-aaa8e3bbce2c admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:13.165633 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff7fa7-f883-4fe8-a55f-aaa8e3bbce2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:13.166048 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff7fa7-f883-4fe8-a55f-aaa8e3bbce2c admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:13.166893 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff7fa7-f883-4fe8-a55f-aaa8e3bbce2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:13.169058 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff7fa7-f883-4fe8-a55f-aaa8e3bbce2c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:13.173201 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1122/2215] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:13 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:35:13.264900 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1094/2216] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:35:13 2021] POST /identity/v3/users => generated 290 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:13.268811 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064fede-d4f2-40e6-a458-cbea89caf960 service cinder] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:13.279535 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064fede-d4f2-40e6-a458-cbea89caf960 service cinder] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:13.284623 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a53ff7-980f-45ac-ba9f-7f03178e798e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:13.285900 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a53ff7-980f-45ac-ba9f-7f03178e798e admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:13.285900 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a53ff7-980f-45ac-ba9f-7f03178e798e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:13.286111 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a53ff7-980f-45ac-ba9f-7f03178e798e admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:13.286737 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a53ff7-980f-45ac-ba9f-7f03178e798e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:13.288308 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a53ff7-980f-45ac-ba9f-7f03178e798e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:13.298339 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1123/2217] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:13.302821 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff7fa7-f883-4fe8-a55f-aaa8e3bbce2c admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:13.313096 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff7fa7-f883-4fe8-a55f-aaa8e3bbce2c admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:13.317600 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71539966-0d07-4501-8d5d-8cc47519dd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:13.318463 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71539966-0d07-4501-8d5d-8cc47519dd15 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:13.321439 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71539966-0d07-4501-8d5d-8cc47519dd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:13.321439 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71539966-0d07-4501-8d5d-8cc47519dd15 admin admin] PATH_INFO: `/v3/projects/e01c981ab966498ab49600670730ada7/users/ecab6df1abf24e85961562af750ba88d/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:13.333779 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71539966-0d07-4501-8d5d-8cc47519dd15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e01c981ab966498ab49600670730ada7, user_id=ecab6df1abf24e85961562af750ba88d, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:13.336386 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71539966-0d07-4501-8d5d-8cc47519dd15 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:13.448726 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1095/2218] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:13 2021] PUT /identity/v3/projects/e01c981ab966498ab49600670730ada7/users/ecab6df1abf24e85961562af750ba88d/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:13.456032 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a53ff7-980f-45ac-ba9f-7f03178e798e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:13.474238 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a53ff7-980f-45ac-ba9f-7f03178e798e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:13.553442 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71539966-0d07-4501-8d5d-8cc47519dd15 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:13.555446 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-71539966-0d07-4501-8d5d-8cc47519dd15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:13.575310 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a434858-a178-4f01-ba92-14d9f20e0c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:13.576133 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a434858-a178-4f01-ba92-14d9f20e0c59 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:13.577406 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a434858-a178-4f01-ba92-14d9f20e0c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:13.577755 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a434858-a178-4f01-ba92-14d9f20e0c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:13.578497 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a434858-a178-4f01-ba92-14d9f20e0c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:13.580157 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a434858-a178-4f01-ba92-14d9f20e0c59 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:13.597060 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1124/2219] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:13 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:13.603995 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a434858-a178-4f01-ba92-14d9f20e0c59 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:13.618210 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a434858-a178-4f01-ba92-14d9f20e0c59 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:13.618427 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71539966-0d07-4501-8d5d-8cc47519dd15 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:13.623006 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04072389-b1c5-460e-9dad-976da5b65987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:13.623884 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04072389-b1c5-460e-9dad-976da5b65987 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:13.624198 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04072389-b1c5-460e-9dad-976da5b65987 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:13.624492 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04072389-b1c5-460e-9dad-976da5b65987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:13.626298 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ac22b-3e26-4e0b-8d57-cbd6e5d9b2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:13.626989 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-04072389-b1c5-460e-9dad-976da5b65987 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:13.630858 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ac22b-3e26-4e0b-8d57-cbd6e5d9b2ef admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:13.631447 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ac22b-3e26-4e0b-8d57-cbd6e5d9b2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:13.631796 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ac22b-3e26-4e0b-8d57-cbd6e5d9b2ef admin admin] PATH_INFO: `/v3/projects/e01c981ab966498ab49600670730ada7/users/ecab6df1abf24e85961562af750ba88d/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:13.634330 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ac22b-3e26-4e0b-8d57-cbd6e5d9b2ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e01c981ab966498ab49600670730ada7, user_id=ecab6df1abf24e85961562af750ba88d, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:13.637625 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ac22b-3e26-4e0b-8d57-cbd6e5d9b2ef admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:13.651917 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1125/2220] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:13 2021] PUT /identity/v3/projects/e01c981ab966498ab49600670730ada7/users/ecab6df1abf24e85961562af750ba88d/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:35:13.663901 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb05702-31f3-46eb-93f0-118a35548a3d None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:13.664183 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb05702-31f3-46eb-93f0-118a35548a3d None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:13.664487 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb05702-31f3-46eb-93f0-118a35548a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:13.705699 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-9cb05702-31f3-46eb-93f0-118a35548a3d None None] MFA Rules not processed for user `ecab6df1abf24e85961562af750ba88d`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:13.706952 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-9cb05702-31f3-46eb-93f0-118a35548a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:13.726763 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04072389-b1c5-460e-9dad-976da5b65987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:13.728250 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04072389-b1c5-460e-9dad-976da5b65987 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:13.745009 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1096/2221] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:13 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:35:13.797380 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1126/2222] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:13 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:13.809094 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04072389-b1c5-460e-9dad-976da5b65987 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:13.875309 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04072389-b1c5-460e-9dad-976da5b65987 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:13.901315 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb05702-31f3-46eb-93f0-118a35548a3d None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:13.940591 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1dbf7-c69a-4e5f-b351-8f996064f544 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:13.941297 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1dbf7-c69a-4e5f-b351-8f996064f544 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:13.941582 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1dbf7-c69a-4e5f-b351-8f996064f544 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:13.941858 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1dbf7-c69a-4e5f-b351-8f996064f544 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:13.954429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1dbf7-c69a-4e5f-b351-8f996064f544 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:13.956015 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1dbf7-c69a-4e5f-b351-8f996064f544 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:13.969175 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1097/2223] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:13 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:13.982229 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb05702-31f3-46eb-93f0-118a35548a3d None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:13.988245 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b18515-4fc9-44be-81a9-a99c6d21303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:13.989169 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b18515-4fc9-44be-81a9-a99c6d21303d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:13.989453 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b18515-4fc9-44be-81a9-a99c6d21303d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:13.989727 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b18515-4fc9-44be-81a9-a99c6d21303d admin admin] PATH_INFO: `/v3/users/7813027404a14301a5210ef58e262357` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:13.990957 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b18515-4fc9-44be-81a9-a99c6d21303d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7813027404a14301a5210ef58e262357)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:13.993364 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b18515-4fc9-44be-81a9-a99c6d21303d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:14.057564 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1dbf7-c69a-4e5f-b351-8f996064f544 service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:14.058985 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-2bf1dbf7-c69a-4e5f-b351-8f996064f544 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:14.071099 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1dbf7-c69a-4e5f-b351-8f996064f544 service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:14.075310 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccaa20-f457-4be4-af8c-0155f49dc20f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:14.075958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccaa20-f457-4be4-af8c-0155f49dc20f service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:14.076242 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccaa20-f457-4be4-af8c-0155f49dc20f service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:14.076551 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccaa20-f457-4be4-af8c-0155f49dc20f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:14.144372 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ccaa20-f457-4be4-af8c-0155f49dc20f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:14.145842 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ccaa20-f457-4be4-af8c-0155f49dc20f service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:14.155876 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1098/2224] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:14 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:35:14.176226 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-01b18515-4fc9-44be-81a9-a99c6d21303d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7813027404a14301a5210ef58e262357'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:14.199531 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-01b18515-4fc9-44be-81a9-a99c6d21303d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7813027404a14301a5210ef58e262357'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:14.207945 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-01b18515-4fc9-44be-81a9-a99c6d21303d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7813027404a14301a5210ef58e262357'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:14.208980 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-01b18515-4fc9-44be-81a9-a99c6d21303d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7813027404a14301a5210ef58e262357'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:14.293433 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-01b18515-4fc9-44be-81a9-a99c6d21303d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7813027404a14301a5210ef58e262357'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:14.300978 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1127/2225] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:13 2021] DELETE /identity/v3/users/7813027404a14301a5210ef58e262357 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:35:14.305648 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d050858-6707-4196-a08a-3fa2e857b020 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:14.305958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d050858-6707-4196-a08a-3fa2e857b020 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:14.306248 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d050858-6707-4196-a08a-3fa2e857b020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:14.324327 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-8d050858-6707-4196-a08a-3fa2e857b020 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:14.325566 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8d050858-6707-4196-a08a-3fa2e857b020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:14.384721 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1099/2226] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:14.396024 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b18515-4fc9-44be-81a9-a99c6d21303d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:14.397469 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-01b18515-4fc9-44be-81a9-a99c6d21303d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:14.458119 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b18515-4fc9-44be-81a9-a99c6d21303d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:14.461880 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80933075-9574-4bd6-9c5f-dfb56114dcc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:14.462524 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80933075-9574-4bd6-9c5f-dfb56114dcc4 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:14.462805 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80933075-9574-4bd6-9c5f-dfb56114dcc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:14.463079 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80933075-9574-4bd6-9c5f-dfb56114dcc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:14.471831 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80933075-9574-4bd6-9c5f-dfb56114dcc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:14.473311 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80933075-9574-4bd6-9c5f-dfb56114dcc4 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:14.483258 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1128/2227] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:35:14.947429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d050858-6707-4196-a08a-3fa2e857b020 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:14.958330 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d050858-6707-4196-a08a-3fa2e857b020 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:14.965266 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80933075-9574-4bd6-9c5f-dfb56114dcc4 service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:14.969777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d53c9-cce2-4cf8-8846-03af02ed253d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:14.969777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d53c9-cce2-4cf8-8846-03af02ed253d service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:14.969777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d53c9-cce2-4cf8-8846-03af02ed253d service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:14.969777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d53c9-cce2-4cf8-8846-03af02ed253d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:14.970199 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-80933075-9574-4bd6-9c5f-dfb56114dcc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:14.970292 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b94d53c9-cce2-4cf8-8846-03af02ed253d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:14.985136 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80933075-9574-4bd6-9c5f-dfb56114dcc4 service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:14.992979 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f50390-9d4b-4ba7-bd25-17424d312ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:14.999101 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f50390-9d4b-4ba7-bd25-17424d312ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:14.999101 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f50390-9d4b-4ba7-bd25-17424d312ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:14.999101 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f50390-9d4b-4ba7-bd25-17424d312ab5 admin admin] PATH_INFO: `/v3/projects/e0fb466cf1cf48679410851466601fe8` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:14.999101 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f50390-9d4b-4ba7-bd25-17424d312ab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0fb466cf1cf48679410851466601fe8)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:14.999101 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f50390-9d4b-4ba7-bd25-17424d312ab5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:15.078698 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d53c9-cce2-4cf8-8846-03af02ed253d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:15.080253 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d53c9-cce2-4cf8-8846-03af02ed253d service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:15.090929 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1100/2228] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:14 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:15.128341 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-91f50390-9d4b-4ba7-bd25-17424d312ab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0fb466cf1cf48679410851466601fe8', 'request_id': 'req-91f50390-9d4b-4ba7-bd25-17424d312ab5'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:15.134599 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-91f50390-9d4b-4ba7-bd25-17424d312ab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0fb466cf1cf48679410851466601fe8', 'request_id': 'req-91f50390-9d4b-4ba7-bd25-17424d312ab5'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:15.242498 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-91f50390-9d4b-4ba7-bd25-17424d312ab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0fb466cf1cf48679410851466601fe8', 'request_id': 'req-91f50390-9d4b-4ba7-bd25-17424d312ab5'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:15.253876 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-91f50390-9d4b-4ba7-bd25-17424d312ab5 admin admin] The token cache is being invalidate because project e0fb466cf1cf48679410851466601fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:15.254162 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-91f50390-9d4b-4ba7-bd25-17424d312ab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:15.254804 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-91f50390-9d4b-4ba7-bd25-17424d312ab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:15.256328 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1129/2229] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:14 2021] DELETE /identity/v3/projects/e0fb466cf1cf48679410851466601fe8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:35:15.260229 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d53c9-cce2-4cf8-8846-03af02ed253d service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:15.270466 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d53c9-cce2-4cf8-8846-03af02ed253d service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:15.326889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af86d3d-42b1-4009-9dc1-56dae772361b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:15.327753 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af86d3d-42b1-4009-9dc1-56dae772361b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:15.328034 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af86d3d-42b1-4009-9dc1-56dae772361b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:15.328304 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af86d3d-42b1-4009-9dc1-56dae772361b admin admin] PATH_INFO: `/v3/users/04454cd21cd44498aa17180cc39d5cb5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:15.329527 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af86d3d-42b1-4009-9dc1-56dae772361b admin admin] RBAC: Authorizing `identity:delete_user(user_id=04454cd21cd44498aa17180cc39d5cb5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:15.331457 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af86d3d-42b1-4009-9dc1-56dae772361b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:15.616720 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3af86d3d-42b1-4009-9dc1-56dae772361b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04454cd21cd44498aa17180cc39d5cb5'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:15.617520 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3af86d3d-42b1-4009-9dc1-56dae772361b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04454cd21cd44498aa17180cc39d5cb5'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:15.625103 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3af86d3d-42b1-4009-9dc1-56dae772361b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04454cd21cd44498aa17180cc39d5cb5'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:15.625749 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3af86d3d-42b1-4009-9dc1-56dae772361b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04454cd21cd44498aa17180cc39d5cb5'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:15.705068 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3af86d3d-42b1-4009-9dc1-56dae772361b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04454cd21cd44498aa17180cc39d5cb5'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:15.722437 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1101/2230] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:15 2021] DELETE /identity/v3/users/04454cd21cd44498aa17180cc39d5cb5 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:16.187900 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f50390-9d4b-4ba7-bd25-17424d312ab5 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:16.190109 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-91f50390-9d4b-4ba7-bd25-17424d312ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:16.207662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f50390-9d4b-4ba7-bd25-17424d312ab5 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:16.289367 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f10197-1096-4e4f-8669-71b9dcdc2083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:16.290411 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f10197-1096-4e4f-8669-71b9dcdc2083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:16.290925 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f10197-1096-4e4f-8669-71b9dcdc2083 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:16.291202 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f10197-1096-4e4f-8669-71b9dcdc2083 admin admin] PATH_INFO: `/v3/projects/7fc62dd77d2b493d89ecc4cb2efa1c22` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:16.292494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f10197-1096-4e4f-8669-71b9dcdc2083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fc62dd77d2b493d89ecc4cb2efa1c22)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:16.294508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f10197-1096-4e4f-8669-71b9dcdc2083 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:16.456413 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f3f10197-1096-4e4f-8669-71b9dcdc2083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fc62dd77d2b493d89ecc4cb2efa1c22', 'request_id': 'req-f3f10197-1096-4e4f-8669-71b9dcdc2083'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:16.474306 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f3f10197-1096-4e4f-8669-71b9dcdc2083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fc62dd77d2b493d89ecc4cb2efa1c22', 'request_id': 'req-f3f10197-1096-4e4f-8669-71b9dcdc2083'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:16.557129 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f3f10197-1096-4e4f-8669-71b9dcdc2083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fc62dd77d2b493d89ecc4cb2efa1c22', 'request_id': 'req-f3f10197-1096-4e4f-8669-71b9dcdc2083'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:16.573662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f3f10197-1096-4e4f-8669-71b9dcdc2083 admin admin] The token cache is being invalidate because project 7fc62dd77d2b493d89ecc4cb2efa1c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:16.577414 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f3f10197-1096-4e4f-8669-71b9dcdc2083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:16.579152 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f3f10197-1096-4e4f-8669-71b9dcdc2083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:16.588115 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1130/2231] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:16 2021] DELETE /identity/v3/projects/7fc62dd77d2b493d89ecc4cb2efa1c22 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:16.589777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3080299-d383-41f5-a6cb-53a5462a730d None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:16.590225 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3080299-d383-41f5-a6cb-53a5462a730d None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:16.590334 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3080299-d383-41f5-a6cb-53a5462a730d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:16.613731 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b3080299-d383-41f5-a6cb-53a5462a730d None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:16.615028 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b3080299-d383-41f5-a6cb-53a5462a730d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:16.683255 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1102/2232] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:16.691790 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13a9df-97d9-4980-bc92-5be226243307 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:16.692101 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13a9df-97d9-4980-bc92-5be226243307 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:16.692383 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13a9df-97d9-4980-bc92-5be226243307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:16.713791 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-5c13a9df-97d9-4980-bc92-5be226243307 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:16.715040 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-5c13a9df-97d9-4980-bc92-5be226243307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:16.724084 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1131/2233] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:16.728119 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3080299-d383-41f5-a6cb-53a5462a730d None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:16.737992 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3080299-d383-41f5-a6cb-53a5462a730d None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:16.742611 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c74f9-20e8-4950-b3e0-29add2eaf0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:16.743337 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c74f9-20e8-4950-b3e0-29add2eaf0bd admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:16.743707 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c74f9-20e8-4950-b3e0-29add2eaf0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:16.744098 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c74f9-20e8-4950-b3e0-29add2eaf0bd admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:16.745054 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c74f9-20e8-4950-b3e0-29add2eaf0bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:35:16.745528 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c74f9-20e8-4950-b3e0-29add2eaf0bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:16.747138 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c74f9-20e8-4950-b3e0-29add2eaf0bd admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:16.764617 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1103/2234] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:35:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:35:16.770740 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13a9df-97d9-4980-bc92-5be226243307 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:16.794386 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13a9df-97d9-4980-bc92-5be226243307 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:16.801974 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6ca27-a45f-4046-a03c-1c0c0555c396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:16.803376 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6ca27-a45f-4046-a03c-1c0c0555c396 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:16.803822 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6ca27-a45f-4046-a03c-1c0c0555c396 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:16.804255 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6ca27-a45f-4046-a03c-1c0c0555c396 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:16.805404 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6ca27-a45f-4046-a03c-1c0c0555c396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:16.808064 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6ca27-a45f-4046-a03c-1c0c0555c396 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:16.905120 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1132/2235] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:16 2021] POST /identity/v3/projects => generated 363 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:16.909287 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c74f9-20e8-4950-b3e0-29add2eaf0bd admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:16.920581 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c74f9-20e8-4950-b3e0-29add2eaf0bd admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:16.986997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4170b-6232-4dc9-854f-a2c20782bda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:16.988621 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4170b-6232-4dc9-854f-a2c20782bda9 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:16.989104 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4170b-6232-4dc9-854f-a2c20782bda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:16.990285 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4170b-6232-4dc9-854f-a2c20782bda9 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:16.991457 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4170b-6232-4dc9-854f-a2c20782bda9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:17.000971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4170b-6232-4dc9-854f-a2c20782bda9 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:17.102991 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1104/2236] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:35:16 2021] POST /identity/v3/users => generated 282 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:35:17.120207 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6ca27-a45f-4046-a03c-1c0c0555c396 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:17.120207 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6ca27-a45f-4046-a03c-1c0c0555c396 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:17.124606 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadb609-0615-492f-bf80-ae07f1c2abdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:17.125357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadb609-0615-492f-bf80-ae07f1c2abdc admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:17.125638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadb609-0615-492f-bf80-ae07f1c2abdc admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:17.125912 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadb609-0615-492f-bf80-ae07f1c2abdc admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:17.126734 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadb609-0615-492f-bf80-ae07f1c2abdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:17.128660 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadb609-0615-492f-bf80-ae07f1c2abdc admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:17.143068 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1133/2237] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:17 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:35:17.148567 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4170b-6232-4dc9-854f-a2c20782bda9 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:17.155144 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4170b-6232-4dc9-854f-a2c20782bda9 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:17.160938 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcae1e0-c25a-42f1-833f-34ad67d711fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:17.161727 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcae1e0-c25a-42f1-833f-34ad67d711fe admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:17.162069 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcae1e0-c25a-42f1-833f-34ad67d711fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:17.162414 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcae1e0-c25a-42f1-833f-34ad67d711fe admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:17.163205 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcae1e0-c25a-42f1-833f-34ad67d711fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:17.164871 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcae1e0-c25a-42f1-833f-34ad67d711fe admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:17.182291 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1105/2238] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:17 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:35:17.184023 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadb609-0615-492f-bf80-ae07f1c2abdc admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:17.217684 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadb609-0615-492f-bf80-ae07f1c2abdc admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:17.226503 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b49850-6abf-464a-ad90-096258d78945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:17.227404 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b49850-6abf-464a-ad90-096258d78945 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:17.227812 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b49850-6abf-464a-ad90-096258d78945 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:17.228376 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b49850-6abf-464a-ad90-096258d78945 admin admin] PATH_INFO: `/v3/projects/5aec1ac6f24943f499aeccadd63dd0b0/users/028570a9a8794c558385ee51033d2a95/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:17.252430 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b49850-6abf-464a-ad90-096258d78945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aec1ac6f24943f499aeccadd63dd0b0, user_id=028570a9a8794c558385ee51033d2a95, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:17.255178 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b49850-6abf-464a-ad90-096258d78945 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:17.363137 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1134/2239] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:17 2021] PUT /identity/v3/projects/5aec1ac6f24943f499aeccadd63dd0b0/users/028570a9a8794c558385ee51033d2a95/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:17.373143 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f023c-229f-4773-a8e6-c0bf390dfdaa None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:17.373463 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f023c-229f-4773-a8e6-c0bf390dfdaa None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:17.373926 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f023c-229f-4773-a8e6-c0bf390dfdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:17.407151 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-c24f023c-229f-4773-a8e6-c0bf390dfdaa None None] MFA Rules not processed for user `028570a9a8794c558385ee51033d2a95`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:17.408371 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-c24f023c-229f-4773-a8e6-c0bf390dfdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:17.517066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1106/2240] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:17 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:17.519341 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b49850-6abf-464a-ad90-096258d78945 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:17.588483 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b49850-6abf-464a-ad90-096258d78945 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:17.593749 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b930625-f21c-4621-a758-5acfcfddc39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:17.594424 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b930625-f21c-4621-a758-5acfcfddc39a admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:17.594707 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b930625-f21c-4621-a758-5acfcfddc39a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:17.594980 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b930625-f21c-4621-a758-5acfcfddc39a admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:17.595671 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b930625-f21c-4621-a758-5acfcfddc39a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:17.597593 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b930625-f21c-4621-a758-5acfcfddc39a admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:17.689902 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1135/2241] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:17 2021] POST /identity/v3/projects => generated 365 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:17.694067 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f023c-229f-4773-a8e6-c0bf390dfdaa None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:17.706849 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f023c-229f-4773-a8e6-c0bf390dfdaa None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:17.767826 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcde22-d842-4bd5-9520-3a3a49bc58df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:17.768455 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcde22-d842-4bd5-9520-3a3a49bc58df admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:17.768741 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcde22-d842-4bd5-9520-3a3a49bc58df admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:17.773511 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcde22-d842-4bd5-9520-3a3a49bc58df admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:17.774407 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcde22-d842-4bd5-9520-3a3a49bc58df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:17.776584 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcde22-d842-4bd5-9520-3a3a49bc58df admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:17.883275 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1107/2242] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:35:17 2021] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:17.887160 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b930625-f21c-4621-a758-5acfcfddc39a admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:17.898524 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b930625-f21c-4621-a758-5acfcfddc39a admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:17.903072 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85dd33-3ef7-42f9-a5f4-43602bce52ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:17.903842 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85dd33-3ef7-42f9-a5f4-43602bce52ec admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:17.904123 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85dd33-3ef7-42f9-a5f4-43602bce52ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:17.908561 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85dd33-3ef7-42f9-a5f4-43602bce52ec admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:17.908561 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85dd33-3ef7-42f9-a5f4-43602bce52ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:17.908561 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85dd33-3ef7-42f9-a5f4-43602bce52ec admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:17.917893 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1136/2243] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:17 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:17.922471 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcde22-d842-4bd5-9520-3a3a49bc58df admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:17.933172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcde22-d842-4bd5-9520-3a3a49bc58df admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:17.939196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2e33a-fc28-497e-9193-9806e327ad7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:17.940186 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2e33a-fc28-497e-9193-9806e327ad7e admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:17.940541 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2e33a-fc28-497e-9193-9806e327ad7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:17.940919 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2e33a-fc28-497e-9193-9806e327ad7e admin admin] PATH_INFO: `/v3/projects/c7ac2a7275314eb5b4a61f66b563ab1f/users/208415a690eb4850a164289946f26c25/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:17.958337 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2e33a-fc28-497e-9193-9806e327ad7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ac2a7275314eb5b4a61f66b563ab1f, user_id=208415a690eb4850a164289946f26c25, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:17.961113 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2e33a-fc28-497e-9193-9806e327ad7e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:18.039384 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1108/2244] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:17 2021] PUT /identity/v3/projects/c7ac2a7275314eb5b4a61f66b563ab1f/users/208415a690eb4850a164289946f26c25/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:18.043172 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85dd33-3ef7-42f9-a5f4-43602bce52ec admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:18.054346 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85dd33-3ef7-42f9-a5f4-43602bce52ec admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:18.110986 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67fc45-fe83-4389-b4fd-5e121eb68f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:18.111984 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67fc45-fe83-4389-b4fd-5e121eb68f17 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:18.112394 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67fc45-fe83-4389-b4fd-5e121eb68f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:18.112772 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67fc45-fe83-4389-b4fd-5e121eb68f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:18.113643 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67fc45-fe83-4389-b4fd-5e121eb68f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:18.115385 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67fc45-fe83-4389-b4fd-5e121eb68f17 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:18.126558 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1137/2245] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:18 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:18.130684 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2e33a-fc28-497e-9193-9806e327ad7e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:18.142851 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2e33a-fc28-497e-9193-9806e327ad7e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:18.147482 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3df25d-623c-4529-8073-bacd65945f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:18.148407 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3df25d-623c-4529-8073-bacd65945f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:18.148688 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3df25d-623c-4529-8073-bacd65945f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:18.149029 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3df25d-623c-4529-8073-bacd65945f30 admin admin] PATH_INFO: `/v3/projects/c7ac2a7275314eb5b4a61f66b563ab1f/users/208415a690eb4850a164289946f26c25/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:18.151001 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3df25d-623c-4529-8073-bacd65945f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ac2a7275314eb5b4a61f66b563ab1f, user_id=208415a690eb4850a164289946f26c25, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:18.153662 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3df25d-623c-4529-8073-bacd65945f30 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:18.164676 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1109/2246] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:18 2021] PUT /identity/v3/projects/c7ac2a7275314eb5b4a61f66b563ab1f/users/208415a690eb4850a164289946f26c25/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:18.175738 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0179da9-9788-4346-8c1a-c9f97854cfbd None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:18.176027 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0179da9-9788-4346-8c1a-c9f97854cfbd None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:18.176304 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0179da9-9788-4346-8c1a-c9f97854cfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:18.202553 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f0179da9-9788-4346-8c1a-c9f97854cfbd None None] MFA Rules not processed for user `208415a690eb4850a164289946f26c25`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:18.203747 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f0179da9-9788-4346-8c1a-c9f97854cfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:18.269426 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1138/2247] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:18 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:18.279954 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3df25d-623c-4529-8073-bacd65945f30 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:18.281648 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-fe3df25d-623c-4529-8073-bacd65945f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:18.337077 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3df25d-623c-4529-8073-bacd65945f30 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:18.340889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa09453-bb9f-4fbc-b84c-e0ce51daa324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:18.341529 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa09453-bb9f-4fbc-b84c-e0ce51daa324 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:18.341809 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa09453-bb9f-4fbc-b84c-e0ce51daa324 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:18.342721 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa09453-bb9f-4fbc-b84c-e0ce51daa324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:18.351868 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa09453-bb9f-4fbc-b84c-e0ce51daa324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:18.353329 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa09453-bb9f-4fbc-b84c-e0ce51daa324 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:18.363792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1110/2248] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:18 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:18.565500 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0179da9-9788-4346-8c1a-c9f97854cfbd None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:18.574897 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0179da9-9788-4346-8c1a-c9f97854cfbd None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:18.579191 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964f022-04e5-4527-a7b3-54df18e72f6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:18.583560 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964f022-04e5-4527-a7b3-54df18e72f6d service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:18.583560 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964f022-04e5-4527-a7b3-54df18e72f6d service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:18.583560 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964f022-04e5-4527-a7b3-54df18e72f6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:18.636800 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964f022-04e5-4527-a7b3-54df18e72f6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:18.638268 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964f022-04e5-4527-a7b3-54df18e72f6d service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:18.649382 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1139/2249] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:18 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:19.429987 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa09453-bb9f-4fbc-b84c-e0ce51daa324 service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:19.431576 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ffa09453-bb9f-4fbc-b84c-e0ce51daa324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:19.496821 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa09453-bb9f-4fbc-b84c-e0ce51daa324 service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:19.502156 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce985d58-93f5-401a-85cb-9030ecd4af51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:19.503009 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce985d58-93f5-401a-85cb-9030ecd4af51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:19.503310 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce985d58-93f5-401a-85cb-9030ecd4af51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:19.503586 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce985d58-93f5-401a-85cb-9030ecd4af51 admin admin] PATH_INFO: `/v3/users/5dd8c7ea39e145b39a820fdc2876c0e5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:19.504762 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce985d58-93f5-401a-85cb-9030ecd4af51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dd8c7ea39e145b39a820fdc2876c0e5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:19.506694 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce985d58-93f5-401a-85cb-9030ecd4af51 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:19.678817 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ce985d58-93f5-401a-85cb-9030ecd4af51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dd8c7ea39e145b39a820fdc2876c0e5'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:19.679385 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ce985d58-93f5-401a-85cb-9030ecd4af51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dd8c7ea39e145b39a820fdc2876c0e5'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:19.686697 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ce985d58-93f5-401a-85cb-9030ecd4af51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dd8c7ea39e145b39a820fdc2876c0e5'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:19.687312 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ce985d58-93f5-401a-85cb-9030ecd4af51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dd8c7ea39e145b39a820fdc2876c0e5'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:19.751647 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ce985d58-93f5-401a-85cb-9030ecd4af51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dd8c7ea39e145b39a820fdc2876c0e5'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:19.773505 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1111/2250] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:19 2021] DELETE /identity/v3/users/5dd8c7ea39e145b39a820fdc2876c0e5 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:19.778132 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70f041-7996-462a-b361-a4b29e722f08 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:19.778662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70f041-7996-462a-b361-a4b29e722f08 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:19.778662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70f041-7996-462a-b361-a4b29e722f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:19.797316 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-4f70f041-7996-462a-b361-a4b29e722f08 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:19.798512 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-4f70f041-7996-462a-b361-a4b29e722f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:19.867779 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1140/2251] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:19.878313 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce985d58-93f5-401a-85cb-9030ecd4af51 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:19.879720 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ce985d58-93f5-401a-85cb-9030ecd4af51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:19.935237 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce985d58-93f5-401a-85cb-9030ecd4af51 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:19.938909 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe8326-0c11-4556-bf08-4458289c1908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:19.939596 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe8326-0c11-4556-bf08-4458289c1908 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:19.939892 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe8326-0c11-4556-bf08-4458289c1908 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:19.940169 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe8326-0c11-4556-bf08-4458289c1908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:19.948936 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe8326-0c11-4556-bf08-4458289c1908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:19.950840 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe8326-0c11-4556-bf08-4458289c1908 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:19.960608 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1112/2252] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:20.450458 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70f041-7996-462a-b361-a4b29e722f08 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:20.451058 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-4f70f041-7996-462a-b361-a4b29e722f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:20.466693 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70f041-7996-462a-b361-a4b29e722f08 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:20.472002 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300fd81-7c11-42ef-a6fe-85ef225f92a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:20.472947 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300fd81-7c11-42ef-a6fe-85ef225f92a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:20.480404 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300fd81-7c11-42ef-a6fe-85ef225f92a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:20.480812 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300fd81-7c11-42ef-a6fe-85ef225f92a8 admin admin] PATH_INFO: `/v3/projects/9438f3d285374de99810fc04fb296826` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:20.482179 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300fd81-7c11-42ef-a6fe-85ef225f92a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9438f3d285374de99810fc04fb296826)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:20.484696 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300fd81-7c11-42ef-a6fe-85ef225f92a8 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:20.610427 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-6300fd81-7c11-42ef-a6fe-85ef225f92a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9438f3d285374de99810fc04fb296826', 'request_id': 'req-6300fd81-7c11-42ef-a6fe-85ef225f92a8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:20.616405 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-6300fd81-7c11-42ef-a6fe-85ef225f92a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9438f3d285374de99810fc04fb296826', 'request_id': 'req-6300fd81-7c11-42ef-a6fe-85ef225f92a8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:20.699075 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-6300fd81-7c11-42ef-a6fe-85ef225f92a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9438f3d285374de99810fc04fb296826', 'request_id': 'req-6300fd81-7c11-42ef-a6fe-85ef225f92a8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:20.713576 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-6300fd81-7c11-42ef-a6fe-85ef225f92a8 admin admin] The token cache is being invalidate because project 9438f3d285374de99810fc04fb296826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:20.714097 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-6300fd81-7c11-42ef-a6fe-85ef225f92a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:20.714987 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-6300fd81-7c11-42ef-a6fe-85ef225f92a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:20.719690 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1141/2253] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:20 2021] DELETE /identity/v3/projects/9438f3d285374de99810fc04fb296826 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:20.723268 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe8326-0c11-4556-bf08-4458289c1908 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:20.734441 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe8326-0c11-4556-bf08-4458289c1908 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:20.791376 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7357a6a-31cd-4f6d-83ad-3ae30c0e0c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:20.792251 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7357a6a-31cd-4f6d-83ad-3ae30c0e0c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:20.792529 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7357a6a-31cd-4f6d-83ad-3ae30c0e0c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:20.792801 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7357a6a-31cd-4f6d-83ad-3ae30c0e0c89 admin admin] PATH_INFO: `/v3/users/ecab6df1abf24e85961562af750ba88d` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:20.797122 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7357a6a-31cd-4f6d-83ad-3ae30c0e0c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecab6df1abf24e85961562af750ba88d)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:20.797122 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7357a6a-31cd-4f6d-83ad-3ae30c0e0c89 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:20.815619 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300fd81-7c11-42ef-a6fe-85ef225f92a8 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:20.818016 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-6300fd81-7c11-42ef-a6fe-85ef225f92a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:20.878889 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300fd81-7c11-42ef-a6fe-85ef225f92a8 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:20.882711 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f0d00-81d8-4c40-bfd3-09096e0f4262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:20.883360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f0d00-81d8-4c40-bfd3-09096e0f4262 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:20.883642 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f0d00-81d8-4c40-bfd3-09096e0f4262 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:20.883923 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f0d00-81d8-4c40-bfd3-09096e0f4262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:20.885715 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-714f0d00-81d8-4c40-bfd3-09096e0f4262 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:20.945958 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f0d00-81d8-4c40-bfd3-09096e0f4262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:20.947381 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f0d00-81d8-4c40-bfd3-09096e0f4262 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:20.957434 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1142/2254] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:20 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:21.010638 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-a7357a6a-31cd-4f6d-83ad-3ae30c0e0c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecab6df1abf24e85961562af750ba88d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:21.011278 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-a7357a6a-31cd-4f6d-83ad-3ae30c0e0c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecab6df1abf24e85961562af750ba88d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:21.018676 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-a7357a6a-31cd-4f6d-83ad-3ae30c0e0c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecab6df1abf24e85961562af750ba88d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:21.019310 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-a7357a6a-31cd-4f6d-83ad-3ae30c0e0c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecab6df1abf24e85961562af750ba88d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:21.105070 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-a7357a6a-31cd-4f6d-83ad-3ae30c0e0c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecab6df1abf24e85961562af750ba88d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:21.127579 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1113/2255] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:20 2021] DELETE /identity/v3/users/ecab6df1abf24e85961562af750ba88d => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:35:21.635948 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f0d00-81d8-4c40-bfd3-09096e0f4262 service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:21.637396 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-714f0d00-81d8-4c40-bfd3-09096e0f4262 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:21.651369 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f0d00-81d8-4c40-bfd3-09096e0f4262 service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:21.711051 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf52fd-3938-459d-b3be-3ee97ac1bb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:21.711911 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf52fd-3938-459d-b3be-3ee97ac1bb61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:21.712217 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf52fd-3938-459d-b3be-3ee97ac1bb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:21.712490 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf52fd-3938-459d-b3be-3ee97ac1bb61 admin admin] PATH_INFO: `/v3/projects/e01c981ab966498ab49600670730ada7` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:21.713777 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf52fd-3938-459d-b3be-3ee97ac1bb61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e01c981ab966498ab49600670730ada7)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:21.715848 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf52fd-3938-459d-b3be-3ee97ac1bb61 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:21.819256 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-87bf52fd-3938-459d-b3be-3ee97ac1bb61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e01c981ab966498ab49600670730ada7', 'request_id': 'req-87bf52fd-3938-459d-b3be-3ee97ac1bb61'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:21.828600 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-87bf52fd-3938-459d-b3be-3ee97ac1bb61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e01c981ab966498ab49600670730ada7', 'request_id': 'req-87bf52fd-3938-459d-b3be-3ee97ac1bb61'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:21.956766 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-87bf52fd-3938-459d-b3be-3ee97ac1bb61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e01c981ab966498ab49600670730ada7', 'request_id': 'req-87bf52fd-3938-459d-b3be-3ee97ac1bb61'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:21.970029 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-87bf52fd-3938-459d-b3be-3ee97ac1bb61 admin admin] The token cache is being invalidate because project e01c981ab966498ab49600670730ada7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:21.970323 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-87bf52fd-3938-459d-b3be-3ee97ac1bb61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:21.970984 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-87bf52fd-3938-459d-b3be-3ee97ac1bb61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:21.972610 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1143/2256] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:21 2021] DELETE /identity/v3/projects/e01c981ab966498ab49600670730ada7 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:21.978345 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a186843-5175-4efa-bb4c-e6bd6c518baa None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:21.978840 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a186843-5175-4efa-bb4c-e6bd6c518baa None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:21.978958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a186843-5175-4efa-bb4c-e6bd6c518baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:21.996148 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-6a186843-5175-4efa-bb4c-e6bd6c518baa None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:21.997382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-6a186843-5175-4efa-bb4c-e6bd6c518baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:22.057594 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1114/2257] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:22.066816 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e08b42-8c6c-4be1-ace1-aaaef116eca9 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:22.067106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e08b42-8c6c-4be1-ace1-aaaef116eca9 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:22.067387 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e08b42-8c6c-4be1-ace1-aaaef116eca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:22.087366 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-a0e08b42-8c6c-4be1-ace1-aaaef116eca9 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:22.088603 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a0e08b42-8c6c-4be1-ace1-aaaef116eca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:22.101218 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1144/2258] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:22.105730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a186843-5175-4efa-bb4c-e6bd6c518baa None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:22.117277 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a186843-5175-4efa-bb4c-e6bd6c518baa None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:22.121974 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1080f4c-67a8-4d79-8faf-27831864efb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:22.122637 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1080f4c-67a8-4d79-8faf-27831864efb1 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:22.122924 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1080f4c-67a8-4d79-8faf-27831864efb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:22.123736 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1080f4c-67a8-4d79-8faf-27831864efb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:22.125048 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1080f4c-67a8-4d79-8faf-27831864efb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:35:22.125362 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1080f4c-67a8-4d79-8faf-27831864efb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:22.126962 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1080f4c-67a8-4d79-8faf-27831864efb1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:22.138715 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1115/2259] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:35:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:35:22.144350 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e08b42-8c6c-4be1-ace1-aaaef116eca9 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:22.153849 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e08b42-8c6c-4be1-ace1-aaaef116eca9 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:22.159827 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7a650-f48d-4e3d-bccd-de30889fca76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:22.161591 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7a650-f48d-4e3d-bccd-de30889fca76 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:22.161591 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7a650-f48d-4e3d-bccd-de30889fca76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:22.161591 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7a650-f48d-4e3d-bccd-de30889fca76 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:22.162061 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7a650-f48d-4e3d-bccd-de30889fca76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:22.163567 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7a650-f48d-4e3d-bccd-de30889fca76 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:22.264974 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b04e6-7a3d-4a93-8238-bbec8604476a None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:22.265380 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b04e6-7a3d-4a93-8238-bbec8604476a None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:22.265659 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b04e6-7a3d-4a93-8238-bbec8604476a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:22.283005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-944b04e6-7a3d-4a93-8238-bbec8604476a None None] MFA Rules not processed for user `9032bdd7ffde4d3f9b500974a4c17c67`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:22.284211 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-944b04e6-7a3d-4a93-8238-bbec8604476a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:22.293107 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1145/2260] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:22 2021] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:22.294059 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7a650-f48d-4e3d-bccd-de30889fca76 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:22.346822 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1116/2261] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:22 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:22.359959 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7a650-f48d-4e3d-bccd-de30889fca76 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:22.364769 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536fbfd-fb91-4363-a639-4225b16ca543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:22.365541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536fbfd-fb91-4363-a639-4225b16ca543 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:22.365930 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536fbfd-fb91-4363-a639-4225b16ca543 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:22.366307 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536fbfd-fb91-4363-a639-4225b16ca543 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:22.367065 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536fbfd-fb91-4363-a639-4225b16ca543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:22.369083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536fbfd-fb91-4363-a639-4225b16ca543 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:22.438900 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1146/2262] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:35:22 2021] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:22.443237 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b04e6-7a3d-4a93-8238-bbec8604476a None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:22.455588 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b04e6-7a3d-4a93-8238-bbec8604476a None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:22.460754 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699dfc8-0932-4712-9270-6d041835de4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:22.461821 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699dfc8-0932-4712-9270-6d041835de4d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:22.462308 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699dfc8-0932-4712-9270-6d041835de4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:22.462782 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699dfc8-0932-4712-9270-6d041835de4d admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:22.464015 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699dfc8-0932-4712-9270-6d041835de4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:22.466774 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699dfc8-0932-4712-9270-6d041835de4d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:22.479564 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1117/2263] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:22 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:22.483849 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536fbfd-fb91-4363-a639-4225b16ca543 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:22.494748 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536fbfd-fb91-4363-a639-4225b16ca543 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:22.500362 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59602e6-64f3-4d4a-9fb8-e5093f8e4d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:22.501034 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59602e6-64f3-4d4a-9fb8-e5093f8e4d6b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:22.501315 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59602e6-64f3-4d4a-9fb8-e5093f8e4d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:22.501590 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59602e6-64f3-4d4a-9fb8-e5093f8e4d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:22.502317 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59602e6-64f3-4d4a-9fb8-e5093f8e4d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:22.503926 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59602e6-64f3-4d4a-9fb8-e5093f8e4d6b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:22.514924 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1147/2264] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:22 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:22.519128 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699dfc8-0932-4712-9270-6d041835de4d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:22.529803 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699dfc8-0932-4712-9270-6d041835de4d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:22.534794 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113ca36-d2f7-4f0e-98bf-4c9f4cee0c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:22.535700 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113ca36-d2f7-4f0e-98bf-4c9f4cee0c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:22.535979 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113ca36-d2f7-4f0e-98bf-4c9f4cee0c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:22.536250 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113ca36-d2f7-4f0e-98bf-4c9f4cee0c24 admin admin] PATH_INFO: `/v3/projects/d29f27ca7dae465dac846ed32abf96a3/users/cf610a27efb4496b8491e26d9a10f386/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:22.552301 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113ca36-d2f7-4f0e-98bf-4c9f4cee0c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29f27ca7dae465dac846ed32abf96a3, user_id=cf610a27efb4496b8491e26d9a10f386, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:22.555013 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113ca36-d2f7-4f0e-98bf-4c9f4cee0c24 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:22.636866 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1118/2265] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:22 2021] PUT /identity/v3/projects/d29f27ca7dae465dac846ed32abf96a3/users/cf610a27efb4496b8491e26d9a10f386/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:22.647516 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8ef64-22b3-4f91-b58a-8cd58f8fa1b5 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:22.647805 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8ef64-22b3-4f91-b58a-8cd58f8fa1b5 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:22.648088 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8ef64-22b3-4f91-b58a-8cd58f8fa1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:22.668853 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113ca36-d2f7-4f0e-98bf-4c9f4cee0c24 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:22.671359 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e113ca36-d2f7-4f0e-98bf-4c9f4cee0c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:22.679871 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-13c8ef64-22b3-4f91-b58a-8cd58f8fa1b5 None None] MFA Rules not processed for user `cf610a27efb4496b8491e26d9a10f386`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:22.681182 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-13c8ef64-22b3-4f91-b58a-8cd58f8fa1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:22.729528 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113ca36-d2f7-4f0e-98bf-4c9f4cee0c24 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:22.733862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1091d-ea6c-468d-a38f-a1c1e56c423c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:22.734549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1091d-ea6c-468d-a38f-a1c1e56c423c service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:22.734777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1091d-ea6c-468d-a38f-a1c1e56c423c service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:22.735824 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1091d-ea6c-468d-a38f-a1c1e56c423c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:22.737027 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1ed1091d-ea6c-468d-a38f-a1c1e56c423c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:22.746786 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1091d-ea6c-468d-a38f-a1c1e56c423c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:22.748250 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1148/2266] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:22 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:22.748948 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1091d-ea6c-468d-a38f-a1c1e56c423c service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:22.753396 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8ef64-22b3-4f91-b58a-8cd58f8fa1b5 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:22.757935 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1119/2267] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:22 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:35:22.790206 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1091d-ea6c-468d-a38f-a1c1e56c423c service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:22.792050 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1ed1091d-ea6c-468d-a38f-a1c1e56c423c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:22.818191 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8ef64-22b3-4f91-b58a-8cd58f8fa1b5 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:22.823322 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5a70a-b63e-48bb-a33a-205bf746d3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:22.824128 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5a70a-b63e-48bb-a33a-205bf746d3da admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:22.824414 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5a70a-b63e-48bb-a33a-205bf746d3da admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:22.824685 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5a70a-b63e-48bb-a33a-205bf746d3da admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:22.825407 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5a70a-b63e-48bb-a33a-205bf746d3da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:22.827860 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5a70a-b63e-48bb-a33a-205bf746d3da admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:22.866488 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1091d-ea6c-468d-a38f-a1c1e56c423c service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:22.871783 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72643e6-6f54-4bab-97f6-24992df9c311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:22.872438 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72643e6-6f54-4bab-97f6-24992df9c311 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:22.872721 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72643e6-6f54-4bab-97f6-24992df9c311 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:22.873046 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72643e6-6f54-4bab-97f6-24992df9c311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:22.875491 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a72643e6-6f54-4bab-97f6-24992df9c311 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:22.937569 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1149/2268] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:22 2021] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:35:22.938806 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5a70a-b63e-48bb-a33a-205bf746d3da admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:22.945437 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72643e6-6f54-4bab-97f6-24992df9c311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:22.946944 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72643e6-6f54-4bab-97f6-24992df9c311 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:22.979803 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1120/2269] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:22 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:35:23.023788 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5a70a-b63e-48bb-a33a-205bf746d3da admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:23.048952 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7870c38-d1cc-4d85-8766-b0c5c9581fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:23.053299 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7870c38-d1cc-4d85-8766-b0c5c9581fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:23.053299 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7870c38-d1cc-4d85-8766-b0c5c9581fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:23.053299 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7870c38-d1cc-4d85-8766-b0c5c9581fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:23.053299 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7870c38-d1cc-4d85-8766-b0c5c9581fa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:23.055336 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7870c38-d1cc-4d85-8766-b0c5c9581fa2 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:23.181514 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1150/2270] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:35:22 2021] POST /identity/v3/users => generated 296 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:23.182101 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72643e6-6f54-4bab-97f6-24992df9c311 service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:23.193654 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72643e6-6f54-4bab-97f6-24992df9c311 service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:23.198450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e855c-5e99-4d49-85c2-5cdeee604bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:23.201956 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e855c-5e99-4d49-85c2-5cdeee604bbf admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:23.201956 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e855c-5e99-4d49-85c2-5cdeee604bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:23.201956 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e855c-5e99-4d49-85c2-5cdeee604bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:23.201956 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e855c-5e99-4d49-85c2-5cdeee604bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:23.202552 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e855c-5e99-4d49-85c2-5cdeee604bbf admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:23.214194 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1121/2271] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:23 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:35:23.219391 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e855c-5e99-4d49-85c2-5cdeee604bbf admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:23.219535 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccbce8-018e-44d1-a27b-88e90ab55dca None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:23.219690 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccbce8-018e-44d1-a27b-88e90ab55dca None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:23.220175 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccbce8-018e-44d1-a27b-88e90ab55dca None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:23.222324 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1151/2272] 10.222.0.25 () {54 vars in 960 bytes} [Fri Aug 27 01:35:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:35:23.228678 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cfaaf-2a39-423e-b4d8-eeffee6847dc None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:23.229088 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cfaaf-2a39-423e-b4d8-eeffee6847dc None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:23.235440 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cfaaf-2a39-423e-b4d8-eeffee6847dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:23.239573 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e855c-5e99-4d49-85c2-5cdeee604bbf admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:23.250964 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cc26f-4cc4-4362-b9f6-b2d593f27883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:23.251879 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cc26f-4cc4-4362-b9f6-b2d593f27883 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:23.252314 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cc26f-4cc4-4362-b9f6-b2d593f27883 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:23.252645 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cc26f-4cc4-4362-b9f6-b2d593f27883 admin admin] PATH_INFO: `/v3/projects/2085322cd1e641bd9c93d4fc176c9186/users/1dedab2dcb574b278ae1d672fb56658b/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:23.272175 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cc26f-4cc4-4362-b9f6-b2d593f27883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2085322cd1e641bd9c93d4fc176c9186, user_id=1dedab2dcb574b278ae1d672fb56658b, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:23.276444 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cc26f-4cc4-4362-b9f6-b2d593f27883 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:23.277091 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-000cfaaf-2a39-423e-b4d8-eeffee6847dc None None] MFA Rules not processed for user `d67c0b68ca7349399d9ea9f4a0b2b564`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:23.278569 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-000cfaaf-2a39-423e-b4d8-eeffee6847dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:23.337506 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1122/2273] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:23 2021] PUT /identity/v3/projects/2085322cd1e641bd9c93d4fc176c9186/users/1dedab2dcb574b278ae1d672fb56658b/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:23.341674 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cc26f-4cc4-4362-b9f6-b2d593f27883 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:23.351309 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1152/2274] 10.222.0.25 () {58 vars in 1058 bytes} [Fri Aug 27 01:35:23 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:23.360048 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cfaaf-2a39-423e-b4d8-eeffee6847dc None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:23.371490 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cfaaf-2a39-423e-b4d8-eeffee6847dc None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:23.403068 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cc26f-4cc4-4362-b9f6-b2d593f27883 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:23.409151 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0109ecc-a4fd-48c6-b376-137a931ca0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:23.409819 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0109ecc-a4fd-48c6-b376-137a931ca0ae admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:23.410101 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0109ecc-a4fd-48c6-b376-137a931ca0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:23.410380 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0109ecc-a4fd-48c6-b376-137a931ca0ae admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:23.411093 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0109ecc-a4fd-48c6-b376-137a931ca0ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:23.412871 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0109ecc-a4fd-48c6-b376-137a931ca0ae admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:23.426912 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1123/2275] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:23 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:23.428242 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0109ecc-a4fd-48c6-b376-137a931ca0ae admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:23.438260 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0109ecc-a4fd-48c6-b376-137a931ca0ae admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:23.438565 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e62d6-85b6-488e-b6e5-61a741c0e1da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd67c0b68ca7349399d9ea9f4a0b2b564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:23.439208 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e62d6-85b6-488e-b6e5-61a741c0e1da service placement] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:23.439491 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e62d6-85b6-488e-b6e5-61a741c0e1da service placement] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:23.439795 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e62d6-85b6-488e-b6e5-61a741c0e1da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:23.441512 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-6e8e62d6-85b6-488e-b6e5-61a741c0e1da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:23.443258 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c044484-8aa5-4c1a-97cf-8a480176cbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:23.444121 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c044484-8aa5-4c1a-97cf-8a480176cbbd admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:23.444395 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c044484-8aa5-4c1a-97cf-8a480176cbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:23.444678 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c044484-8aa5-4c1a-97cf-8a480176cbbd admin admin] PATH_INFO: `/v3/projects/2085322cd1e641bd9c93d4fc176c9186/users/1dedab2dcb574b278ae1d672fb56658b/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:23.446696 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c044484-8aa5-4c1a-97cf-8a480176cbbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2085322cd1e641bd9c93d4fc176c9186, user_id=1dedab2dcb574b278ae1d672fb56658b, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:23.449743 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c044484-8aa5-4c1a-97cf-8a480176cbbd admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:23.453755 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e62d6-85b6-488e-b6e5-61a741c0e1da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:23.455324 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e62d6-85b6-488e-b6e5-61a741c0e1da service placement] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:23.472904 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1124/2276] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:23 2021] PUT /identity/v3/projects/2085322cd1e641bd9c93d4fc176c9186/users/1dedab2dcb574b278ae1d672fb56658b/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:23.473146 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1153/2277] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:23 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:23.477328 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5f4fc-45f7-4998-a9ec-794884e90ef5 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:23.477621 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5f4fc-45f7-4998-a9ec-794884e90ef5 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:23.477900 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5f4fc-45f7-4998-a9ec-794884e90ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:23.503792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-d3a5f4fc-45f7-4998-a9ec-794884e90ef5 None None] MFA Rules not processed for user `1dedab2dcb574b278ae1d672fb56658b`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:23.504972 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d3a5f4fc-45f7-4998-a9ec-794884e90ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:23.574768 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1125/2278] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:23 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:23.591162 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e62d6-85b6-488e-b6e5-61a741c0e1da service placement] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:23.592821 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-6e8e62d6-85b6-488e-b6e5-61a741c0e1da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:23.652781 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e62d6-85b6-488e-b6e5-61a741c0e1da service placement] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:23.701541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc7feb-2751-4223-b744-ae52bfc484ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:23.702203 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc7feb-2751-4223-b744-ae52bfc484ae service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:23.702481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc7feb-2751-4223-b744-ae52bfc484ae service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:23.702759 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc7feb-2751-4223-b744-ae52bfc484ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:23.712200 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc7feb-2751-4223-b744-ae52bfc484ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:23.713660 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc7feb-2751-4223-b744-ae52bfc484ae service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:23.724072 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1154/2279] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:23 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:35:24.847347 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5f4fc-45f7-4998-a9ec-794884e90ef5 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:24.856969 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5f4fc-45f7-4998-a9ec-794884e90ef5 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:24.862754 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d6473-160a-47e6-b524-5a5c74b98a0c tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dedab2dcb574b278ae1d672fb56658b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2085322cd1e641bd9c93d4fc176c9186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:24.863728 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d6473-160a-47e6-b524-5a5c74b98a0c tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:24.864057 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d6473-160a-47e6-b524-5a5c74b98a0c tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:24.864597 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d6473-160a-47e6-b524-5a5c74b98a0c tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:24.865094 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d6473-160a-47e6-b524-5a5c74b98a0c tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:35:24.865409 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d6473-160a-47e6-b524-5a5c74b98a0c tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:24.867055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d6473-160a-47e6-b524-5a5c74b98a0c tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:24.884040 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1126/2280] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:35:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:35:24.885413 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc7feb-2751-4223-b744-ae52bfc484ae service cinder] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:24.894962 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc7feb-2751-4223-b744-ae52bfc484ae service cinder] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:24.899487 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd904763-5f8a-4094-9fea-b54257c888d6 tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dedab2dcb574b278ae1d672fb56658b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2085322cd1e641bd9c93d4fc176c9186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:24.900129 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904763-5f8a-4094-9fea-b54257c888d6 tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:24.906257 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904763-5f8a-4094-9fea-b54257c888d6 tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:24.906257 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904763-5f8a-4094-9fea-b54257c888d6 tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:24.906257 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd904763-5f8a-4094-9fea-b54257c888d6 tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:24.906257 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd904763-5f8a-4094-9fea-b54257c888d6 tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:24.997489 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1155/2281] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:24 2021] POST /identity/v3/projects => generated 355 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:25.002306 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d6473-160a-47e6-b524-5a5c74b98a0c tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:25.012779 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d6473-160a-47e6-b524-5a5c74b98a0c tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:25.070859 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6efa26-8f24-41ed-95ff-5b2db9babc42 tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dedab2dcb574b278ae1d672fb56658b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2085322cd1e641bd9c93d4fc176c9186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:25.071445 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6efa26-8f24-41ed-95ff-5b2db9babc42 tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:25.071731 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6efa26-8f24-41ed-95ff-5b2db9babc42 tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:25.072013 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6efa26-8f24-41ed-95ff-5b2db9babc42 tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:25.072993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6efa26-8f24-41ed-95ff-5b2db9babc42 tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:35:25.073522 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6efa26-8f24-41ed-95ff-5b2db9babc42 tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:25.074713 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6efa26-8f24-41ed-95ff-5b2db9babc42 tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:25.087213 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1127/2282] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:35:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:35:25.122305 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd904763-5f8a-4094-9fea-b54257c888d6 tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:25.132798 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd904763-5f8a-4094-9fea-b54257c888d6 tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:25.137343 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fb59a-c165-4b59-b35c-6100b030b7ee tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dedab2dcb574b278ae1d672fb56658b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2085322cd1e641bd9c93d4fc176c9186', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:25.138184 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fb59a-c165-4b59-b35c-6100b030b7ee tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:25.138468 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fb59a-c165-4b59-b35c-6100b030b7ee tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:25.138741 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fb59a-c165-4b59-b35c-6100b030b7ee tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] PATH_INFO: `/v3/projects/62c9cd12f6dc4fe6b74d45ad6a0051d9` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:25.139938 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fb59a-c165-4b59-b35c-6100b030b7ee tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] RBAC: Authorizing `identity:delete_project(project_id=62c9cd12f6dc4fe6b74d45ad6a0051d9)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:25.142422 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fb59a-c165-4b59-b35c-6100b030b7ee tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:25.249938 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4d1fb59a-c165-4b59-b35c-6100b030b7ee tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c9cd12f6dc4fe6b74d45ad6a0051d9', 'request_id': 'req-4d1fb59a-c165-4b59-b35c-6100b030b7ee'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:25.257189 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4d1fb59a-c165-4b59-b35c-6100b030b7ee tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c9cd12f6dc4fe6b74d45ad6a0051d9', 'request_id': 'req-4d1fb59a-c165-4b59-b35c-6100b030b7ee'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:25.299100 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4d1fb59a-c165-4b59-b35c-6100b030b7ee tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c9cd12f6dc4fe6b74d45ad6a0051d9', 'request_id': 'req-4d1fb59a-c165-4b59-b35c-6100b030b7ee'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:25.309439 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4d1fb59a-c165-4b59-b35c-6100b030b7ee tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] The token cache is being invalidate because project 62c9cd12f6dc4fe6b74d45ad6a0051d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:25.309726 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4d1fb59a-c165-4b59-b35c-6100b030b7ee tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:25.310362 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4d1fb59a-c165-4b59-b35c-6100b030b7ee tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:25.312442 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1156/2283] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:25 2021] DELETE /identity/v3/projects/62c9cd12f6dc4fe6b74d45ad6a0051d9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:25.877473 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6efa26-8f24-41ed-95ff-5b2db9babc42 tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:25.879185 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-3a6efa26-8f24-41ed-95ff-5b2db9babc42 tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:25.951000 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6efa26-8f24-41ed-95ff-5b2db9babc42 tempest-VolumeQuotaClassesTest-119142572 tempest-VolumeQuotaClassesTest-119142572-project-admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:26.013717 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173b543-d113-4184-a71e-df4b2b919a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:26.014816 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173b543-d113-4184-a71e-df4b2b919a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:26.015618 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173b543-d113-4184-a71e-df4b2b919a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:26.016424 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173b543-d113-4184-a71e-df4b2b919a6b admin admin] PATH_INFO: `/v3/users/cf610a27efb4496b8491e26d9a10f386` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:26.017723 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173b543-d113-4184-a71e-df4b2b919a6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf610a27efb4496b8491e26d9a10f386)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:26.019657 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173b543-d113-4184-a71e-df4b2b919a6b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:26.232883 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3173b543-d113-4184-a71e-df4b2b919a6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf610a27efb4496b8491e26d9a10f386'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:26.233560 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3173b543-d113-4184-a71e-df4b2b919a6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf610a27efb4496b8491e26d9a10f386'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:26.241158 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3173b543-d113-4184-a71e-df4b2b919a6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf610a27efb4496b8491e26d9a10f386'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:26.241788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3173b543-d113-4184-a71e-df4b2b919a6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf610a27efb4496b8491e26d9a10f386'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:26.310789 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3173b543-d113-4184-a71e-df4b2b919a6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf610a27efb4496b8491e26d9a10f386'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:26.329975 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1128/2284] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:25 2021] DELETE /identity/v3/users/cf610a27efb4496b8491e26d9a10f386 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:26.334965 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8e372-c120-480e-bffd-a0cfc4fa2164 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:26.335418 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8e372-c120-480e-bffd-a0cfc4fa2164 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:26.335626 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8e372-c120-480e-bffd-a0cfc4fa2164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:26.358217 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-89e8e372-c120-480e-bffd-a0cfc4fa2164 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:26.360103 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-89e8e372-c120-480e-bffd-a0cfc4fa2164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:26.424607 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1157/2285] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:26.434742 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173b543-d113-4184-a71e-df4b2b919a6b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:26.436496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-3173b543-d113-4184-a71e-df4b2b919a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:26.501277 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173b543-d113-4184-a71e-df4b2b919a6b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:26.505069 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ebf36-236a-4734-b1b6-779ecfda99f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:26.505828 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ebf36-236a-4734-b1b6-779ecfda99f0 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:26.506183 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ebf36-236a-4734-b1b6-779ecfda99f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:26.506527 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ebf36-236a-4734-b1b6-779ecfda99f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:26.519277 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ebf36-236a-4734-b1b6-779ecfda99f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:26.520865 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ebf36-236a-4734-b1b6-779ecfda99f0 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:26.533013 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1129/2286] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:26.913424 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8e372-c120-480e-bffd-a0cfc4fa2164 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:26.914955 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-89e8e372-c120-480e-bffd-a0cfc4fa2164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:26.929036 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8e372-c120-480e-bffd-a0cfc4fa2164 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:26.933885 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99809ac7-7168-4dff-9187-2c3aed43bf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:26.934659 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99809ac7-7168-4dff-9187-2c3aed43bf3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:26.934937 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99809ac7-7168-4dff-9187-2c3aed43bf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:26.935216 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99809ac7-7168-4dff-9187-2c3aed43bf3d admin admin] PATH_INFO: `/v3/projects/d29f27ca7dae465dac846ed32abf96a3` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:26.936401 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99809ac7-7168-4dff-9187-2c3aed43bf3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29f27ca7dae465dac846ed32abf96a3)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:26.938397 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99809ac7-7168-4dff-9187-2c3aed43bf3d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:27.054063 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-99809ac7-7168-4dff-9187-2c3aed43bf3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29f27ca7dae465dac846ed32abf96a3', 'request_id': 'req-99809ac7-7168-4dff-9187-2c3aed43bf3d'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:27.060114 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-99809ac7-7168-4dff-9187-2c3aed43bf3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29f27ca7dae465dac846ed32abf96a3', 'request_id': 'req-99809ac7-7168-4dff-9187-2c3aed43bf3d'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:27.139578 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-99809ac7-7168-4dff-9187-2c3aed43bf3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29f27ca7dae465dac846ed32abf96a3', 'request_id': 'req-99809ac7-7168-4dff-9187-2c3aed43bf3d'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:27.152416 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-99809ac7-7168-4dff-9187-2c3aed43bf3d admin admin] The token cache is being invalidate because project d29f27ca7dae465dac846ed32abf96a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:27.152825 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-99809ac7-7168-4dff-9187-2c3aed43bf3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:27.153594 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-99809ac7-7168-4dff-9187-2c3aed43bf3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:27.155497 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1158/2287] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:26 2021] DELETE /identity/v3/projects/d29f27ca7dae465dac846ed32abf96a3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:27.160464 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ebf36-236a-4734-b1b6-779ecfda99f0 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:27.170643 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ebf36-236a-4734-b1b6-779ecfda99f0 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:27.231306 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3fdb08-2816-422f-b326-baad374c468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:27.237008 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fdb08-2816-422f-b326-baad374c468c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:27.237565 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fdb08-2816-422f-b326-baad374c468c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:27.238034 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fdb08-2816-422f-b326-baad374c468c admin admin] PATH_INFO: `/v3/users/1dedab2dcb574b278ae1d672fb56658b` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:27.239587 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3fdb08-2816-422f-b326-baad374c468c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dedab2dcb574b278ae1d672fb56658b)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:27.241944 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3fdb08-2816-422f-b326-baad374c468c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:27.485984 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2a3fdb08-2816-422f-b326-baad374c468c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dedab2dcb574b278ae1d672fb56658b'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:27.486864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2a3fdb08-2816-422f-b326-baad374c468c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dedab2dcb574b278ae1d672fb56658b'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:27.494326 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2a3fdb08-2816-422f-b326-baad374c468c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dedab2dcb574b278ae1d672fb56658b'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:27.495104 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2a3fdb08-2816-422f-b326-baad374c468c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dedab2dcb574b278ae1d672fb56658b'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:27.567934 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2a3fdb08-2816-422f-b326-baad374c468c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dedab2dcb574b278ae1d672fb56658b'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:27.594318 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1130/2288] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:27 2021] DELETE /identity/v3/users/1dedab2dcb574b278ae1d672fb56658b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:28.193958 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99809ac7-7168-4dff-9187-2c3aed43bf3d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:28.195444 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-99809ac7-7168-4dff-9187-2c3aed43bf3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:28.209598 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99809ac7-7168-4dff-9187-2c3aed43bf3d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:28.279761 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d9716-058f-464c-b2e5-e195e13dca02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:28.281055 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d9716-058f-464c-b2e5-e195e13dca02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:28.281722 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d9716-058f-464c-b2e5-e195e13dca02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:28.282315 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d9716-058f-464c-b2e5-e195e13dca02 admin admin] PATH_INFO: `/v3/projects/2085322cd1e641bd9c93d4fc176c9186` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:28.283959 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d9716-058f-464c-b2e5-e195e13dca02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2085322cd1e641bd9c93d4fc176c9186)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:28.286589 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d9716-058f-464c-b2e5-e195e13dca02 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:28.420732 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-8d6d9716-058f-464c-b2e5-e195e13dca02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2085322cd1e641bd9c93d4fc176c9186', 'request_id': 'req-8d6d9716-058f-464c-b2e5-e195e13dca02'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:28.431261 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-8d6d9716-058f-464c-b2e5-e195e13dca02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2085322cd1e641bd9c93d4fc176c9186', 'request_id': 'req-8d6d9716-058f-464c-b2e5-e195e13dca02'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:28.517185 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-8d6d9716-058f-464c-b2e5-e195e13dca02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2085322cd1e641bd9c93d4fc176c9186', 'request_id': 'req-8d6d9716-058f-464c-b2e5-e195e13dca02'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:28.531637 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-8d6d9716-058f-464c-b2e5-e195e13dca02 admin admin] The token cache is being invalidate because project 2085322cd1e641bd9c93d4fc176c9186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:28.532214 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-8d6d9716-058f-464c-b2e5-e195e13dca02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:28.533103 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-8d6d9716-058f-464c-b2e5-e195e13dca02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:28.535790 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1159/2289] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:28 2021] DELETE /identity/v3/projects/2085322cd1e641bd9c93d4fc176c9186 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:28.541642 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241397ac-09ed-485c-bd10-5b386ddff44c None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:28.542169 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241397ac-09ed-485c-bd10-5b386ddff44c None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:28.542562 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241397ac-09ed-485c-bd10-5b386ddff44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:28.566247 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-241397ac-09ed-485c-bd10-5b386ddff44c None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:28.567787 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-241397ac-09ed-485c-bd10-5b386ddff44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:28.637797 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1131/2290] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:28.646238 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0707b5b-2f2a-4ef4-ae0b-e3fd07bee603 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:28.646528 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0707b5b-2f2a-4ef4-ae0b-e3fd07bee603 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:28.646808 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0707b5b-2f2a-4ef4-ae0b-e3fd07bee603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:28.667464 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-c0707b5b-2f2a-4ef4-ae0b-e3fd07bee603 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:28.669286 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c0707b5b-2f2a-4ef4-ae0b-e3fd07bee603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:28.677672 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1160/2291] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:28.685308 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241397ac-09ed-485c-bd10-5b386ddff44c None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:28.695853 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241397ac-09ed-485c-bd10-5b386ddff44c None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:28.701162 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf59502-54e9-4d7b-97ca-f83a9521fa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:28.701972 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf59502-54e9-4d7b-97ca-f83a9521fa43 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:28.702252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf59502-54e9-4d7b-97ca-f83a9521fa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:28.703720 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf59502-54e9-4d7b-97ca-f83a9521fa43 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:28.704469 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf59502-54e9-4d7b-97ca-f83a9521fa43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:35:28.704781 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf59502-54e9-4d7b-97ca-f83a9521fa43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:28.706418 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf59502-54e9-4d7b-97ca-f83a9521fa43 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:28.719879 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1132/2292] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:35:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:35:28.724120 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0707b5b-2f2a-4ef4-ae0b-e3fd07bee603 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:28.734599 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0707b5b-2f2a-4ef4-ae0b-e3fd07bee603 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:28.739374 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4e8d2-9c76-4590-ab4a-6d8ac45bbd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:28.740285 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4e8d2-9c76-4590-ab4a-6d8ac45bbd7d admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:28.740639 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4e8d2-9c76-4590-ab4a-6d8ac45bbd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:28.741003 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4e8d2-9c76-4590-ab4a-6d8ac45bbd7d admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:28.741773 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4e8d2-9c76-4590-ab4a-6d8ac45bbd7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:28.743981 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4e8d2-9c76-4590-ab4a-6d8ac45bbd7d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:28.962147 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1161/2293] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:28 2021] POST /identity/v3/projects => generated 385 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:35:28.963270 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf59502-54e9-4d7b-97ca-f83a9521fa43 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:28.977728 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf59502-54e9-4d7b-97ca-f83a9521fa43 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:29.050429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b097d9d-6a5f-4619-96a2-988c355d3f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:29.053698 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b097d9d-6a5f-4619-96a2-988c355d3f4b admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:29.053698 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b097d9d-6a5f-4619-96a2-988c355d3f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:29.053698 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b097d9d-6a5f-4619-96a2-988c355d3f4b admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:29.053698 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b097d9d-6a5f-4619-96a2-988c355d3f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:29.056227 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b097d9d-6a5f-4619-96a2-988c355d3f4b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:29.169129 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1133/2294] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:35:28 2021] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:29.177687 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4e8d2-9c76-4590-ab4a-6d8ac45bbd7d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:29.208471 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4e8d2-9c76-4590-ab4a-6d8ac45bbd7d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:29.209094 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dd7c6-c0fc-4696-a18e-6d001d8d8c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:29.209255 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dd7c6-c0fc-4696-a18e-6d001d8d8c0b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:29.210211 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dd7c6-c0fc-4696-a18e-6d001d8d8c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:29.210588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dd7c6-c0fc-4696-a18e-6d001d8d8c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:29.211400 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876dd7c6-c0fc-4696-a18e-6d001d8d8c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:29.213168 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876dd7c6-c0fc-4696-a18e-6d001d8d8c0b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:29.227470 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1162/2295] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:29 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:29.228672 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b097d9d-6a5f-4619-96a2-988c355d3f4b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:29.240561 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b097d9d-6a5f-4619-96a2-988c355d3f4b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:29.248916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7e582-b07e-4a17-bd79-de6243b63cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:29.248916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7e582-b07e-4a17-bd79-de6243b63cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:29.248916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7e582-b07e-4a17-bd79-de6243b63cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:29.248916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7e582-b07e-4a17-bd79-de6243b63cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:29.250851 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7e582-b07e-4a17-bd79-de6243b63cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:29.252440 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7e582-b07e-4a17-bd79-de6243b63cd7 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:29.263818 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1134/2296] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:29 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:35:29.271589 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dd7c6-c0fc-4696-a18e-6d001d8d8c0b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:29.284266 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dd7c6-c0fc-4696-a18e-6d001d8d8c0b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:29.289306 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284fc786-5c95-429a-9348-fe047c364be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:29.290207 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fc786-5c95-429a-9348-fe047c364be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:29.290495 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fc786-5c95-429a-9348-fe047c364be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:29.290772 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fc786-5c95-429a-9348-fe047c364be1 admin admin] PATH_INFO: `/v3/projects/0c6687d781bd4f86b5051f03f5d19375/users/5c4e8b50b9b145aba89e946041436590/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:29.307038 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284fc786-5c95-429a-9348-fe047c364be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c6687d781bd4f86b5051f03f5d19375, user_id=5c4e8b50b9b145aba89e946041436590, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:29.310047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284fc786-5c95-429a-9348-fe047c364be1 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:29.380219 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1163/2297] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:29 2021] PUT /identity/v3/projects/0c6687d781bd4f86b5051f03f5d19375/users/5c4e8b50b9b145aba89e946041436590/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:29.391269 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab0389-adcd-4ecd-aafd-9a3a960b2bf8 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:29.391577 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab0389-adcd-4ecd-aafd-9a3a960b2bf8 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:29.391863 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab0389-adcd-4ecd-aafd-9a3a960b2bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:29.422147 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-1eab0389-adcd-4ecd-aafd-9a3a960b2bf8 None None] MFA Rules not processed for user `5c4e8b50b9b145aba89e946041436590`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:29.423376 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1eab0389-adcd-4ecd-aafd-9a3a960b2bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:29.488642 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1135/2298] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:29 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:29.493033 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284fc786-5c95-429a-9348-fe047c364be1 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:29.555174 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284fc786-5c95-429a-9348-fe047c364be1 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:29.560030 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4a730-902d-4a85-9684-1773a13a6840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:29.560698 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4a730-902d-4a85-9684-1773a13a6840 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:29.561012 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4a730-902d-4a85-9684-1773a13a6840 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:29.561290 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4a730-902d-4a85-9684-1773a13a6840 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:29.562014 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4a730-902d-4a85-9684-1773a13a6840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:29.563917 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4a730-902d-4a85-9684-1773a13a6840 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:29.631946 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1164/2299] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:29 2021] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:29.636050 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab0389-adcd-4ecd-aafd-9a3a960b2bf8 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:29.646972 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab0389-adcd-4ecd-aafd-9a3a960b2bf8 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:29.709873 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221064b-5029-425f-b912-e36e3f532bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:29.710628 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221064b-5029-425f-b912-e36e3f532bfe admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:29.710916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221064b-5029-425f-b912-e36e3f532bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:29.711192 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221064b-5029-425f-b912-e36e3f532bfe admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:29.711911 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221064b-5029-425f-b912-e36e3f532bfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:29.714133 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221064b-5029-425f-b912-e36e3f532bfe admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:29.828948 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1136/2300] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:35:29 2021] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:29.830373 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4a730-902d-4a85-9684-1773a13a6840 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:29.842361 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4a730-902d-4a85-9684-1773a13a6840 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:29.848170 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945c602-a7aa-464a-aac2-166fc20579c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:29.848865 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945c602-a7aa-464a-aac2-166fc20579c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:29.849165 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945c602-a7aa-464a-aac2-166fc20579c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:29.849440 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945c602-a7aa-464a-aac2-166fc20579c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:29.850166 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945c602-a7aa-464a-aac2-166fc20579c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:29.851779 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945c602-a7aa-464a-aac2-166fc20579c6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:29.861128 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221064b-5029-425f-b912-e36e3f532bfe admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:29.862870 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-6221064b-5029-425f-b912-e36e3f532bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:29.867332 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1165/2301] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:29 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:29.871082 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945c602-a7aa-464a-aac2-166fc20579c6 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:29.885988 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945c602-a7aa-464a-aac2-166fc20579c6 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:29.893133 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37c39a-4c5d-4c62-9198-5b4cd4c96def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:29.893944 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37c39a-4c5d-4c62-9198-5b4cd4c96def admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:29.894411 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37c39a-4c5d-4c62-9198-5b4cd4c96def admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:29.894790 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37c39a-4c5d-4c62-9198-5b4cd4c96def admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:29.895645 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37c39a-4c5d-4c62-9198-5b4cd4c96def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:29.897401 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37c39a-4c5d-4c62-9198-5b4cd4c96def admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:29.908873 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1166/2302] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:29 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:35:29.914488 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37c39a-4c5d-4c62-9198-5b4cd4c96def admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:29.928826 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37c39a-4c5d-4c62-9198-5b4cd4c96def admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:29.934176 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86377993-9b20-447a-980a-03353b1e7c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:29.935554 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86377993-9b20-447a-980a-03353b1e7c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:29.936130 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86377993-9b20-447a-980a-03353b1e7c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:29.936585 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86377993-9b20-447a-980a-03353b1e7c64 admin admin] PATH_INFO: `/v3/projects/7c3976fd603046b89654735a9c43ea80/users/b503931ee233405b864100838067badc/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:29.942734 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221064b-5029-425f-b912-e36e3f532bfe admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:29.947250 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45cd7e-19ae-4dce-b2d4-deb3768f837c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:29.948153 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45cd7e-19ae-4dce-b2d4-deb3768f837c service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:29.948583 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45cd7e-19ae-4dce-b2d4-deb3768f837c service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:29.949126 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45cd7e-19ae-4dce-b2d4-deb3768f837c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:29.951934 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-3a45cd7e-19ae-4dce-b2d4-deb3768f837c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:29.955855 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86377993-9b20-447a-980a-03353b1e7c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3976fd603046b89654735a9c43ea80, user_id=b503931ee233405b864100838067badc, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:29.958652 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86377993-9b20-447a-980a-03353b1e7c64 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:29.970305 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45cd7e-19ae-4dce-b2d4-deb3768f837c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:29.971942 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45cd7e-19ae-4dce-b2d4-deb3768f837c service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:29.980289 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1137/2303] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:29 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:35:30.035357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1167/2304] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:29 2021] PUT /identity/v3/projects/7c3976fd603046b89654735a9c43ea80/users/b503931ee233405b864100838067badc/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:30.047414 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ce045-f964-4da0-bd95-88320be3c3fa None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:30.047572 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ce045-f964-4da0-bd95-88320be3c3fa None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:30.047919 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ce045-f964-4da0-bd95-88320be3c3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:30.077106 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-717ce045-f964-4da0-bd95-88320be3c3fa None None] MFA Rules not processed for user `b503931ee233405b864100838067badc`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:30.079418 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-717ce045-f964-4da0-bd95-88320be3c3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:30.163606 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1138/2305] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:30 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:30.167622 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86377993-9b20-447a-980a-03353b1e7c64 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:30.262967 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86377993-9b20-447a-980a-03353b1e7c64 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:30.273124 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a1dee-7be8-400b-8595-afacf8a50a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:30.274158 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a1dee-7be8-400b-8595-afacf8a50a49 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:30.274910 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a1dee-7be8-400b-8595-afacf8a50a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:30.275779 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a1dee-7be8-400b-8595-afacf8a50a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:30.276961 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a1dee-7be8-400b-8595-afacf8a50a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:30.279306 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a1dee-7be8-400b-8595-afacf8a50a49 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:30.382488 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1168/2306] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:30 2021] POST /identity/v3/projects => generated 387 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:35:30.388210 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ce045-f964-4da0-bd95-88320be3c3fa None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:30.407856 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ce045-f964-4da0-bd95-88320be3c3fa None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:30.496161 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89e40b-1686-417d-9a88-b2b0fc92e3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:30.496759 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89e40b-1686-417d-9a88-b2b0fc92e3fd admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:30.497072 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89e40b-1686-417d-9a88-b2b0fc92e3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:30.497378 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89e40b-1686-417d-9a88-b2b0fc92e3fd admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:30.498086 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89e40b-1686-417d-9a88-b2b0fc92e3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:30.500024 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89e40b-1686-417d-9a88-b2b0fc92e3fd admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:30.603044 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1139/2307] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:35:30 2021] POST /identity/v3/users => generated 300 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:30.607063 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a1dee-7be8-400b-8595-afacf8a50a49 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:30.618627 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a1dee-7be8-400b-8595-afacf8a50a49 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:30.624377 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483def82-df62-4e3f-889f-55a1a2593175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:30.625441 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483def82-df62-4e3f-889f-55a1a2593175 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:30.625955 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483def82-df62-4e3f-889f-55a1a2593175 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:30.626437 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483def82-df62-4e3f-889f-55a1a2593175 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:30.627393 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483def82-df62-4e3f-889f-55a1a2593175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:30.629285 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483def82-df62-4e3f-889f-55a1a2593175 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:30.641384 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1169/2308] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:30 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:30.645679 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89e40b-1686-417d-9a88-b2b0fc92e3fd admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:30.657309 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89e40b-1686-417d-9a88-b2b0fc92e3fd admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:30.662405 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e3dfd-c1e0-4063-9e80-433f399d9d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:30.663773 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e3dfd-c1e0-4063-9e80-433f399d9d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:30.664452 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e3dfd-c1e0-4063-9e80-433f399d9d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:30.665669 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e3dfd-c1e0-4063-9e80-433f399d9d5b admin admin] PATH_INFO: `/v3/projects/afab829bdd254f74b2b1887b667567f4/users/e352c576c29c403ca2ed20f84839e0d7/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:30.684704 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e3dfd-c1e0-4063-9e80-433f399d9d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=afab829bdd254f74b2b1887b667567f4, user_id=e352c576c29c403ca2ed20f84839e0d7, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:30.688812 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e3dfd-c1e0-4063-9e80-433f399d9d5b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:30.808453 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1140/2309] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:30 2021] PUT /identity/v3/projects/afab829bdd254f74b2b1887b667567f4/users/e352c576c29c403ca2ed20f84839e0d7/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:30.812162 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483def82-df62-4e3f-889f-55a1a2593175 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:30.824140 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483def82-df62-4e3f-889f-55a1a2593175 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:30.899136 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ec895-2d14-4a23-9d9f-2761ce380ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:30.899912 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ec895-2d14-4a23-9d9f-2761ce380ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:30.900418 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ec895-2d14-4a23-9d9f-2761ce380ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:30.900685 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ec895-2d14-4a23-9d9f-2761ce380ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:30.901518 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ec895-2d14-4a23-9d9f-2761ce380ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:30.903424 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ec895-2d14-4a23-9d9f-2761ce380ee1 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:30.918477 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1170/2310] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:30 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:30.924548 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e3dfd-c1e0-4063-9e80-433f399d9d5b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:30.936132 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e3dfd-c1e0-4063-9e80-433f399d9d5b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:30.941751 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101821e-b1b3-4875-adaf-d08b98c260c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:30.942636 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101821e-b1b3-4875-adaf-d08b98c260c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:30.943106 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101821e-b1b3-4875-adaf-d08b98c260c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:30.943298 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101821e-b1b3-4875-adaf-d08b98c260c6 admin admin] PATH_INFO: `/v3/projects/afab829bdd254f74b2b1887b667567f4/users/e352c576c29c403ca2ed20f84839e0d7/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:30.945426 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101821e-b1b3-4875-adaf-d08b98c260c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afab829bdd254f74b2b1887b667567f4, user_id=e352c576c29c403ca2ed20f84839e0d7, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:30.948414 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101821e-b1b3-4875-adaf-d08b98c260c6 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:30.959974 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1141/2311] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:30 2021] PUT /identity/v3/projects/afab829bdd254f74b2b1887b667567f4/users/e352c576c29c403ca2ed20f84839e0d7/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:30.970624 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b32899-0571-4d99-9630-04fe5f0e07ae None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:30.971838 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b32899-0571-4d99-9630-04fe5f0e07ae None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:30.971838 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b32899-0571-4d99-9630-04fe5f0e07ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:31.002674 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-00b32899-0571-4d99-9630-04fe5f0e07ae None None] MFA Rules not processed for user `e352c576c29c403ca2ed20f84839e0d7`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:31.003811 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-00b32899-0571-4d99-9630-04fe5f0e07ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:31.086786 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1171/2312] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:30 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:31.097623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101821e-b1b3-4875-adaf-d08b98c260c6 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:31.099498 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8101821e-b1b3-4875-adaf-d08b98c260c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:31.158782 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101821e-b1b3-4875-adaf-d08b98c260c6 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:31.162874 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a794148-e20e-465a-8075-337c426a75e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:31.163524 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a794148-e20e-465a-8075-337c426a75e4 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:31.167084 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a794148-e20e-465a-8075-337c426a75e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:31.167084 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a794148-e20e-465a-8075-337c426a75e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:31.176175 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a794148-e20e-465a-8075-337c426a75e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:31.178360 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a794148-e20e-465a-8075-337c426a75e4 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:31.190874 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1142/2313] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:31 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:31.898059 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b32899-0571-4d99-9630-04fe5f0e07ae None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:31.899672 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-00b32899-0571-4d99-9630-04fe5f0e07ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:31.968127 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b32899-0571-4d99-9630-04fe5f0e07ae None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:31.972687 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fca69-fd35-499b-b8d4-c5216d18552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:31.973581 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fca69-fd35-499b-b8d4-c5216d18552b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:31.973858 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fca69-fd35-499b-b8d4-c5216d18552b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:31.974130 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fca69-fd35-499b-b8d4-c5216d18552b admin admin] PATH_INFO: `/v3/users/028570a9a8794c558385ee51033d2a95` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:31.975314 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fca69-fd35-499b-b8d4-c5216d18552b admin admin] RBAC: Authorizing `identity:delete_user(user_id=028570a9a8794c558385ee51033d2a95)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:31.977400 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fca69-fd35-499b-b8d4-c5216d18552b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:32.153660 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3d1fca69-fd35-499b-b8d4-c5216d18552b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '028570a9a8794c558385ee51033d2a95'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:32.172728 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3d1fca69-fd35-499b-b8d4-c5216d18552b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '028570a9a8794c558385ee51033d2a95'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:32.181725 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3d1fca69-fd35-499b-b8d4-c5216d18552b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '028570a9a8794c558385ee51033d2a95'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:32.182486 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3d1fca69-fd35-499b-b8d4-c5216d18552b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '028570a9a8794c558385ee51033d2a95'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:32.253281 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3d1fca69-fd35-499b-b8d4-c5216d18552b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '028570a9a8794c558385ee51033d2a95'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:32.259654 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1172/2314] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:31 2021] DELETE /identity/v3/users/028570a9a8794c558385ee51033d2a95 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:32.268956 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372584a-c2a7-480e-bbcd-2c879c4b9c7a None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:32.269427 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372584a-c2a7-480e-bbcd-2c879c4b9c7a None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:32.269619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372584a-c2a7-480e-bbcd-2c879c4b9c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:32.290176 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-8372584a-c2a7-480e-bbcd-2c879c4b9c7a None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:32.291571 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8372584a-c2a7-480e-bbcd-2c879c4b9c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:32.298071 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fca69-fd35-499b-b8d4-c5216d18552b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:32.300178 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-3d1fca69-fd35-499b-b8d4-c5216d18552b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:32.373249 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1143/2315] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:32.373444 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fca69-fd35-499b-b8d4-c5216d18552b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:32.379747 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aae40-b971-4b7e-a746-eece82908195 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:32.380966 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372584a-c2a7-480e-bbcd-2c879c4b9c7a None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:32.381511 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aae40-b971-4b7e-a746-eece82908195 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:32.381903 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aae40-b971-4b7e-a746-eece82908195 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:32.382306 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aae40-b971-4b7e-a746-eece82908195 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:32.382560 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8372584a-c2a7-480e-bbcd-2c879c4b9c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:32.384409 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-2f2aae40-b971-4b7e-a746-eece82908195 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:32.449386 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aae40-b971-4b7e-a746-eece82908195 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:32.450634 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aae40-b971-4b7e-a746-eece82908195 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:32.452913 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372584a-c2a7-480e-bbcd-2c879c4b9c7a None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:32.456932 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f80e26-a155-42ca-9d93-764de1618dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:32.457689 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f80e26-a155-42ca-9d93-764de1618dfa service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:32.458095 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f80e26-a155-42ca-9d93-764de1618dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:32.458469 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f80e26-a155-42ca-9d93-764de1618dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:32.461029 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1173/2316] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:32 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:35:32.469407 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f80e26-a155-42ca-9d93-764de1618dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:32.470923 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f80e26-a155-42ca-9d93-764de1618dfa service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:32.480748 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1144/2317] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:35:33.042732 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aae40-b971-4b7e-a746-eece82908195 service cinder] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:33.043773 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-2f2aae40-b971-4b7e-a746-eece82908195 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:33.068656 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aae40-b971-4b7e-a746-eece82908195 service cinder] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:33.077223 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52129bbf-1b9e-4158-a01e-329dcd603325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:33.078701 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52129bbf-1b9e-4158-a01e-329dcd603325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:33.079052 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52129bbf-1b9e-4158-a01e-329dcd603325 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:33.079395 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52129bbf-1b9e-4158-a01e-329dcd603325 admin admin] PATH_INFO: `/v3/projects/5aec1ac6f24943f499aeccadd63dd0b0` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:33.080686 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52129bbf-1b9e-4158-a01e-329dcd603325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aec1ac6f24943f499aeccadd63dd0b0)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:33.082792 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52129bbf-1b9e-4158-a01e-329dcd603325 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:33.209239 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-52129bbf-1b9e-4158-a01e-329dcd603325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aec1ac6f24943f499aeccadd63dd0b0', 'request_id': 'req-52129bbf-1b9e-4158-a01e-329dcd603325'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:33.216551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-52129bbf-1b9e-4158-a01e-329dcd603325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aec1ac6f24943f499aeccadd63dd0b0', 'request_id': 'req-52129bbf-1b9e-4158-a01e-329dcd603325'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:33.299528 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-52129bbf-1b9e-4158-a01e-329dcd603325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aec1ac6f24943f499aeccadd63dd0b0', 'request_id': 'req-52129bbf-1b9e-4158-a01e-329dcd603325'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:33.311133 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-52129bbf-1b9e-4158-a01e-329dcd603325 admin admin] The token cache is being invalidate because project 5aec1ac6f24943f499aeccadd63dd0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:33.311422 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-52129bbf-1b9e-4158-a01e-329dcd603325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:33.312171 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-52129bbf-1b9e-4158-a01e-329dcd603325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:33.314390 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1174/2318] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:33 2021] DELETE /identity/v3/projects/5aec1ac6f24943f499aeccadd63dd0b0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:33.318369 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f80e26-a155-42ca-9d93-764de1618dfa service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:33.330453 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f80e26-a155-42ca-9d93-764de1618dfa service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:33.388552 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72722e64-a02e-437f-9d41-6119dd7130ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:33.390673 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72722e64-a02e-437f-9d41-6119dd7130ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:33.391072 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72722e64-a02e-437f-9d41-6119dd7130ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:33.391270 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72722e64-a02e-437f-9d41-6119dd7130ab admin admin] PATH_INFO: `/v3/users/208415a690eb4850a164289946f26c25` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:33.392556 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72722e64-a02e-437f-9d41-6119dd7130ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=208415a690eb4850a164289946f26c25)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:33.394551 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72722e64-a02e-437f-9d41-6119dd7130ab admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:33.593965 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-72722e64-a02e-437f-9d41-6119dd7130ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '208415a690eb4850a164289946f26c25'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:33.594641 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-72722e64-a02e-437f-9d41-6119dd7130ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '208415a690eb4850a164289946f26c25'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:33.602786 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-72722e64-a02e-437f-9d41-6119dd7130ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '208415a690eb4850a164289946f26c25'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:33.603521 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-72722e64-a02e-437f-9d41-6119dd7130ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '208415a690eb4850a164289946f26c25'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:33.693776 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-72722e64-a02e-437f-9d41-6119dd7130ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '208415a690eb4850a164289946f26c25'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:33.712263 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1145/2319] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:33 2021] DELETE /identity/v3/users/208415a690eb4850a164289946f26c25 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:34.323532 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52129bbf-1b9e-4158-a01e-329dcd603325 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:34.329053 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-52129bbf-1b9e-4158-a01e-329dcd603325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:34.342367 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52129bbf-1b9e-4158-a01e-329dcd603325 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:34.423723 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f050e-6b8d-4eeb-add3-461697400cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:34.424588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f050e-6b8d-4eeb-add3-461697400cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:34.425175 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f050e-6b8d-4eeb-add3-461697400cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:34.425449 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f050e-6b8d-4eeb-add3-461697400cb4 admin admin] PATH_INFO: `/v3/projects/c7ac2a7275314eb5b4a61f66b563ab1f` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:34.426722 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f050e-6b8d-4eeb-add3-461697400cb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ac2a7275314eb5b4a61f66b563ab1f)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:34.428674 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f050e-6b8d-4eeb-add3-461697400cb4 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:34.589439 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-2e7f050e-6b8d-4eeb-add3-461697400cb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ac2a7275314eb5b4a61f66b563ab1f', 'request_id': 'req-2e7f050e-6b8d-4eeb-add3-461697400cb4'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:34.596713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-2e7f050e-6b8d-4eeb-add3-461697400cb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ac2a7275314eb5b4a61f66b563ab1f', 'request_id': 'req-2e7f050e-6b8d-4eeb-add3-461697400cb4'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:34.697389 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-2e7f050e-6b8d-4eeb-add3-461697400cb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ac2a7275314eb5b4a61f66b563ab1f', 'request_id': 'req-2e7f050e-6b8d-4eeb-add3-461697400cb4'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:34.709053 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-2e7f050e-6b8d-4eeb-add3-461697400cb4 admin admin] The token cache is being invalidate because project c7ac2a7275314eb5b4a61f66b563ab1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:34.709535 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-2e7f050e-6b8d-4eeb-add3-461697400cb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:34.710426 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-2e7f050e-6b8d-4eeb-add3-461697400cb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:34.713114 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1175/2320] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:34 2021] DELETE /identity/v3/projects/c7ac2a7275314eb5b4a61f66b563ab1f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:34.719596 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0ce17-92e2-4b80-a644-b64d46a182fc None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:34.720136 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0ce17-92e2-4b80-a644-b64d46a182fc None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:34.720136 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0ce17-92e2-4b80-a644-b64d46a182fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:34.747472 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b2b0ce17-92e2-4b80-a644-b64d46a182fc None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:34.748702 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b2b0ce17-92e2-4b80-a644-b64d46a182fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:34.809687 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1146/2321] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:34.820248 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a947d-349d-45a7-883b-74aa6d0f1b13 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:34.820635 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a947d-349d-45a7-883b-74aa6d0f1b13 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:34.824500 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a947d-349d-45a7-883b-74aa6d0f1b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:34.844664 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-ed1a947d-349d-45a7-883b-74aa6d0f1b13 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:34.845980 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-ed1a947d-349d-45a7-883b-74aa6d0f1b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:34.854327 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1176/2322] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:34.859967 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0ce17-92e2-4b80-a644-b64d46a182fc None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:34.869163 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0ce17-92e2-4b80-a644-b64d46a182fc None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:34.881532 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e41db8-7552-4a9c-bb89-2a3cd97e34db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:34.882235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e41db8-7552-4a9c-bb89-2a3cd97e34db admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:34.882523 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e41db8-7552-4a9c-bb89-2a3cd97e34db admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:34.883306 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e41db8-7552-4a9c-bb89-2a3cd97e34db admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:34.883523 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e41db8-7552-4a9c-bb89-2a3cd97e34db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:35:34.883835 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e41db8-7552-4a9c-bb89-2a3cd97e34db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:34.885507 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e41db8-7552-4a9c-bb89-2a3cd97e34db admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:34.898076 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1147/2323] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:35:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:35:34.903279 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a947d-349d-45a7-883b-74aa6d0f1b13 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:34.913693 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a947d-349d-45a7-883b-74aa6d0f1b13 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:34.919330 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cb257-f73a-4c3c-8a80-a2a8c1861ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:34.919996 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cb257-f73a-4c3c-8a80-a2a8c1861ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:34.920283 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cb257-f73a-4c3c-8a80-a2a8c1861ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:34.920565 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cb257-f73a-4c3c-8a80-a2a8c1861ed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:34.922134 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cb257-f73a-4c3c-8a80-a2a8c1861ed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:34.924033 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cb257-f73a-4c3c-8a80-a2a8c1861ed8 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:35.047122 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1177/2324] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:34 2021] POST /identity/v3/projects => generated 361 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:35.053064 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e41db8-7552-4a9c-bb89-2a3cd97e34db admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:35.063925 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e41db8-7552-4a9c-bb89-2a3cd97e34db admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:35.123879 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b87e4-066d-43d0-a1eb-12b523da0de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:35.125012 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b87e4-066d-43d0-a1eb-12b523da0de6 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:35.125509 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b87e4-066d-43d0-a1eb-12b523da0de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:35.126011 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b87e4-066d-43d0-a1eb-12b523da0de6 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:35.127203 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b87e4-066d-43d0-a1eb-12b523da0de6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:35.129702 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b87e4-066d-43d0-a1eb-12b523da0de6 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:35.231441 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1148/2325] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:35:35 2021] POST /identity/v3/users => generated 281 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:35:35.235632 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cb257-f73a-4c3c-8a80-a2a8c1861ed8 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:35.246066 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cb257-f73a-4c3c-8a80-a2a8c1861ed8 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:35.250763 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589dd2d-0224-42f0-8d8e-cd5e2dbe01aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:35.251427 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589dd2d-0224-42f0-8d8e-cd5e2dbe01aa admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:35.251709 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589dd2d-0224-42f0-8d8e-cd5e2dbe01aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:35.252301 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589dd2d-0224-42f0-8d8e-cd5e2dbe01aa admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:35.253390 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589dd2d-0224-42f0-8d8e-cd5e2dbe01aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:35.255052 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589dd2d-0224-42f0-8d8e-cd5e2dbe01aa admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:35.266659 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1178/2326] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:35 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:35.270948 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b87e4-066d-43d0-a1eb-12b523da0de6 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:35.282543 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b87e4-066d-43d0-a1eb-12b523da0de6 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:35.287565 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac73c4-4bd0-4c35-905f-d0a6d1c2c820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:35.288321 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac73c4-4bd0-4c35-905f-d0a6d1c2c820 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:35.288675 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac73c4-4bd0-4c35-905f-d0a6d1c2c820 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:35.289058 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac73c4-4bd0-4c35-905f-d0a6d1c2c820 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:35.289857 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac73c4-4bd0-4c35-905f-d0a6d1c2c820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:35.291549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac73c4-4bd0-4c35-905f-d0a6d1c2c820 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:35.302806 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1149/2327] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:35 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:35:35.306847 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589dd2d-0224-42f0-8d8e-cd5e2dbe01aa admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:35.317338 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589dd2d-0224-42f0-8d8e-cd5e2dbe01aa admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:35.322226 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ab9cf-db0e-4a4f-b7ad-4d33281d26b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:35.323108 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ab9cf-db0e-4a4f-b7ad-4d33281d26b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:35.323392 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ab9cf-db0e-4a4f-b7ad-4d33281d26b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:35.323668 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ab9cf-db0e-4a4f-b7ad-4d33281d26b9 admin admin] PATH_INFO: `/v3/projects/3f210efb057d4a219b8a4e175dbc92ee/users/48521d2fb540440da878a1360bb69de0/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:35.339283 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ab9cf-db0e-4a4f-b7ad-4d33281d26b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f210efb057d4a219b8a4e175dbc92ee, user_id=48521d2fb540440da878a1360bb69de0, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:35.341950 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ab9cf-db0e-4a4f-b7ad-4d33281d26b9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:35.460162 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1179/2328] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:35 2021] PUT /identity/v3/projects/3f210efb057d4a219b8a4e175dbc92ee/users/48521d2fb540440da878a1360bb69de0/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:35:35.471515 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f607d-9c69-4996-8eb2-2dd42177120c None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:35.471810 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f607d-9c69-4996-8eb2-2dd42177120c None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:35.472091 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f607d-9c69-4996-8eb2-2dd42177120c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:35.499628 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-c01f607d-9c69-4996-8eb2-2dd42177120c None None] MFA Rules not processed for user `48521d2fb540440da878a1360bb69de0`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:35.500965 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-c01f607d-9c69-4996-8eb2-2dd42177120c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:35.565811 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1150/2329] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:35 2021] POST /identity/v3/auth/tokens => generated 3381 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:35.598537 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ab9cf-db0e-4a4f-b7ad-4d33281d26b9 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:35.600265 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-9d9ab9cf-db0e-4a4f-b7ad-4d33281d26b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:35.656651 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ab9cf-db0e-4a4f-b7ad-4d33281d26b9 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:35.659543 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024b0fd-331a-4163-9f30-05111f884277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:35.660200 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024b0fd-331a-4163-9f30-05111f884277 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:35.660483 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024b0fd-331a-4163-9f30-05111f884277 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:35.660881 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024b0fd-331a-4163-9f30-05111f884277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:35.676549 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024b0fd-331a-4163-9f30-05111f884277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:35.678090 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024b0fd-331a-4163-9f30-05111f884277 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:35.687910 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1180/2330] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:35 2021] GET /identity/v3/auth/tokens => generated 3381 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:35.703603 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f607d-9c69-4996-8eb2-2dd42177120c None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:35.770915 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f607d-9c69-4996-8eb2-2dd42177120c None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:35.776755 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca076d7b-38cd-4c0d-8d33-334c087336ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:35.778750 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca076d7b-38cd-4c0d-8d33-334c087336ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:35.778750 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca076d7b-38cd-4c0d-8d33-334c087336ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:35.778750 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca076d7b-38cd-4c0d-8d33-334c087336ef admin admin] PATH_INFO: `/v3/users/48521d2fb540440da878a1360bb69de0` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:35.781333 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca076d7b-38cd-4c0d-8d33-334c087336ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=48521d2fb540440da878a1360bb69de0)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:35.782298 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca076d7b-38cd-4c0d-8d33-334c087336ef admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:35.997912 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ca076d7b-38cd-4c0d-8d33-334c087336ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48521d2fb540440da878a1360bb69de0'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:35.998643 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ca076d7b-38cd-4c0d-8d33-334c087336ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48521d2fb540440da878a1360bb69de0'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:36.006369 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ca076d7b-38cd-4c0d-8d33-334c087336ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48521d2fb540440da878a1360bb69de0'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:36.007022 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ca076d7b-38cd-4c0d-8d33-334c087336ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48521d2fb540440da878a1360bb69de0'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:36.065029 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ca076d7b-38cd-4c0d-8d33-334c087336ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48521d2fb540440da878a1360bb69de0'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:36.083613 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1151/2331] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:35 2021] DELETE /identity/v3/users/48521d2fb540440da878a1360bb69de0 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:36.088229 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6140900-1132-4def-bdd7-eef6a3ae5267 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:36.088621 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6140900-1132-4def-bdd7-eef6a3ae5267 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:36.088951 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6140900-1132-4def-bdd7-eef6a3ae5267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:36.109750 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-b6140900-1132-4def-bdd7-eef6a3ae5267 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:36.111059 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-b6140900-1132-4def-bdd7-eef6a3ae5267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:36.182030 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1181/2332] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:36.190341 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca076d7b-38cd-4c0d-8d33-334c087336ef admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:36.192434 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ca076d7b-38cd-4c0d-8d33-334c087336ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:36.261132 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca076d7b-38cd-4c0d-8d33-334c087336ef admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:36.264382 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9158a89-8a11-4ace-ae60-87b6411bc6c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:36.265857 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9158a89-8a11-4ace-ae60-87b6411bc6c8 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:36.266242 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9158a89-8a11-4ace-ae60-87b6411bc6c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:36.266517 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9158a89-8a11-4ace-ae60-87b6411bc6c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:36.279280 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9158a89-8a11-4ace-ae60-87b6411bc6c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:36.281346 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9158a89-8a11-4ace-ae60-87b6411bc6c8 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:36.293017 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1152/2333] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:36.412804 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6163ad8-164d-4c62-b036-54b646a75034 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:36.413394 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6163ad8-164d-4c62-b036-54b646a75034 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:36.413394 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6163ad8-164d-4c62-b036-54b646a75034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:36.446052 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-a6163ad8-164d-4c62-b036-54b646a75034 None None] MFA Rules not processed for user `fa605019ca5c40d897cb30c990710ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:36.448872 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a6163ad8-164d-4c62-b036-54b646a75034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:36.520974 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1182/2334] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:36 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:36.539788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9158a89-8a11-4ace-ae60-87b6411bc6c8 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:36.541244 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b9158a89-8a11-4ace-ae60-87b6411bc6c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:36.554704 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9158a89-8a11-4ace-ae60-87b6411bc6c8 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:36.559516 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fdd37-b29f-40a0-9393-003d4b98ca68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:36.560485 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fdd37-b29f-40a0-9393-003d4b98ca68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:36.560775 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fdd37-b29f-40a0-9393-003d4b98ca68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:36.561074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fdd37-b29f-40a0-9393-003d4b98ca68 admin admin] PATH_INFO: `/v3/users/76bcad9416ea4ffd966b9827246ef936` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:36.563459 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fdd37-b29f-40a0-9393-003d4b98ca68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76bcad9416ea4ffd966b9827246ef936)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:36.565464 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fdd37-b29f-40a0-9393-003d4b98ca68 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:36.788724 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-f46fdd37-b29f-40a0-9393-003d4b98ca68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76bcad9416ea4ffd966b9827246ef936'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:36.789511 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-f46fdd37-b29f-40a0-9393-003d4b98ca68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76bcad9416ea4ffd966b9827246ef936'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:36.797487 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-f46fdd37-b29f-40a0-9393-003d4b98ca68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76bcad9416ea4ffd966b9827246ef936'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:36.798170 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-f46fdd37-b29f-40a0-9393-003d4b98ca68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76bcad9416ea4ffd966b9827246ef936'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:36.893423 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-f46fdd37-b29f-40a0-9393-003d4b98ca68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76bcad9416ea4ffd966b9827246ef936'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:36.911848 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1153/2335] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:36 2021] DELETE /identity/v3/users/76bcad9416ea4ffd966b9827246ef936 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:36.981781 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6163ad8-164d-4c62-b036-54b646a75034 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:36.983296 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a6163ad8-164d-4c62-b036-54b646a75034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:36.998020 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6163ad8-164d-4c62-b036-54b646a75034 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:37.078516 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcf603-d828-4c1e-ac4f-1bcdff116250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:37.079382 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcf603-d828-4c1e-ac4f-1bcdff116250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:37.079665 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcf603-d828-4c1e-ac4f-1bcdff116250 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:37.079939 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcf603-d828-4c1e-ac4f-1bcdff116250 admin admin] PATH_INFO: `/v3/projects/3f210efb057d4a219b8a4e175dbc92ee` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:37.081184 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bcf603-d828-4c1e-ac4f-1bcdff116250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f210efb057d4a219b8a4e175dbc92ee)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:37.083264 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bcf603-d828-4c1e-ac4f-1bcdff116250 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:37.201215 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fdd37-b29f-40a0-9393-003d4b98ca68 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:37.203482 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-f46fdd37-b29f-40a0-9393-003d4b98ca68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:37.218185 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fdd37-b29f-40a0-9393-003d4b98ca68 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:37.226839 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecf668-996c-4281-b0f1-a1c5a613e7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:37.226839 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecf668-996c-4281-b0f1-a1c5a613e7b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:37.226839 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecf668-996c-4281-b0f1-a1c5a613e7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:37.226839 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecf668-996c-4281-b0f1-a1c5a613e7b7 admin admin] PATH_INFO: `/v3/projects/b0342a0d1e3b49c29852c11d8aeadb6f` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:37.227138 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecf668-996c-4281-b0f1-a1c5a613e7b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0342a0d1e3b49c29852c11d8aeadb6f)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:37.228021 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecf668-996c-4281-b0f1-a1c5a613e7b7 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:37.235532 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d9bcf603-d828-4c1e-ac4f-1bcdff116250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f210efb057d4a219b8a4e175dbc92ee', 'request_id': 'req-d9bcf603-d828-4c1e-ac4f-1bcdff116250'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:37.241728 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d9bcf603-d828-4c1e-ac4f-1bcdff116250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f210efb057d4a219b8a4e175dbc92ee', 'request_id': 'req-d9bcf603-d828-4c1e-ac4f-1bcdff116250'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:37.345107 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d9bcf603-d828-4c1e-ac4f-1bcdff116250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f210efb057d4a219b8a4e175dbc92ee', 'request_id': 'req-d9bcf603-d828-4c1e-ac4f-1bcdff116250'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:37.363403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d9bcf603-d828-4c1e-ac4f-1bcdff116250 admin admin] The token cache is being invalidate because project 3f210efb057d4a219b8a4e175dbc92ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:37.363740 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d9bcf603-d828-4c1e-ac4f-1bcdff116250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:37.365738 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d9bcf603-d828-4c1e-ac4f-1bcdff116250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:37.368039 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1183/2336] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:36 2021] DELETE /identity/v3/projects/3f210efb057d4a219b8a4e175dbc92ee => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:37.382190 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5207b-a760-4bc7-9895-3c7ffa432b5c None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:37.382190 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5207b-a760-4bc7-9895-3c7ffa432b5c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:37.382190 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5207b-a760-4bc7-9895-3c7ffa432b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:37.383968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-98ecf668-996c-4281-b0f1-a1c5a613e7b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'request_id': 'req-98ecf668-996c-4281-b0f1-a1c5a613e7b7'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:37.390277 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-98ecf668-996c-4281-b0f1-a1c5a613e7b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'request_id': 'req-98ecf668-996c-4281-b0f1-a1c5a613e7b7'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:37.484770 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-efa5207b-a760-4bc7-9895-3c7ffa432b5c None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:37.484770 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-efa5207b-a760-4bc7-9895-3c7ffa432b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:37.498767 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1184/2337] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:37.509190 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aa4cf-0b90-40fe-8eea-08bd315cd47e None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:37.509992 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aa4cf-0b90-40fe-8eea-08bd315cd47e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:37.510546 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aa4cf-0b90-40fe-8eea-08bd315cd47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:37.532503 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-3e7aa4cf-0b90-40fe-8eea-08bd315cd47e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:37.534392 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-3e7aa4cf-0b90-40fe-8eea-08bd315cd47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:37.546763 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1185/2338] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:37.552497 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7aa4cf-0b90-40fe-8eea-08bd315cd47e None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:37.563930 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7aa4cf-0b90-40fe-8eea-08bd315cd47e None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:37.568962 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971eaf4-fd42-4fa8-9c7f-8edb84497dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:37.569850 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971eaf4-fd42-4fa8-9c7f-8edb84497dce admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:37.569976 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971eaf4-fd42-4fa8-9c7f-8edb84497dce admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:37.570178 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971eaf4-fd42-4fa8-9c7f-8edb84497dce admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:37.570909 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971eaf4-fd42-4fa8-9c7f-8edb84497dce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:35:37.571371 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971eaf4-fd42-4fa8-9c7f-8edb84497dce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:37.572976 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971eaf4-fd42-4fa8-9c7f-8edb84497dce admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:37.585113 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1186/2339] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:35:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:35:37.589435 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971eaf4-fd42-4fa8-9c7f-8edb84497dce admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:37.603159 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971eaf4-fd42-4fa8-9c7f-8edb84497dce admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:37.609203 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e467e-70c3-4387-b79c-12d04d038249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:37.609973 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e467e-70c3-4387-b79c-12d04d038249 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:37.610334 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e467e-70c3-4387-b79c-12d04d038249 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:37.610681 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e467e-70c3-4387-b79c-12d04d038249 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:37.611466 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e467e-70c3-4387-b79c-12d04d038249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:37.613629 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e467e-70c3-4387-b79c-12d04d038249 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:37.665373 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-98ecf668-996c-4281-b0f1-a1c5a613e7b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'request_id': 'req-98ecf668-996c-4281-b0f1-a1c5a613e7b7'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:37.678619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-98ecf668-996c-4281-b0f1-a1c5a613e7b7 admin admin] The token cache is being invalidate because project b0342a0d1e3b49c29852c11d8aeadb6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:37.678905 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-98ecf668-996c-4281-b0f1-a1c5a613e7b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:37.679574 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-98ecf668-996c-4281-b0f1-a1c5a613e7b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:37.681215 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1154/2340] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:37 2021] DELETE /identity/v3/projects/b0342a0d1e3b49c29852c11d8aeadb6f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:37.687421 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd4ae8-5bec-411c-bf7d-6e18f1d3de24 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:37.687728 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd4ae8-5bec-411c-bf7d-6e18f1d3de24 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:37.688153 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd4ae8-5bec-411c-bf7d-6e18f1d3de24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:37.706493 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-3fdd4ae8-5bec-411c-bf7d-6e18f1d3de24 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:37.707716 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-3fdd4ae8-5bec-411c-bf7d-6e18f1d3de24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:37.717679 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1155/2341] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:37.725303 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdc0bf-06b7-45ec-bd1e-957dfd4fe07c None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:37.725580 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdc0bf-06b7-45ec-bd1e-957dfd4fe07c None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:37.726055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdc0bf-06b7-45ec-bd1e-957dfd4fe07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:37.744792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-f1cdc0bf-06b7-45ec-bd1e-957dfd4fe07c None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:37.746077 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-f1cdc0bf-06b7-45ec-bd1e-957dfd4fe07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:37.758818 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1156/2342] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:37.759983 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdc0bf-06b7-45ec-bd1e-957dfd4fe07c None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:37.760731 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1187/2343] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:37 2021] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:35:37.764808 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e467e-70c3-4387-b79c-12d04d038249 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:37.766494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-aa5e467e-70c3-4387-b79c-12d04d038249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:37.772073 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdc0bf-06b7-45ec-bd1e-957dfd4fe07c None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:37.837570 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e467e-70c3-4387-b79c-12d04d038249 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:37.839812 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d6715-6d32-4312-9457-11488ed38d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:37.840618 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d6715-6d32-4312-9457-11488ed38d88 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:37.840952 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d6715-6d32-4312-9457-11488ed38d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:37.841209 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d6715-6d32-4312-9457-11488ed38d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:37.841932 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d6715-6d32-4312-9457-11488ed38d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:35:37.842239 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d6715-6d32-4312-9457-11488ed38d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:37.844619 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bc8a3-abbe-4288-8aa1-acdda9b104ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:37.845018 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d6715-6d32-4312-9457-11488ed38d88 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:37.845384 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bc8a3-abbe-4288-8aa1-acdda9b104ae admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:37.845672 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bc8a3-abbe-4288-8aa1-acdda9b104ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:37.845947 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bc8a3-abbe-4288-8aa1-acdda9b104ae admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:37.846861 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bc8a3-abbe-4288-8aa1-acdda9b104ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:37.848754 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bc8a3-abbe-4288-8aa1-acdda9b104ae admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:37.859345 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1157/2344] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:35:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:35:37.862180 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d6715-6d32-4312-9457-11488ed38d88 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:37.862730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-416d6715-6d32-4312-9457-11488ed38d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:37.922246 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d6715-6d32-4312-9457-11488ed38d88 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:37.926679 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3cbb8-a3d8-4f87-ac63-1e689815b50e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:37.927371 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3cbb8-a3d8-4f87-ac63-1e689815b50e service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:37.927655 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3cbb8-a3d8-4f87-ac63-1e689815b50e service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:37.927952 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3cbb8-a3d8-4f87-ac63-1e689815b50e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:37.929768 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-bce3cbb8-a3d8-4f87-ac63-1e689815b50e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:37.995687 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3cbb8-a3d8-4f87-ac63-1e689815b50e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:37.999670 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1188/2345] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:35:37 2021] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:35:37.999824 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3cbb8-a3d8-4f87-ac63-1e689815b50e service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:37.999929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bc8a3-abbe-4288-8aa1-acdda9b104ae admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:38.006931 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1158/2346] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:37 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:38.007595 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3cbb8-a3d8-4f87-ac63-1e689815b50e service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:38.010404 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bc8a3-abbe-4288-8aa1-acdda9b104ae admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:38.016295 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a0462-4521-49ed-9267-4bef5cc2cbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:38.017356 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a0462-4521-49ed-9267-4bef5cc2cbd7 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:38.017488 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a0462-4521-49ed-9267-4bef5cc2cbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:38.017812 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a0462-4521-49ed-9267-4bef5cc2cbd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:38.019027 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a0462-4521-49ed-9267-4bef5cc2cbd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:38.019168 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3cbb8-a3d8-4f87-ac63-1e689815b50e service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:38.021294 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a0462-4521-49ed-9267-4bef5cc2cbd7 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:38.034320 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae765a-003b-4094-b98d-c24438e606dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:38.034320 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae765a-003b-4094-b98d-c24438e606dd admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:38.034320 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae765a-003b-4094-b98d-c24438e606dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:38.034320 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae765a-003b-4094-b98d-c24438e606dd admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:38.034747 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae765a-003b-4094-b98d-c24438e606dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:38.034747 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae765a-003b-4094-b98d-c24438e606dd admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:38.038872 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1159/2347] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:38 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:38.043272 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae765a-003b-4094-b98d-c24438e606dd admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:38.057007 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae765a-003b-4094-b98d-c24438e606dd admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:38.062370 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64517791-b5cd-4b4d-8348-c99779c3c94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:38.063073 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64517791-b5cd-4b4d-8348-c99779c3c94d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:38.063402 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64517791-b5cd-4b4d-8348-c99779c3c94d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:38.063684 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64517791-b5cd-4b4d-8348-c99779c3c94d admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:38.064403 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64517791-b5cd-4b4d-8348-c99779c3c94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:38.066011 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64517791-b5cd-4b4d-8348-c99779c3c94d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:38.076660 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1160/2348] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:38 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:38.081620 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64517791-b5cd-4b4d-8348-c99779c3c94d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:38.092304 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64517791-b5cd-4b4d-8348-c99779c3c94d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:38.105301 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56a53d-9807-438e-b79b-d62573e922f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:38.106203 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56a53d-9807-438e-b79b-d62573e922f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:38.106481 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56a53d-9807-438e-b79b-d62573e922f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:38.106760 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56a53d-9807-438e-b79b-d62573e922f5 admin admin] PATH_INFO: `/v3/projects/31b47b7bf2ed4568af16eb7861b78453/users/b2a94d8d27de4c9db7b8f2b1285058ac/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:38.120204 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1189/2349] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:37 2021] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:38.121126 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a0462-4521-49ed-9267-4bef5cc2cbd7 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:38.124246 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56a53d-9807-438e-b79b-d62573e922f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b47b7bf2ed4568af16eb7861b78453, user_id=b2a94d8d27de4c9db7b8f2b1285058ac, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:38.127196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56a53d-9807-438e-b79b-d62573e922f5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:38.188629 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a0462-4521-49ed-9267-4bef5cc2cbd7 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:38.193556 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d12aa-7929-44dc-a066-e79a4f08b08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:38.194234 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d12aa-7929-44dc-a066-e79a4f08b08f admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:38.194503 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d12aa-7929-44dc-a066-e79a4f08b08f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:38.194777 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d12aa-7929-44dc-a066-e79a4f08b08f admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:38.195500 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d12aa-7929-44dc-a066-e79a4f08b08f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:38.197476 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d12aa-7929-44dc-a066-e79a4f08b08f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:38.206922 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1161/2350] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:38 2021] PUT /identity/v3/projects/31b47b7bf2ed4568af16eb7861b78453/users/b2a94d8d27de4c9db7b8f2b1285058ac/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:35:38.206922 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0ce47-6800-43e5-92a4-aa8d4645ebbc None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:38.206922 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0ce47-6800-43e5-92a4-aa8d4645ebbc None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:38.206922 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0ce47-6800-43e5-92a4-aa8d4645ebbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:38.222442 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-63b0ce47-6800-43e5-92a4-aa8d4645ebbc None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:38.223658 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-63b0ce47-6800-43e5-92a4-aa8d4645ebbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:38.287014 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1162/2351] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:38.298172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0ce47-6800-43e5-92a4-aa8d4645ebbc None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:38.299418 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1190/2352] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:35:38 2021] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:38.299990 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-63b0ce47-6800-43e5-92a4-aa8d4645ebbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:38.307181 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d12aa-7929-44dc-a066-e79a4f08b08f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:38.317359 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d12aa-7929-44dc-a066-e79a4f08b08f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:38.323375 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd7590-6c2f-40cb-a1cb-319ce49ce196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:38.324209 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd7590-6c2f-40cb-a1cb-319ce49ce196 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:38.324492 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd7590-6c2f-40cb-a1cb-319ce49ce196 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:38.325044 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd7590-6c2f-40cb-a1cb-319ce49ce196 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:38.325524 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd7590-6c2f-40cb-a1cb-319ce49ce196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:38.328160 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd7590-6c2f-40cb-a1cb-319ce49ce196 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:38.339765 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1191/2353] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:38 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:38.344605 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd7590-6c2f-40cb-a1cb-319ce49ce196 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:38.356426 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd7590-6c2f-40cb-a1cb-319ce49ce196 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:38.362463 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a32aa-e7f3-488d-987a-b1fb115be2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:38.362463 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a32aa-e7f3-488d-987a-b1fb115be2fd admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:38.362463 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a32aa-e7f3-488d-987a-b1fb115be2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:38.362932 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a32aa-e7f3-488d-987a-b1fb115be2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:38.363496 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a32aa-e7f3-488d-987a-b1fb115be2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:38.364758 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0ce47-6800-43e5-92a4-aa8d4645ebbc None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:38.365144 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a32aa-e7f3-488d-987a-b1fb115be2fd admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:38.370348 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffeea88-c028-469c-aeb0-37326dcd6b01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:38.371163 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffeea88-c028-469c-aeb0-37326dcd6b01 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:38.371451 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffeea88-c028-469c-aeb0-37326dcd6b01 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:38.372226 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffeea88-c028-469c-aeb0-37326dcd6b01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:38.381123 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1192/2354] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:38 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:35:38.383820 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a32aa-e7f3-488d-987a-b1fb115be2fd admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:38.385791 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffeea88-c028-469c-aeb0-37326dcd6b01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:38.387943 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffeea88-c028-469c-aeb0-37326dcd6b01 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:38.393555 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a32aa-e7f3-488d-987a-b1fb115be2fd admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:38.400808 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9014f53-8d52-4213-b3d0-4adec468970d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:38.401756 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9014f53-8d52-4213-b3d0-4adec468970d admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:38.402022 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9014f53-8d52-4213-b3d0-4adec468970d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:38.402301 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9014f53-8d52-4213-b3d0-4adec468970d admin admin] PATH_INFO: `/v3/projects/0c906f0891a04908acd7dc34d1953279/users/34172ab8bb0942fda2a6aeda56a3bf21/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:38.415539 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1163/2355] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:38.424264 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9014f53-8d52-4213-b3d0-4adec468970d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c906f0891a04908acd7dc34d1953279, user_id=34172ab8bb0942fda2a6aeda56a3bf21, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:38.427422 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9014f53-8d52-4213-b3d0-4adec468970d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:38.506298 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1193/2356] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:38 2021] PUT /identity/v3/projects/0c906f0891a04908acd7dc34d1953279/users/34172ab8bb0942fda2a6aeda56a3bf21/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:35:38.511348 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701f585-fa6d-4f72-8821-4da760eb6d32 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:38.511599 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701f585-fa6d-4f72-8821-4da760eb6d32 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:38.511870 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701f585-fa6d-4f72-8821-4da760eb6d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:38.529089 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-0701f585-fa6d-4f72-8821-4da760eb6d32 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:38.530826 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-0701f585-fa6d-4f72-8821-4da760eb6d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:38.595789 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1164/2357] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:38.611138 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9014f53-8d52-4213-b3d0-4adec468970d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:38.669050 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9014f53-8d52-4213-b3d0-4adec468970d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:38.673589 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf94c0-28c3-48a7-8bcd-321bb9148dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:38.674410 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf94c0-28c3-48a7-8bcd-321bb9148dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:38.674976 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf94c0-28c3-48a7-8bcd-321bb9148dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:38.675597 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf94c0-28c3-48a7-8bcd-321bb9148dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:38.686380 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf94c0-28c3-48a7-8bcd-321bb9148dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:38.688169 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf94c0-28c3-48a7-8bcd-321bb9148dc6 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:38.698736 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1194/2358] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:40.567444 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db4ecf-e554-482b-b383-be1c66d94ba4 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:40.568012 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db4ecf-e554-482b-b383-be1c66d94ba4 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:40.568012 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db4ecf-e554-482b-b383-be1c66d94ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:40.600300 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-e8db4ecf-e554-482b-b383-be1c66d94ba4 None None] MFA Rules not processed for user `b2a94d8d27de4c9db7b8f2b1285058ac`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:40.602143 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e8db4ecf-e554-482b-b383-be1c66d94ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:40.768342 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1165/2359] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:40 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:40.782199 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf94c0-28c3-48a7-8bcd-321bb9148dc6 service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:40.908923 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf94c0-28c3-48a7-8bcd-321bb9148dc6 service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:40.918112 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58353a-9685-423f-8b0c-83fadf946c91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:40.918717 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58353a-9685-423f-8b0c-83fadf946c91 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:40.919008 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58353a-9685-423f-8b0c-83fadf946c91 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:40.919299 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58353a-9685-423f-8b0c-83fadf946c91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:40.933515 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58353a-9685-423f-8b0c-83fadf946c91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:40.935585 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58353a-9685-423f-8b0c-83fadf946c91 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:40.948703 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1195/2360] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:40 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:42.607187 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db4ecf-e554-482b-b383-be1c66d94ba4 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:42.609504 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e8db4ecf-e554-482b-b383-be1c66d94ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:42.722343 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db4ecf-e554-482b-b383-be1c66d94ba4 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:42.729696 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15be7cb-0a74-4a8a-8c4b-2e7ec60ae68e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:42.730613 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15be7cb-0a74-4a8a-8c4b-2e7ec60ae68e service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:42.731082 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15be7cb-0a74-4a8a-8c4b-2e7ec60ae68e service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:42.731522 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15be7cb-0a74-4a8a-8c4b-2e7ec60ae68e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:42.733971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-c15be7cb-0a74-4a8a-8c4b-2e7ec60ae68e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:42.749726 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15be7cb-0a74-4a8a-8c4b-2e7ec60ae68e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:42.755805 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15be7cb-0a74-4a8a-8c4b-2e7ec60ae68e service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:42.791481 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1166/2361] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:42 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:42.844649 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58353a-9685-423f-8b0c-83fadf946c91 service cinder] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:42.846463 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-2b58353a-9685-423f-8b0c-83fadf946c91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:42.864512 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58353a-9685-423f-8b0c-83fadf946c91 service cinder] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:42.874790 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098608e8-ad30-4f68-85b4-46b78b7bc546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:42.875674 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098608e8-ad30-4f68-85b4-46b78b7bc546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:42.875952 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098608e8-ad30-4f68-85b4-46b78b7bc546 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:42.876223 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098608e8-ad30-4f68-85b4-46b78b7bc546 admin admin] PATH_INFO: `/v3/users/5c4e8b50b9b145aba89e946041436590` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:42.878380 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098608e8-ad30-4f68-85b4-46b78b7bc546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c4e8b50b9b145aba89e946041436590)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:42.887445 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098608e8-ad30-4f68-85b4-46b78b7bc546 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:42.957897 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da24ae7-20c9-43b5-99e2-dae8e8b2a9c4 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:42.958109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da24ae7-20c9-43b5-99e2-dae8e8b2a9c4 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:42.958392 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da24ae7-20c9-43b5-99e2-dae8e8b2a9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:42.989238 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-6da24ae7-20c9-43b5-99e2-dae8e8b2a9c4 None None] MFA Rules not processed for user `b2a94d8d27de4c9db7b8f2b1285058ac`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:42.991043 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-6da24ae7-20c9-43b5-99e2-dae8e8b2a9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:43.001734 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1167/2362] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:42 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:43.197672 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-098608e8-ad30-4f68-85b4-46b78b7bc546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c4e8b50b9b145aba89e946041436590'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:43.217366 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-098608e8-ad30-4f68-85b4-46b78b7bc546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c4e8b50b9b145aba89e946041436590'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:43.231030 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-098608e8-ad30-4f68-85b4-46b78b7bc546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c4e8b50b9b145aba89e946041436590'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:43.234640 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-098608e8-ad30-4f68-85b4-46b78b7bc546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c4e8b50b9b145aba89e946041436590'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:43.324705 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-098608e8-ad30-4f68-85b4-46b78b7bc546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c4e8b50b9b145aba89e946041436590'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:43.337959 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1196/2363] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:42 2021] DELETE /identity/v3/users/5c4e8b50b9b145aba89e946041436590 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:43.340003 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04d0d0-6b9e-444d-acfd-027341c8c375 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:43.340302 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04d0d0-6b9e-444d-acfd-027341c8c375 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:43.340580 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04d0d0-6b9e-444d-acfd-027341c8c375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:43.366567 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-1a04d0d0-6b9e-444d-acfd-027341c8c375 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:43.372771 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1a04d0d0-6b9e-444d-acfd-027341c8c375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:43.463588 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1168/2364] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:43.487832 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098608e8-ad30-4f68-85b4-46b78b7bc546 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:43.489594 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-098608e8-ad30-4f68-85b4-46b78b7bc546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:43.567047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098608e8-ad30-4f68-85b4-46b78b7bc546 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:43.572434 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209598b5-4042-4e8f-b6ad-c5a55a19a77b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:43.574030 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209598b5-4042-4e8f-b6ad-c5a55a19a77b service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:43.574483 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209598b5-4042-4e8f-b6ad-c5a55a19a77b service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:43.574952 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209598b5-4042-4e8f-b6ad-c5a55a19a77b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:43.609228 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209598b5-4042-4e8f-b6ad-c5a55a19a77b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:43.609909 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209598b5-4042-4e8f-b6ad-c5a55a19a77b service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:43.632661 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1197/2365] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:44.587858 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04d0d0-6b9e-444d-acfd-027341c8c375 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:44.592771 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1a04d0d0-6b9e-444d-acfd-027341c8c375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:44.604555 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04d0d0-6b9e-444d-acfd-027341c8c375 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:44.610429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988cf68-f43a-4d17-93d5-9b974ed68670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:44.611326 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988cf68-f43a-4d17-93d5-9b974ed68670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:44.611653 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988cf68-f43a-4d17-93d5-9b974ed68670 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:44.611929 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988cf68-f43a-4d17-93d5-9b974ed68670 admin admin] PATH_INFO: `/v3/projects/0c6687d781bd4f86b5051f03f5d19375` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:44.613217 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988cf68-f43a-4d17-93d5-9b974ed68670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c6687d781bd4f86b5051f03f5d19375)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:44.615612 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988cf68-f43a-4d17-93d5-9b974ed68670 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:44.770487 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-e988cf68-f43a-4d17-93d5-9b974ed68670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c6687d781bd4f86b5051f03f5d19375', 'request_id': 'req-e988cf68-f43a-4d17-93d5-9b974ed68670'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:44.776562 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-e988cf68-f43a-4d17-93d5-9b974ed68670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c6687d781bd4f86b5051f03f5d19375', 'request_id': 'req-e988cf68-f43a-4d17-93d5-9b974ed68670'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:44.842297 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-e988cf68-f43a-4d17-93d5-9b974ed68670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c6687d781bd4f86b5051f03f5d19375', 'request_id': 'req-e988cf68-f43a-4d17-93d5-9b974ed68670'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:44.854578 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-e988cf68-f43a-4d17-93d5-9b974ed68670 admin admin] The token cache is being invalidate because project 0c6687d781bd4f86b5051f03f5d19375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:44.854896 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-e988cf68-f43a-4d17-93d5-9b974ed68670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:44.855531 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-e988cf68-f43a-4d17-93d5-9b974ed68670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:44.857352 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1169/2366] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:44 2021] DELETE /identity/v3/projects/0c6687d781bd4f86b5051f03f5d19375 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:44.861714 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209598b5-4042-4e8f-b6ad-c5a55a19a77b service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:44.874963 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209598b5-4042-4e8f-b6ad-c5a55a19a77b service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:44.992245 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27035ecf-de64-419d-8f90-8604a9651fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:44.993449 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27035ecf-de64-419d-8f90-8604a9651fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:44.993933 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27035ecf-de64-419d-8f90-8604a9651fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:44.997660 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27035ecf-de64-419d-8f90-8604a9651fdc admin admin] PATH_INFO: `/v3/users/b503931ee233405b864100838067badc` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:44.997660 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27035ecf-de64-419d-8f90-8604a9651fdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b503931ee233405b864100838067badc)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:44.998394 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27035ecf-de64-419d-8f90-8604a9651fdc admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:45.263906 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-27035ecf-de64-419d-8f90-8604a9651fdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b503931ee233405b864100838067badc'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:45.278091 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-27035ecf-de64-419d-8f90-8604a9651fdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b503931ee233405b864100838067badc'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:45.291928 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-27035ecf-de64-419d-8f90-8604a9651fdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b503931ee233405b864100838067badc'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:45.295564 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-27035ecf-de64-419d-8f90-8604a9651fdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b503931ee233405b864100838067badc'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:45.373858 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-27035ecf-de64-419d-8f90-8604a9651fdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b503931ee233405b864100838067badc'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:45.382173 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1198/2367] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:44 2021] DELETE /identity/v3/users/b503931ee233405b864100838067badc => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:35:46.016577 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988cf68-f43a-4d17-93d5-9b974ed68670 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:46.019407 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e988cf68-f43a-4d17-93d5-9b974ed68670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:46.055295 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988cf68-f43a-4d17-93d5-9b974ed68670 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:46.136664 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e2145-3492-4431-95d5-7f3de8b08b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:46.137880 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e2145-3492-4431-95d5-7f3de8b08b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:46.138330 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e2145-3492-4431-95d5-7f3de8b08b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:46.138753 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e2145-3492-4431-95d5-7f3de8b08b5b admin admin] PATH_INFO: `/v3/projects/7c3976fd603046b89654735a9c43ea80` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:46.141014 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e2145-3492-4431-95d5-7f3de8b08b5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c3976fd603046b89654735a9c43ea80)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:46.143438 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e2145-3492-4431-95d5-7f3de8b08b5b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:46.282493 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-995e2145-3492-4431-95d5-7f3de8b08b5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c3976fd603046b89654735a9c43ea80', 'request_id': 'req-995e2145-3492-4431-95d5-7f3de8b08b5b'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:46.297004 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-995e2145-3492-4431-95d5-7f3de8b08b5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c3976fd603046b89654735a9c43ea80', 'request_id': 'req-995e2145-3492-4431-95d5-7f3de8b08b5b'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:46.399172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-995e2145-3492-4431-95d5-7f3de8b08b5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c3976fd603046b89654735a9c43ea80', 'request_id': 'req-995e2145-3492-4431-95d5-7f3de8b08b5b'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:46.418057 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-995e2145-3492-4431-95d5-7f3de8b08b5b admin admin] The token cache is being invalidate because project 7c3976fd603046b89654735a9c43ea80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:46.426464 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-995e2145-3492-4431-95d5-7f3de8b08b5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:46.429343 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-995e2145-3492-4431-95d5-7f3de8b08b5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:46.431925 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1170/2368] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:46 2021] DELETE /identity/v3/projects/7c3976fd603046b89654735a9c43ea80 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:46.441341 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27035ecf-de64-419d-8f90-8604a9651fdc admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:46.443576 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-27035ecf-de64-419d-8f90-8604a9651fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:46.463771 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27035ecf-de64-419d-8f90-8604a9651fdc admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:46.559181 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58bc7d-ae95-4987-9502-e47aafddbf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:46.560159 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58bc7d-ae95-4987-9502-e47aafddbf74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:46.560745 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58bc7d-ae95-4987-9502-e47aafddbf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:46.564554 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58bc7d-ae95-4987-9502-e47aafddbf74 admin admin] PATH_INFO: `/v3/users/e352c576c29c403ca2ed20f84839e0d7` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:46.567986 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58bc7d-ae95-4987-9502-e47aafddbf74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e352c576c29c403ca2ed20f84839e0d7)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:46.571230 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58bc7d-ae95-4987-9502-e47aafddbf74 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:46.585840 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658499f-b760-49ba-9ac3-b858fe286365 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:46.586262 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658499f-b760-49ba-9ac3-b858fe286365 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:46.587133 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658499f-b760-49ba-9ac3-b858fe286365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:46.626436 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-1658499f-b760-49ba-9ac3-b858fe286365 None None] MFA Rules not processed for user `34172ab8bb0942fda2a6aeda56a3bf21`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:46.628446 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1658499f-b760-49ba-9ac3-b858fe286365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:46.699409 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1171/2369] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:46 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:46.704460 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658499f-b760-49ba-9ac3-b858fe286365 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:46.705758 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1658499f-b760-49ba-9ac3-b858fe286365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:46.719992 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658499f-b760-49ba-9ac3-b858fe286365 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:46.724753 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619fafc-c8aa-43a4-9e45-75f62a9ca5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:46.725455 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619fafc-c8aa-43a4-9e45-75f62a9ca5fe admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:46.725732 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619fafc-c8aa-43a4-9e45-75f62a9ca5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:46.726037 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619fafc-c8aa-43a4-9e45-75f62a9ca5fe admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:46.726739 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619fafc-c8aa-43a4-9e45-75f62a9ca5fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:46.728637 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619fafc-c8aa-43a4-9e45-75f62a9ca5fe admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:46.799871 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-fc58bc7d-ae95-4987-9502-e47aafddbf74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e352c576c29c403ca2ed20f84839e0d7'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:46.811914 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-fc58bc7d-ae95-4987-9502-e47aafddbf74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e352c576c29c403ca2ed20f84839e0d7'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:46.821752 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-fc58bc7d-ae95-4987-9502-e47aafddbf74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e352c576c29c403ca2ed20f84839e0d7'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:46.822610 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-fc58bc7d-ae95-4987-9502-e47aafddbf74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e352c576c29c403ca2ed20f84839e0d7'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:46.824106 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1172/2370] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:46 2021] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:46.828904 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619fafc-c8aa-43a4-9e45-75f62a9ca5fe admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:46.908575 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619fafc-c8aa-43a4-9e45-75f62a9ca5fe admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:46.913585 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d6bd9-5ce2-4d50-b8cb-ff34812f9938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:46.914331 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d6bd9-5ce2-4d50-b8cb-ff34812f9938 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:46.914620 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d6bd9-5ce2-4d50-b8cb-ff34812f9938 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:46.914892 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d6bd9-5ce2-4d50-b8cb-ff34812f9938 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:46.915887 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d6bd9-5ce2-4d50-b8cb-ff34812f9938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:46.917843 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d6bd9-5ce2-4d50-b8cb-ff34812f9938 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:46.934809 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-fc58bc7d-ae95-4987-9502-e47aafddbf74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e352c576c29c403ca2ed20f84839e0d7'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:46.942231 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1199/2371] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:46 2021] DELETE /identity/v3/users/e352c576c29c403ca2ed20f84839e0d7 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:47.060217 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1173/2372] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:35:46 2021] POST /identity/v3/users => generated 298 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:47.067194 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58bc7d-ae95-4987-9502-e47aafddbf74 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:47.074875 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-fc58bc7d-ae95-4987-9502-e47aafddbf74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:47.161972 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58bc7d-ae95-4987-9502-e47aafddbf74 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:47.167395 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6835b-2224-48c4-b530-b1c5e019ee93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:47.168100 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6835b-2224-48c4-b530-b1c5e019ee93 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:47.169005 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6835b-2224-48c4-b530-b1c5e019ee93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:47.169269 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6835b-2224-48c4-b530-b1c5e019ee93 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:47.170010 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6835b-2224-48c4-b530-b1c5e019ee93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:47.172774 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6835b-2224-48c4-b530-b1c5e019ee93 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:47.185853 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1200/2373] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:47 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:47.191408 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d6bd9-5ce2-4d50-b8cb-ff34812f9938 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:47.202674 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d6bd9-5ce2-4d50-b8cb-ff34812f9938 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:47.221810 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80628ca-ec0a-4d0b-9d9b-a425a3acac64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:47.223456 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80628ca-ec0a-4d0b-9d9b-a425a3acac64 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:47.225225 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80628ca-ec0a-4d0b-9d9b-a425a3acac64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:47.225743 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80628ca-ec0a-4d0b-9d9b-a425a3acac64 admin admin] PATH_INFO: `/v3/projects/81a1b072067240c39a1dd275789d04b5/users/ae86afc9d10c45bb87afd7ccef20db9c/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:47.259660 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80628ca-ec0a-4d0b-9d9b-a425a3acac64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a1b072067240c39a1dd275789d04b5, user_id=ae86afc9d10c45bb87afd7ccef20db9c, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:47.262911 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80628ca-ec0a-4d0b-9d9b-a425a3acac64 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:47.372729 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1174/2374] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:47 2021] PUT /identity/v3/projects/81a1b072067240c39a1dd275789d04b5/users/ae86afc9d10c45bb87afd7ccef20db9c/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:35:47.377327 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6835b-2224-48c4-b530-b1c5e019ee93 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:47.388795 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6835b-2224-48c4-b530-b1c5e019ee93 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:47.472149 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18769103-89a7-4c7b-bb48-0198f3f02ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:47.472884 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18769103-89a7-4c7b-bb48-0198f3f02ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:47.473127 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18769103-89a7-4c7b-bb48-0198f3f02ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:47.473398 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18769103-89a7-4c7b-bb48-0198f3f02ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:47.474122 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18769103-89a7-4c7b-bb48-0198f3f02ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:47.475768 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18769103-89a7-4c7b-bb48-0198f3f02ff0 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:47.487044 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1201/2375] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:47 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:35:47.491531 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80628ca-ec0a-4d0b-9d9b-a425a3acac64 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:47.503451 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80628ca-ec0a-4d0b-9d9b-a425a3acac64 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:47.510771 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217eb9b6-f746-48ac-802a-61a7ec14d2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:47.511886 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eb9b6-f746-48ac-802a-61a7ec14d2c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:47.512173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eb9b6-f746-48ac-802a-61a7ec14d2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:47.512472 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eb9b6-f746-48ac-802a-61a7ec14d2c2 admin admin] PATH_INFO: `/v3/projects/81a1b072067240c39a1dd275789d04b5/users/ae86afc9d10c45bb87afd7ccef20db9c/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:47.515258 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217eb9b6-f746-48ac-802a-61a7ec14d2c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a1b072067240c39a1dd275789d04b5, user_id=ae86afc9d10c45bb87afd7ccef20db9c, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:47.518167 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217eb9b6-f746-48ac-802a-61a7ec14d2c2 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:47.530379 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1175/2376] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:47 2021] PUT /identity/v3/projects/81a1b072067240c39a1dd275789d04b5/users/ae86afc9d10c45bb87afd7ccef20db9c/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:47.540381 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18769103-89a7-4c7b-bb48-0198f3f02ff0 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:47.542235 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-18769103-89a7-4c7b-bb48-0198f3f02ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:47.557187 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18769103-89a7-4c7b-bb48-0198f3f02ff0 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:47.635842 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb255b9-0379-473f-aabd-8fc7f435bd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:47.637418 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb255b9-0379-473f-aabd-8fc7f435bd93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:47.637713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb255b9-0379-473f-aabd-8fc7f435bd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:47.638005 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb255b9-0379-473f-aabd-8fc7f435bd93 admin admin] PATH_INFO: `/v3/projects/afab829bdd254f74b2b1887b667567f4` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:47.641713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb255b9-0379-473f-aabd-8fc7f435bd93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afab829bdd254f74b2b1887b667567f4)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:47.644198 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb255b9-0379-473f-aabd-8fc7f435bd93 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:47.761112 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-1eb255b9-0379-473f-aabd-8fc7f435bd93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afab829bdd254f74b2b1887b667567f4', 'request_id': 'req-1eb255b9-0379-473f-aabd-8fc7f435bd93'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:47.777253 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-1eb255b9-0379-473f-aabd-8fc7f435bd93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afab829bdd254f74b2b1887b667567f4', 'request_id': 'req-1eb255b9-0379-473f-aabd-8fc7f435bd93'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:47.927848 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-1eb255b9-0379-473f-aabd-8fc7f435bd93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afab829bdd254f74b2b1887b667567f4', 'request_id': 'req-1eb255b9-0379-473f-aabd-8fc7f435bd93'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:47.940507 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-1eb255b9-0379-473f-aabd-8fc7f435bd93 admin admin] The token cache is being invalidate because project afab829bdd254f74b2b1887b667567f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:47.941635 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-1eb255b9-0379-473f-aabd-8fc7f435bd93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:47.941635 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-1eb255b9-0379-473f-aabd-8fc7f435bd93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:47.943241 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1202/2377] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:47 2021] DELETE /identity/v3/projects/afab829bdd254f74b2b1887b667567f4 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:47.950108 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ad991-c56b-4098-a80f-caba35c34964 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:47.950422 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ad991-c56b-4098-a80f-caba35c34964 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:47.950700 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ad991-c56b-4098-a80f-caba35c34964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:47.970028 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-914ad991-c56b-4098-a80f-caba35c34964 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:47.971245 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-914ad991-c56b-4098-a80f-caba35c34964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:48.039347 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1176/2378] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:48.053046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b73be-b911-41b2-adf0-ce14753003c7 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:48.055598 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b73be-b911-41b2-adf0-ce14753003c7 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:48.055598 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b73be-b911-41b2-adf0-ce14753003c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:48.073747 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-dc0b73be-b911-41b2-adf0-ce14753003c7 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:48.075109 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-dc0b73be-b911-41b2-adf0-ce14753003c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:48.084219 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1203/2379] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:48.088760 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ad991-c56b-4098-a80f-caba35c34964 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:48.099932 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ad991-c56b-4098-a80f-caba35c34964 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:48.105518 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6c2ac-005c-4f56-a467-9148b6a50b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:48.106511 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6c2ac-005c-4f56-a467-9148b6a50b39 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:48.106951 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6c2ac-005c-4f56-a467-9148b6a50b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:48.107493 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6c2ac-005c-4f56-a467-9148b6a50b39 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:48.109015 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6c2ac-005c-4f56-a467-9148b6a50b39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:35:48.109653 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6c2ac-005c-4f56-a467-9148b6a50b39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:48.111493 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6c2ac-005c-4f56-a467-9148b6a50b39 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:48.130182 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1177/2380] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:35:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:35:48.131573 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b73be-b911-41b2-adf0-ce14753003c7 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:48.142051 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b73be-b911-41b2-adf0-ce14753003c7 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:48.147516 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30123c21-c9d9-48d2-9371-5747571e7f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:48.148548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30123c21-c9d9-48d2-9371-5747571e7f04 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:48.149072 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30123c21-c9d9-48d2-9371-5747571e7f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:48.149737 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30123c21-c9d9-48d2-9371-5747571e7f04 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:48.151427 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30123c21-c9d9-48d2-9371-5747571e7f04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:48.153600 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30123c21-c9d9-48d2-9371-5747571e7f04 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:48.275414 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1204/2381] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:48 2021] POST /identity/v3/projects => generated 389 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:48.276814 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6c2ac-005c-4f56-a467-9148b6a50b39 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:48.292667 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6c2ac-005c-4f56-a467-9148b6a50b39 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:48.382049 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24cbc7-d0aa-487d-9f2f-2c6f5d4cd500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:48.383978 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24cbc7-d0aa-487d-9f2f-2c6f5d4cd500 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:48.385068 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24cbc7-d0aa-487d-9f2f-2c6f5d4cd500 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:48.385933 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24cbc7-d0aa-487d-9f2f-2c6f5d4cd500 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:48.387143 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24cbc7-d0aa-487d-9f2f-2c6f5d4cd500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:48.395978 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24cbc7-d0aa-487d-9f2f-2c6f5d4cd500 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:48.493979 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1178/2382] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:35:48 2021] POST /identity/v3/users => generated 295 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:48.494983 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30123c21-c9d9-48d2-9371-5747571e7f04 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:48.510717 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30123c21-c9d9-48d2-9371-5747571e7f04 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:48.516379 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef577cf-3ae8-4d59-b63d-e74f72443780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:48.520735 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef577cf-3ae8-4d59-b63d-e74f72443780 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:48.520735 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef577cf-3ae8-4d59-b63d-e74f72443780 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:48.520735 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef577cf-3ae8-4d59-b63d-e74f72443780 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:48.520735 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef577cf-3ae8-4d59-b63d-e74f72443780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:48.520735 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef577cf-3ae8-4d59-b63d-e74f72443780 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:48.534609 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1205/2383] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:48 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:48.539354 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24cbc7-d0aa-487d-9f2f-2c6f5d4cd500 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:48.555110 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24cbc7-d0aa-487d-9f2f-2c6f5d4cd500 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:48.563342 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9f6bd-7d54-43d2-b5cd-11e1f4d641ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:48.565800 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9f6bd-7d54-43d2-b5cd-11e1f4d641ca admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:48.566086 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9f6bd-7d54-43d2-b5cd-11e1f4d641ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:48.566361 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9f6bd-7d54-43d2-b5cd-11e1f4d641ca admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:48.567160 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9f6bd-7d54-43d2-b5cd-11e1f4d641ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:48.569012 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9f6bd-7d54-43d2-b5cd-11e1f4d641ca admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:48.587890 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1179/2384] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:48 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:35:48.592325 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef577cf-3ae8-4d59-b63d-e74f72443780 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:48.603726 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef577cf-3ae8-4d59-b63d-e74f72443780 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:48.611713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529100af-71f4-4c24-afe2-2b635d605618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:48.611713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529100af-71f4-4c24-afe2-2b635d605618 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:48.611713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529100af-71f4-4c24-afe2-2b635d605618 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:48.611713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529100af-71f4-4c24-afe2-2b635d605618 admin admin] PATH_INFO: `/v3/projects/6131929f2c1d40a5903a4f7a19b45855/users/84263d44d47b46ec9806b06b38dbb0e5/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:48.634949 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529100af-71f4-4c24-afe2-2b635d605618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6131929f2c1d40a5903a4f7a19b45855, user_id=84263d44d47b46ec9806b06b38dbb0e5, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:48.638127 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529100af-71f4-4c24-afe2-2b635d605618 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:48.737652 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1206/2385] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:48 2021] PUT /identity/v3/projects/6131929f2c1d40a5903a4f7a19b45855/users/84263d44d47b46ec9806b06b38dbb0e5/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:48.749470 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62330bc3-a0a9-4358-a94b-6e0b538bb0b3 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:48.749946 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62330bc3-a0a9-4358-a94b-6e0b538bb0b3 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:48.749946 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62330bc3-a0a9-4358-a94b-6e0b538bb0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:48.784925 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-62330bc3-a0a9-4358-a94b-6e0b538bb0b3 None None] MFA Rules not processed for user `84263d44d47b46ec9806b06b38dbb0e5`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:48.789402 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-62330bc3-a0a9-4358-a94b-6e0b538bb0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:48.903702 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1180/2386] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:48 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:48.905182 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529100af-71f4-4c24-afe2-2b635d605618 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:49.047728 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529100af-71f4-4c24-afe2-2b635d605618 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:49.054698 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873dca7-ea53-4d1e-805b-33da4e362758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:49.055571 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873dca7-ea53-4d1e-805b-33da4e362758 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:49.055859 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873dca7-ea53-4d1e-805b-33da4e362758 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:49.056141 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873dca7-ea53-4d1e-805b-33da4e362758 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:49.056948 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873dca7-ea53-4d1e-805b-33da4e362758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:49.059911 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873dca7-ea53-4d1e-805b-33da4e362758 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:49.190212 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1207/2387] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:48 2021] POST /identity/v3/projects => generated 389 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:35:49.194289 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62330bc3-a0a9-4358-a94b-6e0b538bb0b3 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:49.205525 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62330bc3-a0a9-4358-a94b-6e0b538bb0b3 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:49.282767 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58814e3b-3294-472b-a741-e7c19b62a7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:49.283583 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58814e3b-3294-472b-a741-e7c19b62a7d7 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:49.284050 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58814e3b-3294-472b-a741-e7c19b62a7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:49.284320 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58814e3b-3294-472b-a741-e7c19b62a7d7 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:49.285061 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58814e3b-3294-472b-a741-e7c19b62a7d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:49.287149 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58814e3b-3294-472b-a741-e7c19b62a7d7 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:49.394788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1181/2388] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:35:49 2021] POST /identity/v3/users => generated 301 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:35:49.408425 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873dca7-ea53-4d1e-805b-33da4e362758 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:49.427755 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873dca7-ea53-4d1e-805b-33da4e362758 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:49.442898 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714ff1c-20ee-4ab8-b5ea-a7f214491008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:49.445495 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714ff1c-20ee-4ab8-b5ea-a7f214491008 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:49.446165 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714ff1c-20ee-4ab8-b5ea-a7f214491008 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:49.447999 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714ff1c-20ee-4ab8-b5ea-a7f214491008 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:49.448995 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714ff1c-20ee-4ab8-b5ea-a7f214491008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:49.450793 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714ff1c-20ee-4ab8-b5ea-a7f214491008 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:49.466036 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1208/2389] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:49 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:49.472193 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58814e3b-3294-472b-a741-e7c19b62a7d7 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:49.487722 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58814e3b-3294-472b-a741-e7c19b62a7d7 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:49.504105 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b7430-1cc7-47c7-9736-17f17508c402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:49.504688 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b7430-1cc7-47c7-9736-17f17508c402 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:49.505002 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b7430-1cc7-47c7-9736-17f17508c402 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:49.505279 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b7430-1cc7-47c7-9736-17f17508c402 admin admin] PATH_INFO: `/v3/projects/8b45b24a9ff04716a76b300e6412f065/users/3adb16fa30594a5eb7050bcaabef0acd/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:49.536714 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b7430-1cc7-47c7-9736-17f17508c402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b45b24a9ff04716a76b300e6412f065, user_id=3adb16fa30594a5eb7050bcaabef0acd, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:49.540806 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b7430-1cc7-47c7-9736-17f17508c402 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:49.597593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1182/2390] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:49 2021] PUT /identity/v3/projects/8b45b24a9ff04716a76b300e6412f065/users/3adb16fa30594a5eb7050bcaabef0acd/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:49.601635 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714ff1c-20ee-4ab8-b5ea-a7f214491008 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:49.614994 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714ff1c-20ee-4ab8-b5ea-a7f214491008 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:49.703276 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd61a3d-cde5-4b03-bddf-8907752b5111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:49.704308 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd61a3d-cde5-4b03-bddf-8907752b5111 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:49.704778 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd61a3d-cde5-4b03-bddf-8907752b5111 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:49.705298 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd61a3d-cde5-4b03-bddf-8907752b5111 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:49.706213 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd61a3d-cde5-4b03-bddf-8907752b5111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:49.708053 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd61a3d-cde5-4b03-bddf-8907752b5111 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:49.719295 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1209/2391] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:49 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:49.724004 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b7430-1cc7-47c7-9736-17f17508c402 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:49.738392 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b7430-1cc7-47c7-9736-17f17508c402 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:49.743925 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc046063-0ee9-4745-a45a-c708000e1c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:49.745158 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc046063-0ee9-4745-a45a-c708000e1c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:49.745649 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc046063-0ee9-4745-a45a-c708000e1c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:49.746324 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc046063-0ee9-4745-a45a-c708000e1c03 admin admin] PATH_INFO: `/v3/projects/8b45b24a9ff04716a76b300e6412f065/users/3adb16fa30594a5eb7050bcaabef0acd/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:49.751923 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc046063-0ee9-4745-a45a-c708000e1c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b45b24a9ff04716a76b300e6412f065, user_id=3adb16fa30594a5eb7050bcaabef0acd, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:49.755218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc046063-0ee9-4745-a45a-c708000e1c03 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:49.787570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1183/2392] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:49 2021] PUT /identity/v3/projects/8b45b24a9ff04716a76b300e6412f065/users/3adb16fa30594a5eb7050bcaabef0acd/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:49.798511 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b47b3-6a82-43af-b30f-93635564bfd4 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:49.798809 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b47b3-6a82-43af-b30f-93635564bfd4 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:49.799078 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b47b3-6a82-43af-b30f-93635564bfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:49.839675 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-c11b47b3-6a82-43af-b30f-93635564bfd4 None None] MFA Rules not processed for user `3adb16fa30594a5eb7050bcaabef0acd`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:49.842122 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c11b47b3-6a82-43af-b30f-93635564bfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:49.953698 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1210/2393] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:49 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:49.965076 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc046063-0ee9-4745-a45a-c708000e1c03 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:49.967684 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-cc046063-0ee9-4745-a45a-c708000e1c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:50.058082 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc046063-0ee9-4745-a45a-c708000e1c03 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:50.069022 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370ef1d-8fc0-4a0e-a03b-4a79dd639537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:50.070458 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370ef1d-8fc0-4a0e-a03b-4a79dd639537 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:50.071016 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370ef1d-8fc0-4a0e-a03b-4a79dd639537 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:50.071420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370ef1d-8fc0-4a0e-a03b-4a79dd639537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:50.088181 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370ef1d-8fc0-4a0e-a03b-4a79dd639537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:50.089860 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370ef1d-8fc0-4a0e-a03b-4a79dd639537 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:50.101432 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1184/2394] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:49 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:50.351825 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b47b3-6a82-43af-b30f-93635564bfd4 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:50.476369 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b47b3-6a82-43af-b30f-93635564bfd4 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:50.481264 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad282884-ed24-4ead-b952-031f1c29b20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:50.482141 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad282884-ed24-4ead-b952-031f1c29b20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:50.482467 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad282884-ed24-4ead-b952-031f1c29b20e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:50.482688 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad282884-ed24-4ead-b952-031f1c29b20e admin admin] PATH_INFO: `/v3/users/84263d44d47b46ec9806b06b38dbb0e5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:50.485473 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad282884-ed24-4ead-b952-031f1c29b20e admin admin] RBAC: Authorizing `identity:delete_user(user_id=84263d44d47b46ec9806b06b38dbb0e5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:50.487393 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad282884-ed24-4ead-b952-031f1c29b20e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:50.698621 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ad282884-ed24-4ead-b952-031f1c29b20e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84263d44d47b46ec9806b06b38dbb0e5'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:50.714556 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ad282884-ed24-4ead-b952-031f1c29b20e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84263d44d47b46ec9806b06b38dbb0e5'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:50.733974 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ad282884-ed24-4ead-b952-031f1c29b20e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84263d44d47b46ec9806b06b38dbb0e5'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:50.734741 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ad282884-ed24-4ead-b952-031f1c29b20e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84263d44d47b46ec9806b06b38dbb0e5'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:50.802043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ad282884-ed24-4ead-b952-031f1c29b20e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84263d44d47b46ec9806b06b38dbb0e5'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:50.816304 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1211/2395] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:50 2021] DELETE /identity/v3/users/84263d44d47b46ec9806b06b38dbb0e5 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:50.818133 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078cb7b-f1da-42c1-9238-c650fd2b423c None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:50.818658 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078cb7b-f1da-42c1-9238-c650fd2b423c None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:50.818955 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078cb7b-f1da-42c1-9238-c650fd2b423c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:50.839460 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-1078cb7b-f1da-42c1-9238-c650fd2b423c None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:50.840801 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1078cb7b-f1da-42c1-9238-c650fd2b423c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:50.908944 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1185/2396] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:50.932540 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad282884-ed24-4ead-b952-031f1c29b20e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:50.936819 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-ad282884-ed24-4ead-b952-031f1c29b20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:51.084961 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad282884-ed24-4ead-b952-031f1c29b20e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:51.091146 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777d34d-f78a-497b-a592-c94cd91462df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:51.092343 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777d34d-f78a-497b-a592-c94cd91462df service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:51.093522 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777d34d-f78a-497b-a592-c94cd91462df service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:51.094401 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777d34d-f78a-497b-a592-c94cd91462df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:51.108464 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777d34d-f78a-497b-a592-c94cd91462df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:51.110514 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777d34d-f78a-497b-a592-c94cd91462df service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:51.123508 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1212/2397] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:35:51.934739 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078cb7b-f1da-42c1-9238-c650fd2b423c None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:51.937241 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1078cb7b-f1da-42c1-9238-c650fd2b423c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:51.952916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078cb7b-f1da-42c1-9238-c650fd2b423c None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:51.961968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c812fae-c6f5-4af4-b7a9-ab26fc5f6625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:51.961968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c812fae-c6f5-4af4-b7a9-ab26fc5f6625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:51.961968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c812fae-c6f5-4af4-b7a9-ab26fc5f6625 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:51.961968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c812fae-c6f5-4af4-b7a9-ab26fc5f6625 admin admin] PATH_INFO: `/v3/projects/6131929f2c1d40a5903a4f7a19b45855` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:51.963433 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c812fae-c6f5-4af4-b7a9-ab26fc5f6625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6131929f2c1d40a5903a4f7a19b45855)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:51.969329 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c812fae-c6f5-4af4-b7a9-ab26fc5f6625 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:52.121831 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-1c812fae-c6f5-4af4-b7a9-ab26fc5f6625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6131929f2c1d40a5903a4f7a19b45855', 'request_id': 'req-1c812fae-c6f5-4af4-b7a9-ab26fc5f6625'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:52.131201 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-1c812fae-c6f5-4af4-b7a9-ab26fc5f6625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6131929f2c1d40a5903a4f7a19b45855', 'request_id': 'req-1c812fae-c6f5-4af4-b7a9-ab26fc5f6625'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:52.191251 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-1c812fae-c6f5-4af4-b7a9-ab26fc5f6625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6131929f2c1d40a5903a4f7a19b45855', 'request_id': 'req-1c812fae-c6f5-4af4-b7a9-ab26fc5f6625'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:52.213370 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-1c812fae-c6f5-4af4-b7a9-ab26fc5f6625 admin admin] The token cache is being invalidate because project 6131929f2c1d40a5903a4f7a19b45855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:52.213677 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-1c812fae-c6f5-4af4-b7a9-ab26fc5f6625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:52.214511 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-1c812fae-c6f5-4af4-b7a9-ab26fc5f6625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:52.216113 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1186/2398] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:51 2021] DELETE /identity/v3/projects/6131929f2c1d40a5903a4f7a19b45855 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:52.220345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777d34d-f78a-497b-a592-c94cd91462df service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:52.231945 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777d34d-f78a-497b-a592-c94cd91462df service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:52.404742 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf7b1c-7bf8-4943-849b-82c63db3a483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:52.406846 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf7b1c-7bf8-4943-849b-82c63db3a483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:52.407287 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf7b1c-7bf8-4943-849b-82c63db3a483 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:52.407714 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf7b1c-7bf8-4943-849b-82c63db3a483 admin admin] PATH_INFO: `/v3/users/3adb16fa30594a5eb7050bcaabef0acd` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:52.410144 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf7b1c-7bf8-4943-849b-82c63db3a483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3adb16fa30594a5eb7050bcaabef0acd)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:52.426257 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf7b1c-7bf8-4943-849b-82c63db3a483 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:52.701505 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-2ccf7b1c-7bf8-4943-849b-82c63db3a483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3adb16fa30594a5eb7050bcaabef0acd'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:52.732076 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-2ccf7b1c-7bf8-4943-849b-82c63db3a483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3adb16fa30594a5eb7050bcaabef0acd'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:52.747887 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-2ccf7b1c-7bf8-4943-849b-82c63db3a483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3adb16fa30594a5eb7050bcaabef0acd'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:52.749377 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-2ccf7b1c-7bf8-4943-849b-82c63db3a483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3adb16fa30594a5eb7050bcaabef0acd'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:52.819942 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-2ccf7b1c-7bf8-4943-849b-82c63db3a483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3adb16fa30594a5eb7050bcaabef0acd'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:52.829903 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1213/2399] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:52 2021] DELETE /identity/v3/users/3adb16fa30594a5eb7050bcaabef0acd => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:53.645969 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c812fae-c6f5-4af4-b7a9-ab26fc5f6625 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:53.648366 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1c812fae-c6f5-4af4-b7a9-ab26fc5f6625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:53.679011 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c812fae-c6f5-4af4-b7a9-ab26fc5f6625 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:53.767978 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15527faa-24c9-474d-8f7a-d647ee235c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:53.768826 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15527faa-24c9-474d-8f7a-d647ee235c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:53.769151 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15527faa-24c9-474d-8f7a-d647ee235c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:53.769426 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15527faa-24c9-474d-8f7a-d647ee235c1b admin admin] PATH_INFO: `/v3/projects/8b45b24a9ff04716a76b300e6412f065` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:53.770789 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15527faa-24c9-474d-8f7a-d647ee235c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b45b24a9ff04716a76b300e6412f065)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:53.773178 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15527faa-24c9-474d-8f7a-d647ee235c1b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:53.899225 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-15527faa-24c9-474d-8f7a-d647ee235c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b45b24a9ff04716a76b300e6412f065', 'request_id': 'req-15527faa-24c9-474d-8f7a-d647ee235c1b'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:53.906194 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-15527faa-24c9-474d-8f7a-d647ee235c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b45b24a9ff04716a76b300e6412f065', 'request_id': 'req-15527faa-24c9-474d-8f7a-d647ee235c1b'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:54.002385 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-15527faa-24c9-474d-8f7a-d647ee235c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b45b24a9ff04716a76b300e6412f065', 'request_id': 'req-15527faa-24c9-474d-8f7a-d647ee235c1b'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:54.018253 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-15527faa-24c9-474d-8f7a-d647ee235c1b admin admin] The token cache is being invalidate because project 8b45b24a9ff04716a76b300e6412f065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:54.018603 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-15527faa-24c9-474d-8f7a-d647ee235c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:54.020052 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-15527faa-24c9-474d-8f7a-d647ee235c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:54.021749 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1187/2400] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:53 2021] DELETE /identity/v3/projects/8b45b24a9ff04716a76b300e6412f065 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:54.028061 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2fb84-0ff4-4b04-8f58-57ae9d171f21 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:54.029322 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2fb84-0ff4-4b04-8f58-57ae9d171f21 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:54.029840 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2fb84-0ff4-4b04-8f58-57ae9d171f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:54.053416 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-5fe2fb84-0ff4-4b04-8f58-57ae9d171f21 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:54.058553 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-5fe2fb84-0ff4-4b04-8f58-57ae9d171f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:54.136128 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1214/2401] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:54.146269 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffa58d-bbc3-4f55-8cdf-8f4354db5383 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:54.146863 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffa58d-bbc3-4f55-8cdf-8f4354db5383 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:54.147265 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffa58d-bbc3-4f55-8cdf-8f4354db5383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:54.169777 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-59ffa58d-bbc3-4f55-8cdf-8f4354db5383 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:54.172767 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-59ffa58d-bbc3-4f55-8cdf-8f4354db5383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:54.182765 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1188/2402] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:54.188209 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2fb84-0ff4-4b04-8f58-57ae9d171f21 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:54.199336 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2fb84-0ff4-4b04-8f58-57ae9d171f21 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:54.223987 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3084274-017f-4fac-a955-a18501183406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:54.224686 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3084274-017f-4fac-a955-a18501183406 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:54.225004 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3084274-017f-4fac-a955-a18501183406 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:54.225259 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3084274-017f-4fac-a955-a18501183406 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:54.225988 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3084274-017f-4fac-a955-a18501183406 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:35:54.226296 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3084274-017f-4fac-a955-a18501183406 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:54.227899 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3084274-017f-4fac-a955-a18501183406 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:54.247167 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1215/2403] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:35:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:35:54.252342 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffa58d-bbc3-4f55-8cdf-8f4354db5383 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:54.265296 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffa58d-bbc3-4f55-8cdf-8f4354db5383 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:54.274788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6056143-cbfd-4e63-8a29-7df5824cc82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:54.277170 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6056143-cbfd-4e63-8a29-7df5824cc82f admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:54.277628 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6056143-cbfd-4e63-8a29-7df5824cc82f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:54.281567 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6056143-cbfd-4e63-8a29-7df5824cc82f admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:54.281567 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6056143-cbfd-4e63-8a29-7df5824cc82f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:54.283241 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6056143-cbfd-4e63-8a29-7df5824cc82f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:54.383832 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1189/2404] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:35:54 2021] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:54.387754 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3084274-017f-4fac-a955-a18501183406 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:54.403938 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3084274-017f-4fac-a955-a18501183406 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:54.489089 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73666e67-01b8-4794-9221-154a463dd01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:54.489778 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73666e67-01b8-4794-9221-154a463dd01b admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:54.492996 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73666e67-01b8-4794-9221-154a463dd01b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:54.492996 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73666e67-01b8-4794-9221-154a463dd01b admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:54.492996 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73666e67-01b8-4794-9221-154a463dd01b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:54.492996 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73666e67-01b8-4794-9221-154a463dd01b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:54.578789 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1216/2405] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:35:54 2021] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:35:54.582692 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6056143-cbfd-4e63-8a29-7df5824cc82f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:54.595209 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6056143-cbfd-4e63-8a29-7df5824cc82f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:54.600379 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9d050-726b-49e9-8474-0f6f9c404eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:54.601336 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9d050-726b-49e9-8474-0f6f9c404eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:54.601845 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9d050-726b-49e9-8474-0f6f9c404eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:54.602478 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9d050-726b-49e9-8474-0f6f9c404eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:54.603524 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9d050-726b-49e9-8474-0f6f9c404eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:54.606055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9d050-726b-49e9-8474-0f6f9c404eb5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:54.623700 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1190/2406] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:54 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:54.624356 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73666e67-01b8-4794-9221-154a463dd01b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:54.634880 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73666e67-01b8-4794-9221-154a463dd01b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:54.644152 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63415742-2eb1-4e61-8a3f-cf4481bbb003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:54.644905 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63415742-2eb1-4e61-8a3f-cf4481bbb003 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:54.645180 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63415742-2eb1-4e61-8a3f-cf4481bbb003 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:54.645456 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63415742-2eb1-4e61-8a3f-cf4481bbb003 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:54.646201 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63415742-2eb1-4e61-8a3f-cf4481bbb003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:54.649715 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63415742-2eb1-4e61-8a3f-cf4481bbb003 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:54.668825 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1217/2407] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:35:54 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:35:54.670479 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9d050-726b-49e9-8474-0f6f9c404eb5 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:54.682680 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9d050-726b-49e9-8474-0f6f9c404eb5 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:54.691138 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7824e-f0ce-437b-b8f0-00e3973707e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:54.692414 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7824e-f0ce-437b-b8f0-00e3973707e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:54.692945 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7824e-f0ce-437b-b8f0-00e3973707e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:54.693428 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7824e-f0ce-437b-b8f0-00e3973707e9 admin admin] PATH_INFO: `/v3/projects/52cd4fb14df549ea9fed02941d73e8bd/users/55547f8d3c89488184543969b7260b9b/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:54.721726 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7824e-f0ce-437b-b8f0-00e3973707e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52cd4fb14df549ea9fed02941d73e8bd, user_id=55547f8d3c89488184543969b7260b9b, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:54.728189 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7824e-f0ce-437b-b8f0-00e3973707e9 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:54.758037 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebe480-13de-4cde-8f60-77020e43abcb None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:54.758340 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebe480-13de-4cde-8f60-77020e43abcb None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:54.758986 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebe480-13de-4cde-8f60-77020e43abcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:54.789669 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-caebe480-13de-4cde-8f60-77020e43abcb None None] MFA Rules not processed for user `ae86afc9d10c45bb87afd7ccef20db9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:54.791061 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-caebe480-13de-4cde-8f60-77020e43abcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:54.848631 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1191/2408] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:35:54 2021] PUT /identity/v3/projects/52cd4fb14df549ea9fed02941d73e8bd/users/55547f8d3c89488184543969b7260b9b/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:35:54.859495 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e17745-1291-43c4-acba-745aed4070df None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:54.859907 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e17745-1291-43c4-acba-745aed4070df None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:54.860266 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e17745-1291-43c4-acba-745aed4070df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:54.867475 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1218/2409] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:54 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:54.879776 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebe480-13de-4cde-8f60-77020e43abcb None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:54.881283 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-caebe480-13de-4cde-8f60-77020e43abcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:54.886779 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-25e17745-1291-43c4-acba-745aed4070df None None] MFA Rules not processed for user `55547f8d3c89488184543969b7260b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:54.887948 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-25e17745-1291-43c4-acba-745aed4070df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:54.936000 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebe480-13de-4cde-8f60-77020e43abcb None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:54.961971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1192/2410] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:54 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:54.973128 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e17745-1291-43c4-acba-745aed4070df None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:54.974472 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-25e17745-1291-43c4-acba-745aed4070df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:54.987945 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4913f-c778-4bf5-ac7c-3142fbc2204b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59679a5d71249fc8cd65fbcf84e7bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:54.988606 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4913f-c778-4bf5-ac7c-3142fbc2204b service glance] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:54.988891 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4913f-c778-4bf5-ac7c-3142fbc2204b service glance] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:54.989167 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4913f-c778-4bf5-ac7c-3142fbc2204b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:54.991052 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-77c4913f-c778-4bf5-ac7c-3142fbc2204b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:55.029317 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e17745-1291-43c4-acba-745aed4070df None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:55.033154 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee57955-dfd0-4c54-b98a-a4af1870bc08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:55.033806 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee57955-dfd0-4c54-b98a-a4af1870bc08 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:55.034086 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee57955-dfd0-4c54-b98a-a4af1870bc08 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:55.034372 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee57955-dfd0-4c54-b98a-a4af1870bc08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:55.042539 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee57955-dfd0-4c54-b98a-a4af1870bc08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:55.043961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee57955-dfd0-4c54-b98a-a4af1870bc08 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:55.048326 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4913f-c778-4bf5-ac7c-3142fbc2204b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:55.050046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4913f-c778-4bf5-ac7c-3142fbc2204b service glance] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:55.053143 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1193/2411] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:54 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:35:55.058877 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1219/2412] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:54 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:35:55.079276 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee57955-dfd0-4c54-b98a-a4af1870bc08 service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:55.187988 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee57955-dfd0-4c54-b98a-a4af1870bc08 service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:55.193568 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7044d9-4b56-4967-b946-54fc33b444a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:55.194551 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7044d9-4b56-4967-b946-54fc33b444a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:55.195009 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7044d9-4b56-4967-b946-54fc33b444a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:55.195319 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7044d9-4b56-4967-b946-54fc33b444a7 admin admin] PATH_INFO: `/v3/users/55547f8d3c89488184543969b7260b9b` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:55.196533 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7044d9-4b56-4967-b946-54fc33b444a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55547f8d3c89488184543969b7260b9b)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:55.198591 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7044d9-4b56-4967-b946-54fc33b444a7 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:55.385546 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0d147-fada-4060-b2db-e4969b776efb None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:55.385840 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0d147-fada-4060-b2db-e4969b776efb None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:55.386121 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0d147-fada-4060-b2db-e4969b776efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:55.404637 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f4e0d147-fada-4060-b2db-e4969b776efb None None] MFA Rules not processed for user `3f65fb7e73db469f8b171c3126005427`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:55.406523 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f4e0d147-fada-4060-b2db-e4969b776efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:55.458219 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3d7044d9-4b56-4967-b946-54fc33b444a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55547f8d3c89488184543969b7260b9b'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:55.459056 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3d7044d9-4b56-4967-b946-54fc33b444a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55547f8d3c89488184543969b7260b9b'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:55.461967 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1220/2413] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 01:35:55 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:35:55.466680 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3d7044d9-4b56-4967-b946-54fc33b444a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55547f8d3c89488184543969b7260b9b'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:55.473216 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3d7044d9-4b56-4967-b946-54fc33b444a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55547f8d3c89488184543969b7260b9b'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:55.582727 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3d7044d9-4b56-4967-b946-54fc33b444a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55547f8d3c89488184543969b7260b9b'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:55.607971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1194/2414] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:35:55 2021] DELETE /identity/v3/users/55547f8d3c89488184543969b7260b9b => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:35:55.612415 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5a28e-4dff-430f-93df-bc7be211ca82 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:55.612702 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5a28e-4dff-430f-93df-bc7be211ca82 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:55.613001 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5a28e-4dff-430f-93df-bc7be211ca82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:55.631393 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-14d5a28e-4dff-430f-93df-bc7be211ca82 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:35:55.633081 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-14d5a28e-4dff-430f-93df-bc7be211ca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:55.651877 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7044d9-4b56-4967-b946-54fc33b444a7 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:55.653295 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-3d7044d9-4b56-4967-b946-54fc33b444a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:55.692321 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1221/2415] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:35:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:35:55.703550 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5a28e-4dff-430f-93df-bc7be211ca82 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:55.704922 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-14d5a28e-4dff-430f-93df-bc7be211ca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:55.722496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7044d9-4b56-4967-b946-54fc33b444a7 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:55.727538 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771fd8f-0f41-42f3-b3bd-4659479f494c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48536f4437240b79cf10961de9cc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:55.728190 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771fd8f-0f41-42f3-b3bd-4659479f494c service swift] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:55.728749 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771fd8f-0f41-42f3-b3bd-4659479f494c service swift] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:55.729063 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771fd8f-0f41-42f3-b3bd-4659479f494c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:55.730972 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8771fd8f-0f41-42f3-b3bd-4659479f494c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:55.771622 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5a28e-4dff-430f-93df-bc7be211ca82 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:55.775465 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f91a2-30ef-4b2a-9314-37a4c1f5a8ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:55.776135 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f91a2-30ef-4b2a-9314-37a4c1f5a8ac service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:55.776422 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f91a2-30ef-4b2a-9314-37a4c1f5a8ac service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:55.776690 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f91a2-30ef-4b2a-9314-37a4c1f5a8ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:55.786496 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f91a2-30ef-4b2a-9314-37a4c1f5a8ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:55.787971 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f91a2-30ef-4b2a-9314-37a4c1f5a8ac service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:55.795400 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771fd8f-0f41-42f3-b3bd-4659479f494c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:55.797594 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771fd8f-0f41-42f3-b3bd-4659479f494c service swift] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:55.799334 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1222/2416] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:35:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:35:55.816622 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1195/2417] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 01:35:55 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 01:35:56.440252 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f91a2-30ef-4b2a-9314-37a4c1f5a8ac service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:35:56.444002 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-535f91a2-30ef-4b2a-9314-37a4c1f5a8ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:35:56.510072 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f91a2-30ef-4b2a-9314-37a4c1f5a8ac service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:35:56.516674 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f136846-12c0-473c-8d63-51f073c7636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:35:56.517779 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f136846-12c0-473c-8d63-51f073c7636a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:35:56.518179 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f136846-12c0-473c-8d63-51f073c7636a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:35:56.518824 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f136846-12c0-473c-8d63-51f073c7636a admin admin] PATH_INFO: `/v3/projects/52cd4fb14df549ea9fed02941d73e8bd` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:35:56.520384 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f136846-12c0-473c-8d63-51f073c7636a admin admin] RBAC: Authorizing `identity:delete_project(project_id=52cd4fb14df549ea9fed02941d73e8bd)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:35:56.522626 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f136846-12c0-473c-8d63-51f073c7636a admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:35:56.664495 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-2f136846-12c0-473c-8d63-51f073c7636a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52cd4fb14df549ea9fed02941d73e8bd', 'request_id': 'req-2f136846-12c0-473c-8d63-51f073c7636a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:56.687137 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-2f136846-12c0-473c-8d63-51f073c7636a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52cd4fb14df549ea9fed02941d73e8bd', 'request_id': 'req-2f136846-12c0-473c-8d63-51f073c7636a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:56.762264 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-2f136846-12c0-473c-8d63-51f073c7636a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52cd4fb14df549ea9fed02941d73e8bd', 'request_id': 'req-2f136846-12c0-473c-8d63-51f073c7636a'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:56.787357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-2f136846-12c0-473c-8d63-51f073c7636a admin admin] The token cache is being invalidate because project 52cd4fb14df549ea9fed02941d73e8bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:35:56.787655 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-2f136846-12c0-473c-8d63-51f073c7636a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:56.788373 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-2f136846-12c0-473c-8d63-51f073c7636a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:35:56.790412 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1223/2418] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:35:56 2021] DELETE /identity/v3/projects/52cd4fb14df549ea9fed02941d73e8bd => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:36:04.575414 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd4559-a4ca-4904-9bee-ebe09cc76f6c None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:36:04.576308 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd4559-a4ca-4904-9bee-ebe09cc76f6c None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:36:04.576812 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd4559-a4ca-4904-9bee-ebe09cc76f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:36:04.595593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-84dd4559-a4ca-4904-9bee-ebe09cc76f6c None None] MFA Rules not processed for user `b2a94d8d27de4c9db7b8f2b1285058ac`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:36:04.597022 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-84dd4559-a4ca-4904-9bee-ebe09cc76f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:36:04.664874 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1196/2419] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:36:04 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:36:04.928507 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f136846-12c0-473c-8d63-51f073c7636a admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:36:04.930057 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-2f136846-12c0-473c-8d63-51f073c7636a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:36:04.997399 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f136846-12c0-473c-8d63-51f073c7636a admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:36:05.001296 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a3cd4-9deb-4926-b427-8979019d0fc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:36:05.001955 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a3cd4-9deb-4926-b427-8979019d0fc1 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:36:05.002234 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a3cd4-9deb-4926-b427-8979019d0fc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:36:05.002515 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a3cd4-9deb-4926-b427-8979019d0fc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:36:05.004287 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-2f3a3cd4-9deb-4926-b427-8979019d0fc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:36:05.015776 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a3cd4-9deb-4926-b427-8979019d0fc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:36:05.017254 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a3cd4-9deb-4926-b427-8979019d0fc1 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:36:05.026477 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1224/2420] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:36:04 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:36:07.094554 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75047e93-313f-4cf4-836f-08c8eb3e31bd None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:36:07.095080 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75047e93-313f-4cf4-836f-08c8eb3e31bd None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:36:07.095080 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75047e93-313f-4cf4-836f-08c8eb3e31bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:36:07.112821 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-75047e93-313f-4cf4-836f-08c8eb3e31bd None None] MFA Rules not processed for user `34172ab8bb0942fda2a6aeda56a3bf21`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:36:07.114031 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-75047e93-313f-4cf4-836f-08c8eb3e31bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:36:07.169335 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1197/2421] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:36:07 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:36:10.613605 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624ba85-f4d0-4caa-8f68-0ca9d92898a4 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:36:10.614114 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624ba85-f4d0-4caa-8f68-0ca9d92898a4 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:36:10.614373 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624ba85-f4d0-4caa-8f68-0ca9d92898a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:36:10.632179 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-5624ba85-f4d0-4caa-8f68-0ca9d92898a4 None None] MFA Rules not processed for user `3f65fb7e73db469f8b171c3126005427`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:36:10.633500 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-5624ba85-f4d0-4caa-8f68-0ca9d92898a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:36:10.691095 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1225/2422] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 01:36:10 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:36:10.704472 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75047e93-313f-4cf4-836f-08c8eb3e31bd None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:36:10.705930 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-75047e93-313f-4cf4-836f-08c8eb3e31bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:36:10.777445 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75047e93-313f-4cf4-836f-08c8eb3e31bd None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:36:10.790103 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314511fa-00cf-42bb-ad60-81d0a3cb245c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48536f4437240b79cf10961de9cc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:36:10.790103 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314511fa-00cf-42bb-ad60-81d0a3cb245c service swift] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:36:10.790103 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314511fa-00cf-42bb-ad60-81d0a3cb245c service swift] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:36:10.790103 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314511fa-00cf-42bb-ad60-81d0a3cb245c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:36:10.792605 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314511fa-00cf-42bb-ad60-81d0a3cb245c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:36:10.794222 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314511fa-00cf-42bb-ad60-81d0a3cb245c service swift] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:36:10.802547 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1198/2423] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 01:36:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 01:36:25.110043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624ba85-f4d0-4caa-8f68-0ca9d92898a4 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:36:25.112136 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-5624ba85-f4d0-4caa-8f68-0ca9d92898a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:36:25.183283 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624ba85-f4d0-4caa-8f68-0ca9d92898a4 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:36:25.189435 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d873f-381f-4ff2-a6c2-2daec8cc6f48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:36:25.190084 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d873f-381f-4ff2-a6c2-2daec8cc6f48 service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:36:25.190367 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d873f-381f-4ff2-a6c2-2daec8cc6f48 service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:36:25.190645 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d873f-381f-4ff2-a6c2-2daec8cc6f48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:36:25.192380 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-ac6d873f-381f-4ff2-a6c2-2daec8cc6f48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:36:25.204998 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d873f-381f-4ff2-a6c2-2daec8cc6f48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:36:25.206577 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d873f-381f-4ff2-a6c2-2daec8cc6f48 service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:36:25.217369 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1226/2424] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:36:25 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:36:40.071340 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b337b-22e3-4b80-bb29-18b11f065660 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:36:40.071841 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b337b-22e3-4b80-bb29-18b11f065660 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:36:40.071932 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b337b-22e3-4b80-bb29-18b11f065660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:36:40.089640 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-c88b337b-22e3-4b80-bb29-18b11f065660 None None] MFA Rules not processed for user `3f65fb7e73db469f8b171c3126005427`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:36:40.090937 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-c88b337b-22e3-4b80-bb29-18b11f065660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:36:40.098329 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1199/2425] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 01:36:40 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:36:40.111607 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d873f-381f-4ff2-a6c2-2daec8cc6f48 service nova] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:36:40.122775 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d873f-381f-4ff2-a6c2-2daec8cc6f48 service nova] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:36:40.128477 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984abc1-cc5b-4ee5-95df-0df8c1b94f62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48536f4437240b79cf10961de9cc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:36:40.129147 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984abc1-cc5b-4ee5-95df-0df8c1b94f62 service swift] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:36:40.129428 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984abc1-cc5b-4ee5-95df-0df8c1b94f62 service swift] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:36:40.129704 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984abc1-cc5b-4ee5-95df-0df8c1b94f62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:36:40.137636 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984abc1-cc5b-4ee5-95df-0df8c1b94f62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:36:40.139191 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984abc1-cc5b-4ee5-95df-0df8c1b94f62 service swift] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:36:40.147574 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1227/2426] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 01:36:40 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 01:36:47.567486 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b337b-22e3-4b80-bb29-18b11f065660 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:36:47.568968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-c88b337b-22e3-4b80-bb29-18b11f065660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:36:47.590910 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b337b-22e3-4b80-bb29-18b11f065660 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:36:47.599532 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80115f8b-43f8-4a6c-bf91-308e596ef1ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:36:47.601722 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80115f8b-43f8-4a6c-bf91-308e596ef1ea service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:36:47.601722 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80115f8b-43f8-4a6c-bf91-308e596ef1ea service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:36:47.602277 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80115f8b-43f8-4a6c-bf91-308e596ef1ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:36:47.605093 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-80115f8b-43f8-4a6c-bf91-308e596ef1ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:36:47.700612 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80115f8b-43f8-4a6c-bf91-308e596ef1ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:36:47.702252 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80115f8b-43f8-4a6c-bf91-308e596ef1ea service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:36:47.714174 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1200/2427] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:36:47 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:36:50.193707 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984abc1-cc5b-4ee5-95df-0df8c1b94f62 service swift] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:36:50.195216 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-8984abc1-cc5b-4ee5-95df-0df8c1b94f62 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:36:50.219219 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984abc1-cc5b-4ee5-95df-0df8c1b94f62 service swift] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:36:50.239441 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a787fa9-0dae-48a8-9d6f-9083cece8a06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:36:50.241444 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a787fa9-0dae-48a8-9d6f-9083cece8a06 service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:36:50.242068 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a787fa9-0dae-48a8-9d6f-9083cece8a06 service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:36:50.242735 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a787fa9-0dae-48a8-9d6f-9083cece8a06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:36:50.245185 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-6a787fa9-0dae-48a8-9d6f-9083cece8a06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:36:50.270547 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a787fa9-0dae-48a8-9d6f-9083cece8a06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:36:50.272170 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a787fa9-0dae-48a8-9d6f-9083cece8a06 service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:36:50.288235 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1228/2428] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:36:50 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:36:52.107997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678f4c1-6fb5-426a-a233-8c1c5ee7c9e7 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:36:52.108518 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678f4c1-6fb5-426a-a233-8c1c5ee7c9e7 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:36:52.108613 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678f4c1-6fb5-426a-a233-8c1c5ee7c9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:36:52.127494 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-0678f4c1-6fb5-426a-a233-8c1c5ee7c9e7 None None] MFA Rules not processed for user `3f65fb7e73db469f8b171c3126005427`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:36:52.133495 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-0678f4c1-6fb5-426a-a233-8c1c5ee7c9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:36:52.136463 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1201/2429] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 01:36:52 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:36:52.158284 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a787fa9-0dae-48a8-9d6f-9083cece8a06 service nova] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:36:52.165036 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a787fa9-0dae-48a8-9d6f-9083cece8a06 service nova] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:36:52.170140 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f945069-4fe7-4818-abb9-a14af2000dd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48536f4437240b79cf10961de9cc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:36:52.170781 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f945069-4fe7-4818-abb9-a14af2000dd2 service swift] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:36:52.171066 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f945069-4fe7-4818-abb9-a14af2000dd2 service swift] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:36:52.171342 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f945069-4fe7-4818-abb9-a14af2000dd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:36:52.179939 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f945069-4fe7-4818-abb9-a14af2000dd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:36:52.181890 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f945069-4fe7-4818-abb9-a14af2000dd2 service swift] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:36:52.197354 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1229/2430] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 01:36:52 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 01:36:59.276325 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1809109-4a7d-407a-b16a-44a8e33cf608 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:36:59.276905 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1809109-4a7d-407a-b16a-44a8e33cf608 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:36:59.277012 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1809109-4a7d-407a-b16a-44a8e33cf608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:36:59.296873 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-a1809109-4a7d-407a-b16a-44a8e33cf608 None None] MFA Rules not processed for user `3f65fb7e73db469f8b171c3126005427`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:36:59.298907 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a1809109-4a7d-407a-b16a-44a8e33cf608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:36:59.311691 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1202/2431] 10.222.0.25 () {58 vars in 968 bytes} [Fri Aug 27 01:36:59 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:36:59.322199 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f945069-4fe7-4818-abb9-a14af2000dd2 service swift] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:36:59.333725 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f945069-4fe7-4818-abb9-a14af2000dd2 service swift] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:36:59.339280 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43513e-3c95-4f04-b77b-9a9db5a2688f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48536f4437240b79cf10961de9cc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:36:59.339965 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43513e-3c95-4f04-b77b-9a9db5a2688f service swift] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:36:59.340250 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43513e-3c95-4f04-b77b-9a9db5a2688f service swift] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:36:59.340533 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43513e-3c95-4f04-b77b-9a9db5a2688f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:36:59.349931 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43513e-3c95-4f04-b77b-9a9db5a2688f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:36:59.351533 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43513e-3c95-4f04-b77b-9a9db5a2688f service swift] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:36:59.360821 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1230/2432] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 01:36:59 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 01:37:03.465482 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1809109-4a7d-407a-b16a-44a8e33cf608 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:03.465482 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a1809109-4a7d-407a-b16a-44a8e33cf608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:03.465482 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1809109-4a7d-407a-b16a-44a8e33cf608 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:03.466322 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed99db-d13f-4941-8c4f-52920fc69ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:03.466322 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed99db-d13f-4941-8c4f-52920fc69ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:03.466322 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed99db-d13f-4941-8c4f-52920fc69ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:03.466322 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed99db-d13f-4941-8c4f-52920fc69ebb admin admin] PATH_INFO: `/v3/users/b2a94d8d27de4c9db7b8f2b1285058ac` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:03.466655 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed99db-d13f-4941-8c4f-52920fc69ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2a94d8d27de4c9db7b8f2b1285058ac)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:03.466655 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed99db-d13f-4941-8c4f-52920fc69ebb admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:04.108609 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-f8ed99db-d13f-4941-8c4f-52920fc69ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2a94d8d27de4c9db7b8f2b1285058ac'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:04.109301 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-f8ed99db-d13f-4941-8c4f-52920fc69ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2a94d8d27de4c9db7b8f2b1285058ac'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:04.121290 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-f8ed99db-d13f-4941-8c4f-52920fc69ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2a94d8d27de4c9db7b8f2b1285058ac'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:04.122172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-f8ed99db-d13f-4941-8c4f-52920fc69ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2a94d8d27de4c9db7b8f2b1285058ac'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:04.202064 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-f8ed99db-d13f-4941-8c4f-52920fc69ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2a94d8d27de4c9db7b8f2b1285058ac'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:04.222889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1203/2433] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:37:03 2021] DELETE /identity/v3/users/b2a94d8d27de4c9db7b8f2b1285058ac => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:37:04.490745 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43513e-3c95-4f04-b77b-9a9db5a2688f service swift] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:04.503246 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43513e-3c95-4f04-b77b-9a9db5a2688f service swift] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:04.585410 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743d214-d14b-4d29-bd80-e0cdcff3ecab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:04.586323 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743d214-d14b-4d29-bd80-e0cdcff3ecab admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:04.586600 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743d214-d14b-4d29-bd80-e0cdcff3ecab admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:04.586875 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743d214-d14b-4d29-bd80-e0cdcff3ecab admin admin] PATH_INFO: `/v3/projects/31b47b7bf2ed4568af16eb7861b78453` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:04.588178 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743d214-d14b-4d29-bd80-e0cdcff3ecab admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b47b7bf2ed4568af16eb7861b78453)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:04.590470 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743d214-d14b-4d29-bd80-e0cdcff3ecab admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:04.689046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-9743d214-d14b-4d29-bd80-e0cdcff3ecab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b47b7bf2ed4568af16eb7861b78453', 'request_id': 'req-9743d214-d14b-4d29-bd80-e0cdcff3ecab'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:04.699385 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-9743d214-d14b-4d29-bd80-e0cdcff3ecab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b47b7bf2ed4568af16eb7861b78453', 'request_id': 'req-9743d214-d14b-4d29-bd80-e0cdcff3ecab'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:04.818868 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-9743d214-d14b-4d29-bd80-e0cdcff3ecab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b47b7bf2ed4568af16eb7861b78453', 'request_id': 'req-9743d214-d14b-4d29-bd80-e0cdcff3ecab'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:04.829506 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-9743d214-d14b-4d29-bd80-e0cdcff3ecab admin admin] The token cache is being invalidate because project 31b47b7bf2ed4568af16eb7861b78453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:37:04.829790 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-9743d214-d14b-4d29-bd80-e0cdcff3ecab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:04.830406 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-9743d214-d14b-4d29-bd80-e0cdcff3ecab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:04.831942 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1231/2434] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:37:04 2021] DELETE /identity/v3/projects/31b47b7bf2ed4568af16eb7861b78453 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:37:04.837745 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceefb3-9be6-4631-9ee6-0b3e948722cd None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:04.838219 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceefb3-9be6-4631-9ee6-0b3e948722cd None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:04.838325 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceefb3-9be6-4631-9ee6-0b3e948722cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:04.857429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-99ceefb3-9be6-4631-9ee6-0b3e948722cd None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:04.858557 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-99ceefb3-9be6-4631-9ee6-0b3e948722cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:04.924879 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1204/2435] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:37:04.932805 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344d88f-5aef-4d4d-80d5-7cc3a76315e4 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:04.933119 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344d88f-5aef-4d4d-80d5-7cc3a76315e4 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:04.933394 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344d88f-5aef-4d4d-80d5-7cc3a76315e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:04.952591 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f344d88f-5aef-4d4d-80d5-7cc3a76315e4 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:04.955554 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f344d88f-5aef-4d4d-80d5-7cc3a76315e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:04.962527 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1232/2436] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:37:04.966758 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ceefb3-9be6-4631-9ee6-0b3e948722cd None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:04.976456 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ceefb3-9be6-4631-9ee6-0b3e948722cd None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:04.981193 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f79f9-b975-4aff-bf54-f16ebeec3644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:04.981850 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f79f9-b975-4aff-bf54-f16ebeec3644 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:04.982127 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f79f9-b975-4aff-bf54-f16ebeec3644 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:04.982395 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f79f9-b975-4aff-bf54-f16ebeec3644 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:04.983095 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f79f9-b975-4aff-bf54-f16ebeec3644 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:37:04.983395 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f79f9-b975-4aff-bf54-f16ebeec3644 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:04.984984 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f79f9-b975-4aff-bf54-f16ebeec3644 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:04.996237 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1205/2437] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:37:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:37:05.001696 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344d88f-5aef-4d4d-80d5-7cc3a76315e4 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:05.010709 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344d88f-5aef-4d4d-80d5-7cc3a76315e4 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:05.015408 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340fe1e-709a-47d7-966d-c1d2dbeef7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:05.016201 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340fe1e-709a-47d7-966d-c1d2dbeef7ad admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:05.016637 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340fe1e-709a-47d7-966d-c1d2dbeef7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:05.017768 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340fe1e-709a-47d7-966d-c1d2dbeef7ad admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:05.018535 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340fe1e-709a-47d7-966d-c1d2dbeef7ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:05.020479 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340fe1e-709a-47d7-966d-c1d2dbeef7ad admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:05.144357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1233/2438] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:37:04 2021] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:37:05.145589 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f79f9-b975-4aff-bf54-f16ebeec3644 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:05.155404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f79f9-b975-4aff-bf54-f16ebeec3644 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:05.214749 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ef9d9-46ef-44da-9f6f-40e3610881e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:05.215554 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ef9d9-46ef-44da-9f6f-40e3610881e5 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:05.215839 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ef9d9-46ef-44da-9f6f-40e3610881e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:05.216115 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ef9d9-46ef-44da-9f6f-40e3610881e5 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:05.216815 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ef9d9-46ef-44da-9f6f-40e3610881e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:05.218846 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ef9d9-46ef-44da-9f6f-40e3610881e5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:05.296895 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1206/2439] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:37:05 2021] POST /identity/v3/users => generated 283 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:37:05.297962 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340fe1e-709a-47d7-966d-c1d2dbeef7ad admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:05.308610 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340fe1e-709a-47d7-966d-c1d2dbeef7ad admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:05.313440 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956dbf2-4378-4165-a830-26412e8f65d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:05.314589 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956dbf2-4378-4165-a830-26412e8f65d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:05.314902 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956dbf2-4378-4165-a830-26412e8f65d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:05.315189 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956dbf2-4378-4165-a830-26412e8f65d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:05.315924 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956dbf2-4378-4165-a830-26412e8f65d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:05.317552 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956dbf2-4378-4165-a830-26412e8f65d3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:05.327582 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1234/2440] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:37:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:37:05.332296 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ef9d9-46ef-44da-9f6f-40e3610881e5 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:05.342368 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ef9d9-46ef-44da-9f6f-40e3610881e5 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:05.347621 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022a075-a0f7-48cf-a8da-101d64110d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:05.348277 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022a075-a0f7-48cf-a8da-101d64110d0d admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:05.348561 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022a075-a0f7-48cf-a8da-101d64110d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:05.348860 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022a075-a0f7-48cf-a8da-101d64110d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:05.349593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022a075-a0f7-48cf-a8da-101d64110d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:05.351167 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022a075-a0f7-48cf-a8da-101d64110d0d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:05.361212 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1207/2441] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:37:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:37:05.365472 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956dbf2-4378-4165-a830-26412e8f65d3 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:05.375432 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956dbf2-4378-4165-a830-26412e8f65d3 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:05.380551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed3c1d-ec8b-400b-8ce5-4730dd83cffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:05.381497 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed3c1d-ec8b-400b-8ce5-4730dd83cffd admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:05.381773 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed3c1d-ec8b-400b-8ce5-4730dd83cffd admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:05.382043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed3c1d-ec8b-400b-8ce5-4730dd83cffd admin admin] PATH_INFO: `/v3/projects/95e18a80ccaa40cbab445c3cd7476747/users/2f2e6b14acb44a5d9f38379e3d9a48a9/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:05.397873 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed3c1d-ec8b-400b-8ce5-4730dd83cffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e18a80ccaa40cbab445c3cd7476747, user_id=2f2e6b14acb44a5d9f38379e3d9a48a9, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:05.400602 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed3c1d-ec8b-400b-8ce5-4730dd83cffd admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:05.481929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1235/2442] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:37:05 2021] PUT /identity/v3/projects/95e18a80ccaa40cbab445c3cd7476747/users/2f2e6b14acb44a5d9f38379e3d9a48a9/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:37:05.493070 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef208c9-1850-4536-8522-6e0fe3974251 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:05.493359 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef208c9-1850-4536-8522-6e0fe3974251 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:05.493644 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef208c9-1850-4536-8522-6e0fe3974251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:05.520995 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-8ef208c9-1850-4536-8522-6e0fe3974251 None None] MFA Rules not processed for user `2f2e6b14acb44a5d9f38379e3d9a48a9`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:05.522213 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8ef208c9-1850-4536-8522-6e0fe3974251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:05.588354 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1208/2443] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:05 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:37:05.600088 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed3c1d-ec8b-400b-8ce5-4730dd83cffd admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:05.602001 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-5aed3c1d-ec8b-400b-8ce5-4730dd83cffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:05.666246 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed3c1d-ec8b-400b-8ce5-4730dd83cffd admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:05.669909 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23614509-bb0f-418a-8890-931630ac8579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:05.670568 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23614509-bb0f-418a-8890-931630ac8579 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:05.670854 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23614509-bb0f-418a-8890-931630ac8579 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:05.671131 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23614509-bb0f-418a-8890-931630ac8579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:05.680478 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23614509-bb0f-418a-8890-931630ac8579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:05.681924 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23614509-bb0f-418a-8890-931630ac8579 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:05.690804 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1236/2444] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:37:05 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:37:11.427901 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a539e31-0d7e-4a62-8c6f-176c68ca40a3 None None] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:11.428417 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a539e31-0d7e-4a62-8c6f-176c68ca40a3 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:11.428417 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a539e31-0d7e-4a62-8c6f-176c68ca40a3 None None] PATH_INFO: `/` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:11.430347 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1209/2445] 10.222.0.25 () {54 vars in 921 bytes} [Fri Aug 27 01:37:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:37:11.437261 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1be5f-8ae1-4d30-a047-c9bd9fc72459 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:11.437741 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1be5f-8ae1-4d30-a047-c9bd9fc72459 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:11.437831 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1be5f-8ae1-4d30-a047-c9bd9fc72459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:11.457220 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-80c1be5f-8ae1-4d30-a047-c9bd9fc72459 None None] MFA Rules not processed for user `249a7642a0284dde91a7719f732b2d70`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:11.458513 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-80c1be5f-8ae1-4d30-a047-c9bd9fc72459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:11.536170 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1237/2446] 10.222.0.25 () {58 vars in 1019 bytes} [Fri Aug 27 01:37:11 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:37:11.550530 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a539e31-0d7e-4a62-8c6f-176c68ca40a3 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:11.552221 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-7a539e31-0d7e-4a62-8c6f-176c68ca40a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:11.608423 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a539e31-0d7e-4a62-8c6f-176c68ca40a3 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:11.612704 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc0825-e668-4a0d-bcba-93cff0edc277 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a59679a5d71249fc8cd65fbcf84e7bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:11.613384 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc0825-e668-4a0d-bcba-93cff0edc277 service glance] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:11.613670 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc0825-e668-4a0d-bcba-93cff0edc277 service glance] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:11.613950 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc0825-e668-4a0d-bcba-93cff0edc277 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:11.624419 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc0825-e668-4a0d-bcba-93cff0edc277 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:11.626549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc0825-e668-4a0d-bcba-93cff0edc277 service glance] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:11.637276 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1210/2447] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:37:11 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:37:11.883432 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafeaaf8-732b-4135-be98-d796cb38360d None None] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:11.883724 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafeaaf8-732b-4135-be98-d796cb38360d None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:11.884021 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafeaaf8-732b-4135-be98-d796cb38360d None None] PATH_INFO: `/` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:11.886095 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1238/2448] 10.222.0.25 () {54 vars in 921 bytes} [Fri Aug 27 01:37:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 01:37:11.891570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43558e6a-0e61-42f4-a304-b02e26af180f None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:11.891861 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43558e6a-0e61-42f4-a304-b02e26af180f None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:11.892142 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43558e6a-0e61-42f4-a304-b02e26af180f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:11.915448 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-43558e6a-0e61-42f4-a304-b02e26af180f None None] MFA Rules not processed for user `2e2182e4d74047a399e7ffea63e7ce6e`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:11.916649 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-43558e6a-0e61-42f4-a304-b02e26af180f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:11.968890 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1211/2449] 10.222.0.25 () {58 vars in 1019 bytes} [Fri Aug 27 01:37:11 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:37:11.981651 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafeaaf8-732b-4135-be98-d796cb38360d None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:11.983353 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-dafeaaf8-732b-4135-be98-d796cb38360d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:11.996860 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafeaaf8-732b-4135-be98-d796cb38360d None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:12.000310 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423bf9a-c683-4033-997c-d3202f92f02f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:12.001074 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423bf9a-c683-4033-997c-d3202f92f02f service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:12.001577 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423bf9a-c683-4033-997c-d3202f92f02f service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:12.001858 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423bf9a-c683-4033-997c-d3202f92f02f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:12.008902 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423bf9a-c683-4033-997c-d3202f92f02f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:12.011913 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423bf9a-c683-4033-997c-d3202f92f02f service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:12.018310 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1239/2450] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:37:11 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:37:17.449321 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec4f41-1d89-479d-895e-5c4cfc5bf342 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:17.449781 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec4f41-1d89-479d-895e-5c4cfc5bf342 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:17.449911 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec4f41-1d89-479d-895e-5c4cfc5bf342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:17.469165 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-98ec4f41-1d89-479d-895e-5c4cfc5bf342 None None] MFA Rules not processed for user `3f65fb7e73db469f8b171c3126005427`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:17.470991 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-98ec4f41-1d89-479d-895e-5c4cfc5bf342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:17.533001 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1212/2451] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 01:37:17 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:37:17.546504 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423bf9a-c683-4033-997c-d3202f92f02f service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:17.548462 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-b423bf9a-c683-4033-997c-d3202f92f02f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:17.617918 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423bf9a-c683-4033-997c-d3202f92f02f service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:17.623129 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a29417-1f1a-4dba-bf76-a0d248957080 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48536f4437240b79cf10961de9cc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:17.623747 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a29417-1f1a-4dba-bf76-a0d248957080 service swift] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:17.624029 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a29417-1f1a-4dba-bf76-a0d248957080 service swift] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:17.624302 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a29417-1f1a-4dba-bf76-a0d248957080 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:17.633104 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a29417-1f1a-4dba-bf76-a0d248957080 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:17.634722 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a29417-1f1a-4dba-bf76-a0d248957080 service swift] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:17.643654 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1240/2452] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 01:37:17 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 01:37:34.710925 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec4f41-1d89-479d-895e-5c4cfc5bf342 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:34.721033 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec4f41-1d89-479d-895e-5c4cfc5bf342 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:34.724752 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19c504-0716-4d9e-b170-bff19af388fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:34.725441 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19c504-0716-4d9e-b170-bff19af388fc service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:34.725726 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19c504-0716-4d9e-b170-bff19af388fc service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:34.726002 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19c504-0716-4d9e-b170-bff19af388fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:34.727807 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-5d19c504-0716-4d9e-b170-bff19af388fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:34.793566 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19c504-0716-4d9e-b170-bff19af388fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:34.796160 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19c504-0716-4d9e-b170-bff19af388fc service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:34.806487 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1213/2453] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:37:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:37:37.050629 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c623a6-0be4-4627-8d67-b8ba12473b49 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:37.051190 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c623a6-0be4-4627-8d67-b8ba12473b49 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:37.051190 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c623a6-0be4-4627-8d67-b8ba12473b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:37.069505 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f0c623a6-0be4-4627-8d67-b8ba12473b49 None None] MFA Rules not processed for user `3f65fb7e73db469f8b171c3126005427`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:37.071898 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f0c623a6-0be4-4627-8d67-b8ba12473b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:37.079259 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1241/2454] 10.222.0.25 () {58 vars in 968 bytes} [Fri Aug 27 01:37:37 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:37:37.091878 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19c504-0716-4d9e-b170-bff19af388fc service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:37.103926 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19c504-0716-4d9e-b170-bff19af388fc service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:37.108979 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a603a2-30d1-46ab-8c44-717d3abbba1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48536f4437240b79cf10961de9cc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:37.110164 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a603a2-30d1-46ab-8c44-717d3abbba1e service swift] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:37.110447 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a603a2-30d1-46ab-8c44-717d3abbba1e service swift] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:37.110907 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a603a2-30d1-46ab-8c44-717d3abbba1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:37.119450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a603a2-30d1-46ab-8c44-717d3abbba1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:37.121059 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a603a2-30d1-46ab-8c44-717d3abbba1e service swift] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:37.131066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1214/2455] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 01:37:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 01:37:38.806419 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c623a6-0be4-4627-8d67-b8ba12473b49 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:38.807943 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f0c623a6-0be4-4627-8d67-b8ba12473b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:38.825254 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c623a6-0be4-4627-8d67-b8ba12473b49 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:38.830759 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060bb85-9e62-4b63-8f92-65c4bdfd5ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:38.832069 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060bb85-9e62-4b63-8f92-65c4bdfd5ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:38.832357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060bb85-9e62-4b63-8f92-65c4bdfd5ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:38.832801 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060bb85-9e62-4b63-8f92-65c4bdfd5ffd admin admin] PATH_INFO: `/v3/users/fa605019ca5c40d897cb30c990710ff6` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:38.834124 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060bb85-9e62-4b63-8f92-65c4bdfd5ffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa605019ca5c40d897cb30c990710ff6)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:38.836008 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060bb85-9e62-4b63-8f92-65c4bdfd5ffd admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:39.001583 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f060bb85-9e62-4b63-8f92-65c4bdfd5ffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa605019ca5c40d897cb30c990710ff6'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:39.013382 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f060bb85-9e62-4b63-8f92-65c4bdfd5ffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa605019ca5c40d897cb30c990710ff6'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:39.020145 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f060bb85-9e62-4b63-8f92-65c4bdfd5ffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa605019ca5c40d897cb30c990710ff6'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:39.020826 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f060bb85-9e62-4b63-8f92-65c4bdfd5ffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa605019ca5c40d897cb30c990710ff6'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:39.075672 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f060bb85-9e62-4b63-8f92-65c4bdfd5ffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa605019ca5c40d897cb30c990710ff6'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:39.082235 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1242/2456] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:37:38 2021] DELETE /identity/v3/users/fa605019ca5c40d897cb30c990710ff6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:37:39.354339 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a603a2-30d1-46ab-8c44-717d3abbba1e service swift] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:39.368756 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a603a2-30d1-46ab-8c44-717d3abbba1e service swift] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:39.433570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fab03d-c108-48ff-945a-b84e9728528a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:39.434428 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fab03d-c108-48ff-945a-b84e9728528a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:39.434696 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fab03d-c108-48ff-945a-b84e9728528a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:39.434972 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fab03d-c108-48ff-945a-b84e9728528a admin admin] PATH_INFO: `/v3/projects/1d392d1b39ee49d1b87211d5c447f9dc` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:39.436140 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fab03d-c108-48ff-945a-b84e9728528a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d392d1b39ee49d1b87211d5c447f9dc)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:39.438388 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fab03d-c108-48ff-945a-b84e9728528a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:39.585029 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b2fab03d-c108-48ff-945a-b84e9728528a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d392d1b39ee49d1b87211d5c447f9dc', 'request_id': 'req-b2fab03d-c108-48ff-945a-b84e9728528a'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:39.590971 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b2fab03d-c108-48ff-945a-b84e9728528a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d392d1b39ee49d1b87211d5c447f9dc', 'request_id': 'req-b2fab03d-c108-48ff-945a-b84e9728528a'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:39.675217 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b2fab03d-c108-48ff-945a-b84e9728528a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d392d1b39ee49d1b87211d5c447f9dc', 'request_id': 'req-b2fab03d-c108-48ff-945a-b84e9728528a'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:39.685415 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b2fab03d-c108-48ff-945a-b84e9728528a admin admin] The token cache is being invalidate because project 1d392d1b39ee49d1b87211d5c447f9dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:37:39.685703 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b2fab03d-c108-48ff-945a-b84e9728528a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:39.686319 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b2fab03d-c108-48ff-945a-b84e9728528a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:39.688361 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1215/2457] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:37:39 2021] DELETE /identity/v3/projects/1d392d1b39ee49d1b87211d5c447f9dc => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:37:39.694570 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942557f-ab75-44f3-84a9-cfa4541b255a None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:39.694860 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942557f-ab75-44f3-84a9-cfa4541b255a None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:39.695142 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942557f-ab75-44f3-84a9-cfa4541b255a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:39.716311 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-8942557f-ab75-44f3-84a9-cfa4541b255a None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:39.717601 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-8942557f-ab75-44f3-84a9-cfa4541b255a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:39.775180 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1243/2458] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:37:39.783904 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276da37a-b26f-44c7-bff1-f3a93594acd2 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:39.784195 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276da37a-b26f-44c7-bff1-f3a93594acd2 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:39.784475 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276da37a-b26f-44c7-bff1-f3a93594acd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:39.803363 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-276da37a-b26f-44c7-bff1-f3a93594acd2 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:39.804554 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-276da37a-b26f-44c7-bff1-f3a93594acd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:39.812291 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1216/2459] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:37:39.816510 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942557f-ab75-44f3-84a9-cfa4541b255a None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:39.826002 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942557f-ab75-44f3-84a9-cfa4541b255a None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:39.830589 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00c85c-33d4-483a-9365-b22465b7ce3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:39.831229 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00c85c-33d4-483a-9365-b22465b7ce3d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:39.831507 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00c85c-33d4-483a-9365-b22465b7ce3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:39.831782 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00c85c-33d4-483a-9365-b22465b7ce3d admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:39.832492 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00c85c-33d4-483a-9365-b22465b7ce3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:37:39.832794 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00c85c-33d4-483a-9365-b22465b7ce3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:39.834392 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00c85c-33d4-483a-9365-b22465b7ce3d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:39.846309 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1244/2460] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:37:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:37:39.850105 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276da37a-b26f-44c7-bff1-f3a93594acd2 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:39.859037 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276da37a-b26f-44c7-bff1-f3a93594acd2 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:39.864561 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356a356-be34-412d-b369-a6d70b7f7f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:39.865233 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356a356-be34-412d-b369-a6d70b7f7f22 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:39.865516 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356a356-be34-412d-b369-a6d70b7f7f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:39.865790 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356a356-be34-412d-b369-a6d70b7f7f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:39.866485 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356a356-be34-412d-b369-a6d70b7f7f22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:39.868352 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356a356-be34-412d-b369-a6d70b7f7f22 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:39.957974 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1217/2461] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:37:39 2021] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:37:39.962083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00c85c-33d4-483a-9365-b22465b7ce3d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:39.972620 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00c85c-33d4-483a-9365-b22465b7ce3d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:40.034590 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55a2e6-07e3-4420-98df-8c67f02f8316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:40.035259 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55a2e6-07e3-4420-98df-8c67f02f8316 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:40.035802 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55a2e6-07e3-4420-98df-8c67f02f8316 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:40.036083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55a2e6-07e3-4420-98df-8c67f02f8316 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:40.036777 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55a2e6-07e3-4420-98df-8c67f02f8316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:40.038714 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55a2e6-07e3-4420-98df-8c67f02f8316 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:40.138630 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1245/2462] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:37:39 2021] POST /identity/v3/users => generated 284 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:37:40.143348 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356a356-be34-412d-b369-a6d70b7f7f22 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:40.153668 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356a356-be34-412d-b369-a6d70b7f7f22 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:40.159271 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65987c07-6667-49ed-8b56-aa8a43ae7c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:40.165901 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65987c07-6667-49ed-8b56-aa8a43ae7c46 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:40.165901 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65987c07-6667-49ed-8b56-aa8a43ae7c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:40.165901 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65987c07-6667-49ed-8b56-aa8a43ae7c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:40.165901 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65987c07-6667-49ed-8b56-aa8a43ae7c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:40.165901 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65987c07-6667-49ed-8b56-aa8a43ae7c46 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:40.174998 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1218/2463] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:37:40 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:37:40.178792 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55a2e6-07e3-4420-98df-8c67f02f8316 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:40.189084 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55a2e6-07e3-4420-98df-8c67f02f8316 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:40.193677 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5183691-68c4-4f09-8cb8-a58dde6f896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:40.194326 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5183691-68c4-4f09-8cb8-a58dde6f896c admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:40.194607 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5183691-68c4-4f09-8cb8-a58dde6f896c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:40.194880 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5183691-68c4-4f09-8cb8-a58dde6f896c admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:40.195598 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5183691-68c4-4f09-8cb8-a58dde6f896c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:40.197220 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5183691-68c4-4f09-8cb8-a58dde6f896c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:40.207379 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1246/2464] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:37:40 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:37:40.211272 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65987c07-6667-49ed-8b56-aa8a43ae7c46 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:40.221203 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65987c07-6667-49ed-8b56-aa8a43ae7c46 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:40.225841 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84584db2-d2e0-45f7-b90b-01e73dcbfc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:40.226704 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84584db2-d2e0-45f7-b90b-01e73dcbfc92 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:40.226985 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84584db2-d2e0-45f7-b90b-01e73dcbfc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:40.227262 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84584db2-d2e0-45f7-b90b-01e73dcbfc92 admin admin] PATH_INFO: `/v3/projects/e7df15110ef9407db5752cfd0254b9b6/users/b7ffd19fc87f4554b447909e0f35b4fd/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:40.241990 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84584db2-d2e0-45f7-b90b-01e73dcbfc92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7df15110ef9407db5752cfd0254b9b6, user_id=b7ffd19fc87f4554b447909e0f35b4fd, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:40.244621 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84584db2-d2e0-45f7-b90b-01e73dcbfc92 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:40.322031 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1219/2465] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:37:40 2021] PUT /identity/v3/projects/e7df15110ef9407db5752cfd0254b9b6/users/b7ffd19fc87f4554b447909e0f35b4fd/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:37:40.332387 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b0e60-4aab-4d72-8734-4558e71b0227 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:40.332679 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b0e60-4aab-4d72-8734-4558e71b0227 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:40.333018 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b0e60-4aab-4d72-8734-4558e71b0227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:40.361190 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-e44b0e60-4aab-4d72-8734-4558e71b0227 None None] MFA Rules not processed for user `b7ffd19fc87f4554b447909e0f35b4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:40.362437 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-e44b0e60-4aab-4d72-8734-4558e71b0227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:40.433353 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1247/2466] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:40 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:37:40.443654 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84584db2-d2e0-45f7-b90b-01e73dcbfc92 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:40.445381 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-84584db2-d2e0-45f7-b90b-01e73dcbfc92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:40.505324 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84584db2-d2e0-45f7-b90b-01e73dcbfc92 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:40.509073 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a07b13-15af-4795-abbd-d322425b223c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:40.509708 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a07b13-15af-4795-abbd-d322425b223c service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:40.509993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a07b13-15af-4795-abbd-d322425b223c service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:40.510265 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a07b13-15af-4795-abbd-d322425b223c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:40.519352 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a07b13-15af-4795-abbd-d322425b223c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:40.520770 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a07b13-15af-4795-abbd-d322425b223c service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:40.529328 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1220/2467] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:37:40 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:37:50.424141 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b0e60-4aab-4d72-8734-4558e71b0227 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:50.486335 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b0e60-4aab-4d72-8734-4558e71b0227 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:50.493070 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42335e34-de3a-45e4-a88c-202eb674f9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:50.494375 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335e34-de3a-45e4-a88c-202eb674f9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:50.494640 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335e34-de3a-45e4-a88c-202eb674f9af admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:50.494915 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335e34-de3a-45e4-a88c-202eb674f9af admin admin] PATH_INFO: `/v3/users/b7ffd19fc87f4554b447909e0f35b4fd` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:50.496096 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42335e34-de3a-45e4-a88c-202eb674f9af admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ffd19fc87f4554b447909e0f35b4fd)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:50.498058 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42335e34-de3a-45e4-a88c-202eb674f9af admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:50.664334 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a07b13-15af-4795-abbd-d322425b223c service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:50.665773 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-89a07b13-15af-4795-abbd-d322425b223c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:50.680213 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a07b13-15af-4795-abbd-d322425b223c service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:50.684791 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224d3c6-2285-429a-b109-581330980c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:50.685668 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224d3c6-2285-429a-b109-581330980c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:50.685945 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224d3c6-2285-429a-b109-581330980c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:50.686217 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224d3c6-2285-429a-b109-581330980c59 admin admin] PATH_INFO: `/v3/users/2f2e6b14acb44a5d9f38379e3d9a48a9` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:50.687375 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224d3c6-2285-429a-b109-581330980c59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f2e6b14acb44a5d9f38379e3d9a48a9)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:50.690161 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224d3c6-2285-429a-b109-581330980c59 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:50.733239 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-42335e34-de3a-45e4-a88c-202eb674f9af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ffd19fc87f4554b447909e0f35b4fd'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:50.745164 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-42335e34-de3a-45e4-a88c-202eb674f9af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ffd19fc87f4554b447909e0f35b4fd'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:50.752482 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-42335e34-de3a-45e4-a88c-202eb674f9af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ffd19fc87f4554b447909e0f35b4fd'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:50.753140 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-42335e34-de3a-45e4-a88c-202eb674f9af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ffd19fc87f4554b447909e0f35b4fd'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:50.835745 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-42335e34-de3a-45e4-a88c-202eb674f9af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ffd19fc87f4554b447909e0f35b4fd'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:50.841827 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1248/2468] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:37:50 2021] DELETE /identity/v3/users/b7ffd19fc87f4554b447909e0f35b4fd => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:37:50.846959 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b55f8c-2580-4740-bad4-cb43f87c9f8c None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:50.847245 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b55f8c-2580-4740-bad4-cb43f87c9f8c None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:50.847521 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b55f8c-2580-4740-bad4-cb43f87c9f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:50.865067 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-60b55f8c-2580-4740-bad4-cb43f87c9f8c None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:50.866319 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-60b55f8c-2580-4740-bad4-cb43f87c9f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:50.876637 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3224d3c6-2285-429a-b109-581330980c59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f2e6b14acb44a5d9f38379e3d9a48a9'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:50.877303 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3224d3c6-2285-429a-b109-581330980c59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f2e6b14acb44a5d9f38379e3d9a48a9'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:50.883978 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3224d3c6-2285-429a-b109-581330980c59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f2e6b14acb44a5d9f38379e3d9a48a9'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:50.884608 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3224d3c6-2285-429a-b109-581330980c59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f2e6b14acb44a5d9f38379e3d9a48a9'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:50.924598 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1249/2469] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:37:50.934407 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b55f8c-2580-4740-bad4-cb43f87c9f8c None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:50.935702 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-60b55f8c-2580-4740-bad4-cb43f87c9f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:50.961477 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3224d3c6-2285-429a-b109-581330980c59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f2e6b14acb44a5d9f38379e3d9a48a9'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:50.979598 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1221/2470] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:37:50 2021] DELETE /identity/v3/users/2f2e6b14acb44a5d9f38379e3d9a48a9 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:37:50.983959 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3301c56-d342-46a8-86ce-4d9f3eab3e43 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:50.984247 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3301c56-d342-46a8-86ce-4d9f3eab3e43 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:50.984683 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3301c56-d342-46a8-86ce-4d9f3eab3e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:50.991532 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b55f8c-2580-4740-bad4-cb43f87c9f8c None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:51.001854 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-c3301c56-d342-46a8-86ce-4d9f3eab3e43 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:51.003101 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-c3301c56-d342-46a8-86ce-4d9f3eab3e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:51.037380 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2feda-8315-4a14-a664-b5cbca8870b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:51.038307 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2feda-8315-4a14-a664-b5cbca8870b6 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:51.038668 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2feda-8315-4a14-a664-b5cbca8870b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:51.038948 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2feda-8315-4a14-a664-b5cbca8870b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:51.060033 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1222/2471] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:37:51.069817 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3301c56-d342-46a8-86ce-4d9f3eab3e43 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:51.078950 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3301c56-d342-46a8-86ce-4d9f3eab3e43 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:51.082605 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cc309-e6a1-44f4-b4df-a2388677a757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:51.083239 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cc309-e6a1-44f4-b4df-a2388677a757 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:51.083521 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cc309-e6a1-44f4-b4df-a2388677a757 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:51.083792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cc309-e6a1-44f4-b4df-a2388677a757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:51.092698 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cc309-e6a1-44f4-b4df-a2388677a757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:51.094764 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cc309-e6a1-44f4-b4df-a2388677a757 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:51.098340 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2feda-8315-4a14-a664-b5cbca8870b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:51.099902 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2feda-8315-4a14-a664-b5cbca8870b6 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:51.104117 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1223/2472] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:37:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:37:51.110877 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1250/2473] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:37:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:37:51.562706 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cc309-e6a1-44f4-b4df-a2388677a757 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:51.564267 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-381cc309-e6a1-44f4-b4df-a2388677a757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:51.579929 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cc309-e6a1-44f4-b4df-a2388677a757 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:51.585770 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b194f-d7e4-421b-ac76-40884440e287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:51.586593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b194f-d7e4-421b-ac76-40884440e287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:51.586870 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b194f-d7e4-421b-ac76-40884440e287 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:51.587238 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b194f-d7e4-421b-ac76-40884440e287 admin admin] PATH_INFO: `/v3/projects/95e18a80ccaa40cbab445c3cd7476747` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:51.588289 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b194f-d7e4-421b-ac76-40884440e287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e18a80ccaa40cbab445c3cd7476747)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:51.590207 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b194f-d7e4-421b-ac76-40884440e287 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:51.722747 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-389b194f-d7e4-421b-ac76-40884440e287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e18a80ccaa40cbab445c3cd7476747', 'request_id': 'req-389b194f-d7e4-421b-ac76-40884440e287'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:51.729005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-389b194f-d7e4-421b-ac76-40884440e287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e18a80ccaa40cbab445c3cd7476747', 'request_id': 'req-389b194f-d7e4-421b-ac76-40884440e287'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:51.824304 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-389b194f-d7e4-421b-ac76-40884440e287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e18a80ccaa40cbab445c3cd7476747', 'request_id': 'req-389b194f-d7e4-421b-ac76-40884440e287'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:51.834986 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-389b194f-d7e4-421b-ac76-40884440e287 admin admin] The token cache is being invalidate because project 95e18a80ccaa40cbab445c3cd7476747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:37:51.835271 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-389b194f-d7e4-421b-ac76-40884440e287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:51.835890 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-389b194f-d7e4-421b-ac76-40884440e287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:51.837459 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1224/2474] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:37:51 2021] DELETE /identity/v3/projects/95e18a80ccaa40cbab445c3cd7476747 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:37:51.843374 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f51e-3eb6-420e-a8da-6a5e6b88ac30 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:51.843841 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f51e-3eb6-420e-a8da-6a5e6b88ac30 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:51.843953 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f51e-3eb6-420e-a8da-6a5e6b88ac30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:51.863471 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-bb46f51e-3eb6-420e-a8da-6a5e6b88ac30 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:51.864690 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-bb46f51e-3eb6-420e-a8da-6a5e6b88ac30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:51.925023 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1251/2475] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:37:51.932794 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab2048-ef55-4327-a757-d2ac998ec153 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:51.933121 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab2048-ef55-4327-a757-d2ac998ec153 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:51.933402 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab2048-ef55-4327-a757-d2ac998ec153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:51.951417 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-68ab2048-ef55-4327-a757-d2ac998ec153 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:51.952639 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-68ab2048-ef55-4327-a757-d2ac998ec153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:51.961218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1225/2476] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:37:51.965533 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46f51e-3eb6-420e-a8da-6a5e6b88ac30 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:51.976144 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46f51e-3eb6-420e-a8da-6a5e6b88ac30 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:51.980814 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33df0cd-5727-4f60-9770-c6417994ef17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:51.981562 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33df0cd-5727-4f60-9770-c6417994ef17 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:51.981918 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33df0cd-5727-4f60-9770-c6417994ef17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:51.982202 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33df0cd-5727-4f60-9770-c6417994ef17 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:51.982927 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33df0cd-5727-4f60-9770-c6417994ef17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:37:51.983235 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33df0cd-5727-4f60-9770-c6417994ef17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:51.984818 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33df0cd-5727-4f60-9770-c6417994ef17 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:51.999760 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1252/2477] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:37:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:37:52.001883 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab2048-ef55-4327-a757-d2ac998ec153 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:52.010328 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab2048-ef55-4327-a757-d2ac998ec153 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:52.015243 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad6e4e-296d-43f0-8ba2-3fd533f79f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:52.015899 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad6e4e-296d-43f0-8ba2-3fd533f79f8b admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:52.016184 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad6e4e-296d-43f0-8ba2-3fd533f79f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:52.016463 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad6e4e-296d-43f0-8ba2-3fd533f79f8b admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:52.017864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad6e4e-296d-43f0-8ba2-3fd533f79f8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:52.019766 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad6e4e-296d-43f0-8ba2-3fd533f79f8b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:52.096007 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33df0cd-5727-4f60-9770-c6417994ef17 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:52.098649 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c33df0cd-5727-4f60-9770-c6417994ef17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:52.112248 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33df0cd-5727-4f60-9770-c6417994ef17 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:52.117494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8432fc-f9aa-4c55-9ad9-a0fffcd84a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:52.118363 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8432fc-f9aa-4c55-9ad9-a0fffcd84a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:52.118650 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8432fc-f9aa-4c55-9ad9-a0fffcd84a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:52.118924 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8432fc-f9aa-4c55-9ad9-a0fffcd84a50 admin admin] PATH_INFO: `/v3/projects/e7df15110ef9407db5752cfd0254b9b6` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:52.120204 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8432fc-f9aa-4c55-9ad9-a0fffcd84a50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7df15110ef9407db5752cfd0254b9b6)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:52.122052 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8432fc-f9aa-4c55-9ad9-a0fffcd84a50 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:52.132205 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1226/2478] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:37:52 2021] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:37:52.134967 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad6e4e-296d-43f0-8ba2-3fd533f79f8b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:52.194435 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad6e4e-296d-43f0-8ba2-3fd533f79f8b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:52.199055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8f736-cd48-4429-914b-4bcf4115f323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:52.199715 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8f736-cd48-4429-914b-4bcf4115f323 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:52.200006 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8f736-cd48-4429-914b-4bcf4115f323 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:52.200272 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8f736-cd48-4429-914b-4bcf4115f323 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:52.200983 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8f736-cd48-4429-914b-4bcf4115f323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:52.202878 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8f736-cd48-4429-914b-4bcf4115f323 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:52.263579 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-cb8432fc-f9aa-4c55-9ad9-a0fffcd84a50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7df15110ef9407db5752cfd0254b9b6', 'request_id': 'req-cb8432fc-f9aa-4c55-9ad9-a0fffcd84a50'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:52.270593 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-cb8432fc-f9aa-4c55-9ad9-a0fffcd84a50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7df15110ef9407db5752cfd0254b9b6', 'request_id': 'req-cb8432fc-f9aa-4c55-9ad9-a0fffcd84a50'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:52.316638 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1227/2479] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:37:52 2021] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:37:52.320432 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8f736-cd48-4429-914b-4bcf4115f323 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:52.330021 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8f736-cd48-4429-914b-4bcf4115f323 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:52.386218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f1343-695c-4ad4-8201-350b66a3b860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:52.386960 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f1343-695c-4ad4-8201-350b66a3b860 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:52.387245 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f1343-695c-4ad4-8201-350b66a3b860 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:52.387519 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f1343-695c-4ad4-8201-350b66a3b860 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:52.388269 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f1343-695c-4ad4-8201-350b66a3b860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:52.395073 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f1343-695c-4ad4-8201-350b66a3b860 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:52.402025 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1228/2480] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:37:52 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:37:52.404693 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f1343-695c-4ad4-8201-350b66a3b860 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:52.414369 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f1343-695c-4ad4-8201-350b66a3b860 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:52.418775 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-cb8432fc-f9aa-4c55-9ad9-a0fffcd84a50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7df15110ef9407db5752cfd0254b9b6', 'request_id': 'req-cb8432fc-f9aa-4c55-9ad9-a0fffcd84a50'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:52.422550 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c343f6-a371-413e-b66c-c65c6d63ce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:52.422550 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c343f6-a371-413e-b66c-c65c6d63ce65 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:52.422550 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c343f6-a371-413e-b66c-c65c6d63ce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:52.422550 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c343f6-a371-413e-b66c-c65c6d63ce65 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:52.423736 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c343f6-a371-413e-b66c-c65c6d63ce65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:52.423736 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c343f6-a371-413e-b66c-c65c6d63ce65 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:52.430928 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-cb8432fc-f9aa-4c55-9ad9-a0fffcd84a50 admin admin] The token cache is being invalidate because project e7df15110ef9407db5752cfd0254b9b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:37:52.431221 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-cb8432fc-f9aa-4c55-9ad9-a0fffcd84a50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:52.431869 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-cb8432fc-f9aa-4c55-9ad9-a0fffcd84a50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:52.436161 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1229/2481] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:37:52 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:37:52.436298 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1253/2482] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:37:52 2021] DELETE /identity/v3/projects/e7df15110ef9407db5752cfd0254b9b6 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:37:52.437130 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c343f6-a371-413e-b66c-c65c6d63ce65 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:52.438881 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-31c343f6-a371-413e-b66c-c65c6d63ce65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:52.439006 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df1baf-6b95-409f-916f-b2a5973c6744 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:52.439391 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df1baf-6b95-409f-916f-b2a5973c6744 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:52.439675 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df1baf-6b95-409f-916f-b2a5973c6744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:52.452238 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c343f6-a371-413e-b66c-c65c6d63ce65 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:52.457514 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b6fe5-e4a5-4565-ae70-4df9d4ed6601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:52.467861 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b6fe5-e4a5-4565-ae70-4df9d4ed6601 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:52.467861 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b6fe5-e4a5-4565-ae70-4df9d4ed6601 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:52.467861 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b6fe5-e4a5-4565-ae70-4df9d4ed6601 admin admin] PATH_INFO: `/v3/projects/cd65d5540e80463386d99d26ed4e4a67/users/bf9f68a511284950bc6970d4280294a3/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:52.468156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-80df1baf-6b95-409f-916f-b2a5973c6744 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:52.468156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-80df1baf-6b95-409f-916f-b2a5973c6744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:52.468156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1254/2483] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:37:52.473588 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b6fe5-e4a5-4565-ae70-4df9d4ed6601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd65d5540e80463386d99d26ed4e4a67, user_id=bf9f68a511284950bc6970d4280294a3, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:52.476295 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b6fe5-e4a5-4565-ae70-4df9d4ed6601 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:52.476935 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50186e1a-0ca9-471a-a583-12eb9fd515f6 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:52.477224 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50186e1a-0ca9-471a-a583-12eb9fd515f6 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:52.477502 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50186e1a-0ca9-471a-a583-12eb9fd515f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:52.496364 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-50186e1a-0ca9-471a-a583-12eb9fd515f6 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:52.497605 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-50186e1a-0ca9-471a-a583-12eb9fd515f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:52.506092 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1255/2484] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:37:52.510231 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50186e1a-0ca9-471a-a583-12eb9fd515f6 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:52.519494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50186e1a-0ca9-471a-a583-12eb9fd515f6 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:52.524795 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22df47-cd26-428d-b2cb-bfbdfcdf06bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:52.525944 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22df47-cd26-428d-b2cb-bfbdfcdf06bc admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:52.526420 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22df47-cd26-428d-b2cb-bfbdfcdf06bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:52.526894 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22df47-cd26-428d-b2cb-bfbdfcdf06bc admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:52.528193 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22df47-cd26-428d-b2cb-bfbdfcdf06bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:37:52.528743 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22df47-cd26-428d-b2cb-bfbdfcdf06bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:52.531825 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22df47-cd26-428d-b2cb-bfbdfcdf06bc admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:52.545364 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1256/2485] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:37:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:37:52.549351 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22df47-cd26-428d-b2cb-bfbdfcdf06bc admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:52.550538 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1230/2486] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:37:52 2021] PUT /identity/v3/projects/cd65d5540e80463386d99d26ed4e4a67/users/bf9f68a511284950bc6970d4280294a3/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:37:52.559293 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22df47-cd26-428d-b2cb-bfbdfcdf06bc admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:52.560744 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f3eb8-11cb-4d7e-b386-22c0406ca297 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:52.561075 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f3eb8-11cb-4d7e-b386-22c0406ca297 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:52.561352 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f3eb8-11cb-4d7e-b386-22c0406ca297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:52.588693 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-166f3eb8-11cb-4d7e-b386-22c0406ca297 None None] MFA Rules not processed for user `bf9f68a511284950bc6970d4280294a3`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:52.589928 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-166f3eb8-11cb-4d7e-b386-22c0406ca297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:52.615668 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bfd7e-de15-4c93-a5d5-fe7787af05d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:52.616329 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bfd7e-de15-4c93-a5d5-fe7787af05d0 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:52.616611 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bfd7e-de15-4c93-a5d5-fe7787af05d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:52.616913 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bfd7e-de15-4c93-a5d5-fe7787af05d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:52.617597 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bfd7e-de15-4c93-a5d5-fe7787af05d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:52.619497 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bfd7e-de15-4c93-a5d5-fe7787af05d0 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:52.653446 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1231/2487] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:52 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:37:52.663515 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f3eb8-11cb-4d7e-b386-22c0406ca297 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:52.664984 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-166f3eb8-11cb-4d7e-b386-22c0406ca297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:52.720532 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1257/2488] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:37:52 2021] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:37:52.722025 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bfd7e-de15-4c93-a5d5-fe7787af05d0 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:52.724678 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f3eb8-11cb-4d7e-b386-22c0406ca297 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:52.773437 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d1c54-9747-4562-b52f-17787149c517 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:52.774089 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d1c54-9747-4562-b52f-17787149c517 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:52.774373 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d1c54-9747-4562-b52f-17787149c517 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:52.774641 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d1c54-9747-4562-b52f-17787149c517 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:52.782699 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bfd7e-de15-4c93-a5d5-fe7787af05d0 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:52.788022 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8ac47-e77e-46ec-912a-ee77e60f9f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:52.788685 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8ac47-e77e-46ec-912a-ee77e60f9f66 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:52.788995 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8ac47-e77e-46ec-912a-ee77e60f9f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:52.789275 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8ac47-e77e-46ec-912a-ee77e60f9f66 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:52.789960 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8ac47-e77e-46ec-912a-ee77e60f9f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:52.791870 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8ac47-e77e-46ec-912a-ee77e60f9f66 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:52.829334 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d1c54-9747-4562-b52f-17787149c517 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:52.831272 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d1c54-9747-4562-b52f-17787149c517 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:52.839980 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1232/2489] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:37:52 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:37:52.895652 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1258/2490] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:37:52 2021] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:37:52.897824 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d1c54-9747-4562-b52f-17787149c517 service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:52.908628 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d1c54-9747-4562-b52f-17787149c517 service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:52.914218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fba7c-9f8f-44d2-a3c7-1f375a60d87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:52.914871 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fba7c-9f8f-44d2-a3c7-1f375a60d87e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:52.915150 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fba7c-9f8f-44d2-a3c7-1f375a60d87e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:52.915422 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fba7c-9f8f-44d2-a3c7-1f375a60d87e admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:52.916160 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fba7c-9f8f-44d2-a3c7-1f375a60d87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:52.917785 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fba7c-9f8f-44d2-a3c7-1f375a60d87e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:52.928559 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1233/2491] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:37:52 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:37:52.932700 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8ac47-e77e-46ec-912a-ee77e60f9f66 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:52.942970 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8ac47-e77e-46ec-912a-ee77e60f9f66 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:52.947969 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be442bdc-149c-474c-9304-9aa48ae2df94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:52.948633 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be442bdc-149c-474c-9304-9aa48ae2df94 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:52.948947 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be442bdc-149c-474c-9304-9aa48ae2df94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:52.949229 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be442bdc-149c-474c-9304-9aa48ae2df94 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:52.949964 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be442bdc-149c-474c-9304-9aa48ae2df94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:52.951552 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be442bdc-149c-474c-9304-9aa48ae2df94 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:52.962469 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1259/2492] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:37:52 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:37:52.966477 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fba7c-9f8f-44d2-a3c7-1f375a60d87e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:52.977172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fba7c-9f8f-44d2-a3c7-1f375a60d87e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:52.981881 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f4279-3787-43d8-8edb-ca3c96e37a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:52.982846 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f4279-3787-43d8-8edb-ca3c96e37a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:52.983197 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f4279-3787-43d8-8edb-ca3c96e37a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:52.983541 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f4279-3787-43d8-8edb-ca3c96e37a07 admin admin] PATH_INFO: `/v3/projects/52dfd385f66649178ac6b5a0dae3dc2c/users/82c014dd6b1342ec85679bd2dc2f4046/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:52.998233 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f4279-3787-43d8-8edb-ca3c96e37a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52dfd385f66649178ac6b5a0dae3dc2c, user_id=82c014dd6b1342ec85679bd2dc2f4046, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:53.000877 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f4279-3787-43d8-8edb-ca3c96e37a07 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:53.114984 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1234/2493] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:37:52 2021] PUT /identity/v3/projects/52dfd385f66649178ac6b5a0dae3dc2c/users/82c014dd6b1342ec85679bd2dc2f4046/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:37:53.125293 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5a181-33ee-4505-b2d4-a25d9800a10f None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:53.125634 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5a181-33ee-4505-b2d4-a25d9800a10f None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:53.125918 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5a181-33ee-4505-b2d4-a25d9800a10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:53.153486 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-02d5a181-33ee-4505-b2d4-a25d9800a10f None None] MFA Rules not processed for user `82c014dd6b1342ec85679bd2dc2f4046`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:53.154848 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-02d5a181-33ee-4505-b2d4-a25d9800a10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:53.217941 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1260/2494] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:53 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:37:53.222619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f4279-3787-43d8-8edb-ca3c96e37a07 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:53.281963 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f4279-3787-43d8-8edb-ca3c96e37a07 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:53.286959 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2c53d-bb53-4cc5-af5c-142ecf9e076b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:53.287610 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2c53d-bb53-4cc5-af5c-142ecf9e076b admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:53.287895 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2c53d-bb53-4cc5-af5c-142ecf9e076b admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:53.288175 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2c53d-bb53-4cc5-af5c-142ecf9e076b admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:53.288905 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2c53d-bb53-4cc5-af5c-142ecf9e076b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:53.290838 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2c53d-bb53-4cc5-af5c-142ecf9e076b admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:53.454827 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1235/2495] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:37:53 2021] POST /identity/v3/projects => generated 379 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:37:53.458799 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5a181-33ee-4505-b2d4-a25d9800a10f None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:53.469429 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5a181-33ee-4505-b2d4-a25d9800a10f None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:53.522518 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4647a0-f34c-4a4b-8e7a-9b8c17845d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:53.523206 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4647a0-f34c-4a4b-8e7a-9b8c17845d2e admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:53.523489 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4647a0-f34c-4a4b-8e7a-9b8c17845d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:53.523761 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4647a0-f34c-4a4b-8e7a-9b8c17845d2e admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:53.524446 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4647a0-f34c-4a4b-8e7a-9b8c17845d2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:53.526549 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4647a0-f34c-4a4b-8e7a-9b8c17845d2e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:53.682807 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1261/2496] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:37:53 2021] POST /identity/v3/users => generated 296 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:37:53.686875 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2c53d-bb53-4cc5-af5c-142ecf9e076b admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:53.697966 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2c53d-bb53-4cc5-af5c-142ecf9e076b admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:53.702792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a647a3-b8f7-40c8-9994-0c652bce9304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:53.707134 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a647a3-b8f7-40c8-9994-0c652bce9304 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:53.707134 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a647a3-b8f7-40c8-9994-0c652bce9304 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:53.707134 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a647a3-b8f7-40c8-9994-0c652bce9304 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:53.707134 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a647a3-b8f7-40c8-9994-0c652bce9304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:53.707134 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a647a3-b8f7-40c8-9994-0c652bce9304 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:53.717039 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1236/2497] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:37:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:37:53.721008 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4647a0-f34c-4a4b-8e7a-9b8c17845d2e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:53.731425 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4647a0-f34c-4a4b-8e7a-9b8c17845d2e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:53.736206 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126dc38-528d-4735-85b1-6bd2ecbfbc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:53.737779 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126dc38-528d-4735-85b1-6bd2ecbfbc21 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:53.737779 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126dc38-528d-4735-85b1-6bd2ecbfbc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:53.738410 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126dc38-528d-4735-85b1-6bd2ecbfbc21 admin admin] PATH_INFO: `/v3/projects/bb345f8502f049eeb533eb56e6b02a98/users/a9232513b8ef46a6acc1f3f4b2f2263b/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:53.756087 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126dc38-528d-4735-85b1-6bd2ecbfbc21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb345f8502f049eeb533eb56e6b02a98, user_id=a9232513b8ef46a6acc1f3f4b2f2263b, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:53.764929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126dc38-528d-4735-85b1-6bd2ecbfbc21 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:53.849026 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1262/2498] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:37:53 2021] PUT /identity/v3/projects/bb345f8502f049eeb533eb56e6b02a98/users/a9232513b8ef46a6acc1f3f4b2f2263b/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:37:53.852682 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a647a3-b8f7-40c8-9994-0c652bce9304 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:53.863381 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a647a3-b8f7-40c8-9994-0c652bce9304 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:53.916710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19bfbd-c966-44f0-b652-420cabfcd567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:53.917394 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19bfbd-c966-44f0-b652-420cabfcd567 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:53.917698 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19bfbd-c966-44f0-b652-420cabfcd567 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:53.917983 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19bfbd-c966-44f0-b652-420cabfcd567 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:53.918668 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19bfbd-c966-44f0-b652-420cabfcd567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:53.920388 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19bfbd-c966-44f0-b652-420cabfcd567 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:53.931169 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1237/2499] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:37:53 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:37:53.935259 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126dc38-528d-4735-85b1-6bd2ecbfbc21 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:53.945782 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126dc38-528d-4735-85b1-6bd2ecbfbc21 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:53.950660 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d831d-5c48-4043-8ee1-ded273bede63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:53.954324 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d831d-5c48-4043-8ee1-ded273bede63 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:53.954324 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d831d-5c48-4043-8ee1-ded273bede63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:53.954324 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d831d-5c48-4043-8ee1-ded273bede63 admin admin] PATH_INFO: `/v3/projects/bb345f8502f049eeb533eb56e6b02a98/users/a9232513b8ef46a6acc1f3f4b2f2263b/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:53.954324 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d831d-5c48-4043-8ee1-ded273bede63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb345f8502f049eeb533eb56e6b02a98, user_id=a9232513b8ef46a6acc1f3f4b2f2263b, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:53.956826 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d831d-5c48-4043-8ee1-ded273bede63 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:53.967795 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1263/2500] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:37:53 2021] PUT /identity/v3/projects/bb345f8502f049eeb533eb56e6b02a98/users/a9232513b8ef46a6acc1f3f4b2f2263b/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:37:53.985854 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df57b14-f935-4805-98c7-2d8f6ae56a84 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:53.985854 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df57b14-f935-4805-98c7-2d8f6ae56a84 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:53.985854 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df57b14-f935-4805-98c7-2d8f6ae56a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:54.006867 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-5df57b14-f935-4805-98c7-2d8f6ae56a84 None None] MFA Rules not processed for user `a9232513b8ef46a6acc1f3f4b2f2263b`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:54.011916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-5df57b14-f935-4805-98c7-2d8f6ae56a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:54.074306 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1238/2501] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:53 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:37:54.080258 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d831d-5c48-4043-8ee1-ded273bede63 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:54.140800 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d831d-5c48-4043-8ee1-ded273bede63 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:54.146208 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be5213-cf36-4935-8664-05c533771c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:54.147059 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be5213-cf36-4935-8664-05c533771c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:54.147338 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be5213-cf36-4935-8664-05c533771c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:54.147611 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be5213-cf36-4935-8664-05c533771c1f admin admin] PATH_INFO: `/v3/users/82c014dd6b1342ec85679bd2dc2f4046` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:54.148777 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be5213-cf36-4935-8664-05c533771c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c014dd6b1342ec85679bd2dc2f4046)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:54.150706 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be5213-cf36-4935-8664-05c533771c1f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:54.321575 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-96be5213-cf36-4935-8664-05c533771c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c014dd6b1342ec85679bd2dc2f4046'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:54.333329 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-96be5213-cf36-4935-8664-05c533771c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c014dd6b1342ec85679bd2dc2f4046'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:54.339901 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-96be5213-cf36-4935-8664-05c533771c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c014dd6b1342ec85679bd2dc2f4046'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:54.340583 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-96be5213-cf36-4935-8664-05c533771c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c014dd6b1342ec85679bd2dc2f4046'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:54.452308 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-96be5213-cf36-4935-8664-05c533771c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c014dd6b1342ec85679bd2dc2f4046'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:54.459377 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1264/2502] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:37:54 2021] DELETE /identity/v3/users/82c014dd6b1342ec85679bd2dc2f4046 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:37:54.464221 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a36da-89a2-4b2a-ae54-6addb438a948 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:54.464514 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a36da-89a2-4b2a-ae54-6addb438a948 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:54.464794 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a36da-89a2-4b2a-ae54-6addb438a948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:54.482735 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-850a36da-89a2-4b2a-ae54-6addb438a948 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:54.483930 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-850a36da-89a2-4b2a-ae54-6addb438a948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:54.540588 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1239/2503] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:37:54.550678 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be5213-cf36-4935-8664-05c533771c1f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:54.552093 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-96be5213-cf36-4935-8664-05c533771c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:54.607769 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be5213-cf36-4935-8664-05c533771c1f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:54.611497 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a3760-2ff7-45f7-b0ad-5a83fc6c28a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:54.612228 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a3760-2ff7-45f7-b0ad-5a83fc6c28a7 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:54.612644 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a3760-2ff7-45f7-b0ad-5a83fc6c28a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:54.612959 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a3760-2ff7-45f7-b0ad-5a83fc6c28a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:54.622114 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a3760-2ff7-45f7-b0ad-5a83fc6c28a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:54.623580 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a3760-2ff7-45f7-b0ad-5a83fc6c28a7 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:54.633575 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1265/2504] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:37:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:37:55.086219 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a36da-89a2-4b2a-ae54-6addb438a948 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:55.086219 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-850a36da-89a2-4b2a-ae54-6addb438a948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:55.096375 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a36da-89a2-4b2a-ae54-6addb438a948 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:55.101178 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e94b5-0efc-4cd5-b0f3-452711b17d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:55.102122 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e94b5-0efc-4cd5-b0f3-452711b17d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:55.102449 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e94b5-0efc-4cd5-b0f3-452711b17d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:55.102677 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e94b5-0efc-4cd5-b0f3-452711b17d2d admin admin] PATH_INFO: `/v3/projects/52dfd385f66649178ac6b5a0dae3dc2c` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:55.103852 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e94b5-0efc-4cd5-b0f3-452711b17d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=52dfd385f66649178ac6b5a0dae3dc2c)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:55.105780 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e94b5-0efc-4cd5-b0f3-452711b17d2d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:55.276062 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-e80e94b5-0efc-4cd5-b0f3-452711b17d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52dfd385f66649178ac6b5a0dae3dc2c', 'request_id': 'req-e80e94b5-0efc-4cd5-b0f3-452711b17d2d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:55.282192 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-e80e94b5-0efc-4cd5-b0f3-452711b17d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52dfd385f66649178ac6b5a0dae3dc2c', 'request_id': 'req-e80e94b5-0efc-4cd5-b0f3-452711b17d2d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:55.395821 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-e80e94b5-0efc-4cd5-b0f3-452711b17d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52dfd385f66649178ac6b5a0dae3dc2c', 'request_id': 'req-e80e94b5-0efc-4cd5-b0f3-452711b17d2d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:55.406473 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-e80e94b5-0efc-4cd5-b0f3-452711b17d2d admin admin] The token cache is being invalidate because project 52dfd385f66649178ac6b5a0dae3dc2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:37:55.406754 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-e80e94b5-0efc-4cd5-b0f3-452711b17d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:55.407360 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-e80e94b5-0efc-4cd5-b0f3-452711b17d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:55.409493 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1240/2505] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:37:55 2021] DELETE /identity/v3/projects/52dfd385f66649178ac6b5a0dae3dc2c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:37:55.413605 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a3760-2ff7-45f7-b0ad-5a83fc6c28a7 service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:55.423670 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a3760-2ff7-45f7-b0ad-5a83fc6c28a7 service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:55.479124 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2072ec-a347-486c-ba68-1579612c8f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:55.479989 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2072ec-a347-486c-ba68-1579612c8f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:55.480278 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2072ec-a347-486c-ba68-1579612c8f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:55.480555 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2072ec-a347-486c-ba68-1579612c8f5a admin admin] PATH_INFO: `/v3/users/a9232513b8ef46a6acc1f3f4b2f2263b` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:55.481764 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2072ec-a347-486c-ba68-1579612c8f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9232513b8ef46a6acc1f3f4b2f2263b)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:55.483666 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2072ec-a347-486c-ba68-1579612c8f5a admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:55.756404 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3f2072ec-a347-486c-ba68-1579612c8f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9232513b8ef46a6acc1f3f4b2f2263b'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:55.767568 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3f2072ec-a347-486c-ba68-1579612c8f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9232513b8ef46a6acc1f3f4b2f2263b'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:55.774754 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3f2072ec-a347-486c-ba68-1579612c8f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9232513b8ef46a6acc1f3f4b2f2263b'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:55.775425 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3f2072ec-a347-486c-ba68-1579612c8f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9232513b8ef46a6acc1f3f4b2f2263b'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:55.886101 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3f2072ec-a347-486c-ba68-1579612c8f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9232513b8ef46a6acc1f3f4b2f2263b'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:55.892210 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1266/2506] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:37:55 2021] DELETE /identity/v3/users/a9232513b8ef46a6acc1f3f4b2f2263b => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:37:56.333482 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e94b5-0efc-4cd5-b0f3-452711b17d2d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:56.335011 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e80e94b5-0efc-4cd5-b0f3-452711b17d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:56.350912 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e94b5-0efc-4cd5-b0f3-452711b17d2d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:56.408005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0b374-c027-4e07-8f03-b2b7f1456086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:56.408995 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0b374-c027-4e07-8f03-b2b7f1456086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:56.409274 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0b374-c027-4e07-8f03-b2b7f1456086 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:56.409552 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0b374-c027-4e07-8f03-b2b7f1456086 admin admin] PATH_INFO: `/v3/projects/bb345f8502f049eeb533eb56e6b02a98` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:56.410724 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0b374-c027-4e07-8f03-b2b7f1456086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb345f8502f049eeb533eb56e6b02a98)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:56.412624 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0b374-c027-4e07-8f03-b2b7f1456086 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:56.505029 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-21c0b374-c027-4e07-8f03-b2b7f1456086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb345f8502f049eeb533eb56e6b02a98', 'request_id': 'req-21c0b374-c027-4e07-8f03-b2b7f1456086'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:56.511044 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-21c0b374-c027-4e07-8f03-b2b7f1456086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb345f8502f049eeb533eb56e6b02a98', 'request_id': 'req-21c0b374-c027-4e07-8f03-b2b7f1456086'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:56.578454 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-21c0b374-c027-4e07-8f03-b2b7f1456086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb345f8502f049eeb533eb56e6b02a98', 'request_id': 'req-21c0b374-c027-4e07-8f03-b2b7f1456086'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:56.589898 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-21c0b374-c027-4e07-8f03-b2b7f1456086 admin admin] The token cache is being invalidate because project bb345f8502f049eeb533eb56e6b02a98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:37:56.590185 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-21c0b374-c027-4e07-8f03-b2b7f1456086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:56.590818 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-21c0b374-c027-4e07-8f03-b2b7f1456086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:56.592374 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1241/2507] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:37:56 2021] DELETE /identity/v3/projects/bb345f8502f049eeb533eb56e6b02a98 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:37:56.598510 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdec4d8-6e88-4da1-a5a3-1eb85ea9cdd5 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:56.598982 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdec4d8-6e88-4da1-a5a3-1eb85ea9cdd5 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:56.599166 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdec4d8-6e88-4da1-a5a3-1eb85ea9cdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:56.621734 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-3fdec4d8-6e88-4da1-a5a3-1eb85ea9cdd5 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:56.622948 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-3fdec4d8-6e88-4da1-a5a3-1eb85ea9cdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:56.681406 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1267/2508] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:37:56.689233 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7e674-85f6-49e5-afbe-aae7e56c8407 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:56.689543 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7e674-85f6-49e5-afbe-aae7e56c8407 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:56.689824 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7e674-85f6-49e5-afbe-aae7e56c8407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:56.708550 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-59c7e674-85f6-49e5-afbe-aae7e56c8407 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:56.709791 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-59c7e674-85f6-49e5-afbe-aae7e56c8407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:56.717739 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1242/2509] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:37:56.723372 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdec4d8-6e88-4da1-a5a3-1eb85ea9cdd5 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:56.740798 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdec4d8-6e88-4da1-a5a3-1eb85ea9cdd5 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:56.745976 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b97a7-07e9-45b3-98cb-a2a89fe1a2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:56.746664 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b97a7-07e9-45b3-98cb-a2a89fe1a2ca admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:56.746949 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b97a7-07e9-45b3-98cb-a2a89fe1a2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:56.747256 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b97a7-07e9-45b3-98cb-a2a89fe1a2ca admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:56.748008 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b97a7-07e9-45b3-98cb-a2a89fe1a2ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:37:56.748345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b97a7-07e9-45b3-98cb-a2a89fe1a2ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:56.750001 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b97a7-07e9-45b3-98cb-a2a89fe1a2ca admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:56.762358 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1268/2510] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:37:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:37:56.767378 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7e674-85f6-49e5-afbe-aae7e56c8407 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:56.776553 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7e674-85f6-49e5-afbe-aae7e56c8407 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:56.781789 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9c30b-eecf-4c00-b335-d8a4c68cfbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:56.782438 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c30b-eecf-4c00-b335-d8a4c68cfbbc admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:56.782722 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c30b-eecf-4c00-b335-d8a4c68cfbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:56.782994 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c30b-eecf-4c00-b335-d8a4c68cfbbc admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:56.784205 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9c30b-eecf-4c00-b335-d8a4c68cfbbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:56.786133 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9c30b-eecf-4c00-b335-d8a4c68cfbbc admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:56.911959 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1243/2511] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:37:56 2021] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:37:56.915997 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b97a7-07e9-45b3-98cb-a2a89fe1a2ca admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:56.927024 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b97a7-07e9-45b3-98cb-a2a89fe1a2ca admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:56.980416 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d48a2c-aeb9-4b4e-9d36-d710f9ab6d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:56.981120 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d48a2c-aeb9-4b4e-9d36-d710f9ab6d02 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:56.981401 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d48a2c-aeb9-4b4e-9d36-d710f9ab6d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:56.981674 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d48a2c-aeb9-4b4e-9d36-d710f9ab6d02 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:56.982355 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d48a2c-aeb9-4b4e-9d36-d710f9ab6d02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:56.984241 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d48a2c-aeb9-4b4e-9d36-d710f9ab6d02 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:57.087660 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1269/2512] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:37:56 2021] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:37:57.091725 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9c30b-eecf-4c00-b335-d8a4c68cfbbc admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:57.102439 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9c30b-eecf-4c00-b335-d8a4c68cfbbc admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:57.107438 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf3afe-ddc4-448a-a609-d778c178a535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:57.108084 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf3afe-ddc4-448a-a609-d778c178a535 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:57.108360 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf3afe-ddc4-448a-a609-d778c178a535 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:57.114413 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf3afe-ddc4-448a-a609-d778c178a535 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:57.114413 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf3afe-ddc4-448a-a609-d778c178a535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:57.114413 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf3afe-ddc4-448a-a609-d778c178a535 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:57.121271 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1244/2513] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:37:57 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:37:57.125153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d48a2c-aeb9-4b4e-9d36-d710f9ab6d02 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:57.135541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d48a2c-aeb9-4b4e-9d36-d710f9ab6d02 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:57.141174 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c101d7-de90-4871-95d1-14d1a799eaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:57.142036 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c101d7-de90-4871-95d1-14d1a799eaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:57.145275 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c101d7-de90-4871-95d1-14d1a799eaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:57.145275 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c101d7-de90-4871-95d1-14d1a799eaa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:57.145275 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c101d7-de90-4871-95d1-14d1a799eaa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:57.145573 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c101d7-de90-4871-95d1-14d1a799eaa8 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:57.155574 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1270/2514] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:37:57 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:37:57.160299 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf3afe-ddc4-448a-a609-d778c178a535 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:57.170567 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf3afe-ddc4-448a-a609-d778c178a535 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:57.175961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79497725-bd65-46b9-969d-d12556832202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:57.176850 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79497725-bd65-46b9-969d-d12556832202 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:57.177157 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79497725-bd65-46b9-969d-d12556832202 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:57.177436 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79497725-bd65-46b9-969d-d12556832202 admin admin] PATH_INFO: `/v3/projects/1e4532d3ede34fe29d9aa3f40e5bdf14/users/948dc6033c0e49caab64c386f432790f/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:57.191748 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79497725-bd65-46b9-969d-d12556832202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4532d3ede34fe29d9aa3f40e5bdf14, user_id=948dc6033c0e49caab64c386f432790f, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:57.194413 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79497725-bd65-46b9-969d-d12556832202 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:57.270978 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1245/2515] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:37:57 2021] PUT /identity/v3/projects/1e4532d3ede34fe29d9aa3f40e5bdf14/users/948dc6033c0e49caab64c386f432790f/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:37:57.283766 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd8c57-3d77-44bf-91a7-0431689237b4 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:57.283983 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd8c57-3d77-44bf-91a7-0431689237b4 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:57.284265 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd8c57-3d77-44bf-91a7-0431689237b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:57.311218 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-40dd8c57-3d77-44bf-91a7-0431689237b4 None None] MFA Rules not processed for user `948dc6033c0e49caab64c386f432790f`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:57.312431 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-40dd8c57-3d77-44bf-91a7-0431689237b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:57.375658 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1271/2516] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:57 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:37:57.380190 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79497725-bd65-46b9-969d-d12556832202 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:57.447290 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79497725-bd65-46b9-969d-d12556832202 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:57.451941 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc97365-d301-4be3-b4fe-a5527f08d577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:57.454628 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc97365-d301-4be3-b4fe-a5527f08d577 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:57.454628 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc97365-d301-4be3-b4fe-a5527f08d577 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:57.454628 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc97365-d301-4be3-b4fe-a5527f08d577 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:57.454628 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc97365-d301-4be3-b4fe-a5527f08d577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:57.455702 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc97365-d301-4be3-b4fe-a5527f08d577 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:57.534243 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1246/2517] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:37:57 2021] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:37:57.538509 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd8c57-3d77-44bf-91a7-0431689237b4 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:57.549270 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd8c57-3d77-44bf-91a7-0431689237b4 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:57.603393 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bff1a2-063c-4dcd-b243-7c33d8a0f884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:57.604056 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bff1a2-063c-4dcd-b243-7c33d8a0f884 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:57.604324 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bff1a2-063c-4dcd-b243-7c33d8a0f884 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:57.604597 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bff1a2-063c-4dcd-b243-7c33d8a0f884 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:57.605345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bff1a2-063c-4dcd-b243-7c33d8a0f884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:57.607256 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bff1a2-063c-4dcd-b243-7c33d8a0f884 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:57.704519 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1272/2518] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:37:57 2021] POST /identity/v3/users => generated 300 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:37:57.709251 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc97365-d301-4be3-b4fe-a5527f08d577 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:57.719764 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc97365-d301-4be3-b4fe-a5527f08d577 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:57.724478 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f820f6-7400-47f0-8e77-7352d09023ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:57.725156 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f820f6-7400-47f0-8e77-7352d09023ef admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:57.725436 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f820f6-7400-47f0-8e77-7352d09023ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:57.725772 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f820f6-7400-47f0-8e77-7352d09023ef admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:57.726505 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f820f6-7400-47f0-8e77-7352d09023ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:57.728082 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f820f6-7400-47f0-8e77-7352d09023ef admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:57.738273 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1247/2519] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:37:57 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:37:57.742375 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bff1a2-063c-4dcd-b243-7c33d8a0f884 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:57.752091 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bff1a2-063c-4dcd-b243-7c33d8a0f884 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:57.757973 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca5f1b-51f8-4505-b663-5be0ab11a688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:57.758876 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca5f1b-51f8-4505-b663-5be0ab11a688 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:57.759160 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca5f1b-51f8-4505-b663-5be0ab11a688 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:57.759433 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca5f1b-51f8-4505-b663-5be0ab11a688 admin admin] PATH_INFO: `/v3/projects/7017938b9fb74c67af24c6c18d5e0b4e/users/edf2272b3b4c43a4a343f930bbac1171/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:57.774541 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca5f1b-51f8-4505-b663-5be0ab11a688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7017938b9fb74c67af24c6c18d5e0b4e, user_id=edf2272b3b4c43a4a343f930bbac1171, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:57.777345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca5f1b-51f8-4505-b663-5be0ab11a688 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:57.857348 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1273/2520] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:37:57 2021] PUT /identity/v3/projects/7017938b9fb74c67af24c6c18d5e0b4e/users/edf2272b3b4c43a4a343f930bbac1171/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:37:57.861250 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f820f6-7400-47f0-8e77-7352d09023ef admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:57.871758 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f820f6-7400-47f0-8e77-7352d09023ef admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:57.927163 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdc85e-a804-4cfc-beeb-1847d05a1b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:57.927856 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdc85e-a804-4cfc-beeb-1847d05a1b41 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:57.928135 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdc85e-a804-4cfc-beeb-1847d05a1b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:57.928515 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdc85e-a804-4cfc-beeb-1847d05a1b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:57.929260 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdc85e-a804-4cfc-beeb-1847d05a1b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:57.930836 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdc85e-a804-4cfc-beeb-1847d05a1b41 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:57.940323 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1248/2521] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:37:57 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:37:57.945222 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca5f1b-51f8-4505-b663-5be0ab11a688 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:57.955103 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca5f1b-51f8-4505-b663-5be0ab11a688 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:57.959775 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07090610-c3ed-459b-9936-1038f97966f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:57.960697 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07090610-c3ed-459b-9936-1038f97966f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:57.961009 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07090610-c3ed-459b-9936-1038f97966f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:57.961279 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07090610-c3ed-459b-9936-1038f97966f5 admin admin] PATH_INFO: `/v3/projects/7017938b9fb74c67af24c6c18d5e0b4e/users/edf2272b3b4c43a4a343f930bbac1171/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:57.963199 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07090610-c3ed-459b-9936-1038f97966f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7017938b9fb74c67af24c6c18d5e0b4e, user_id=edf2272b3b4c43a4a343f930bbac1171, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:57.965833 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07090610-c3ed-459b-9936-1038f97966f5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:57.976484 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1274/2522] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:37:57 2021] PUT /identity/v3/projects/7017938b9fb74c67af24c6c18d5e0b4e/users/edf2272b3b4c43a4a343f930bbac1171/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:37:57.987832 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2d2c1-af0e-4ae8-991d-a546835ea73a None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:57.988118 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2d2c1-af0e-4ae8-991d-a546835ea73a None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:57.988430 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2d2c1-af0e-4ae8-991d-a546835ea73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:58.015633 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-7ab2d2c1-af0e-4ae8-991d-a546835ea73a None None] MFA Rules not processed for user `edf2272b3b4c43a4a343f930bbac1171`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:58.016875 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-7ab2d2c1-af0e-4ae8-991d-a546835ea73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:58.085020 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1249/2523] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:57 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:37:58.095648 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07090610-c3ed-459b-9936-1038f97966f5 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:58.097345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-07090610-c3ed-459b-9936-1038f97966f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:58.152337 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07090610-c3ed-459b-9936-1038f97966f5 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:58.156139 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c318785-f389-4c86-b4c6-37c0ed3760f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:58.156812 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c318785-f389-4c86-b4c6-37c0ed3760f2 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:58.157124 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c318785-f389-4c86-b4c6-37c0ed3760f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:58.157401 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c318785-f389-4c86-b4c6-37c0ed3760f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:58.167022 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c318785-f389-4c86-b4c6-37c0ed3760f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:58.168444 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c318785-f389-4c86-b4c6-37c0ed3760f2 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:58.178559 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1275/2524] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:37:58 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:37:58.205364 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2d2c1-af0e-4ae8-991d-a546835ea73a None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:58.264287 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2d2c1-af0e-4ae8-991d-a546835ea73a None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:58.269031 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1900ff-2a06-497d-83a9-a2ff9384ab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:58.269890 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1900ff-2a06-497d-83a9-a2ff9384ab78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:58.270207 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1900ff-2a06-497d-83a9-a2ff9384ab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:58.270494 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1900ff-2a06-497d-83a9-a2ff9384ab78 admin admin] PATH_INFO: `/v3/users/948dc6033c0e49caab64c386f432790f` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:58.271743 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1900ff-2a06-497d-83a9-a2ff9384ab78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=948dc6033c0e49caab64c386f432790f)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:58.273673 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1900ff-2a06-497d-83a9-a2ff9384ab78 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:58.439192 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-1d1900ff-2a06-497d-83a9-a2ff9384ab78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948dc6033c0e49caab64c386f432790f'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:58.439943 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-1d1900ff-2a06-497d-83a9-a2ff9384ab78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948dc6033c0e49caab64c386f432790f'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:58.446619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-1d1900ff-2a06-497d-83a9-a2ff9384ab78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948dc6033c0e49caab64c386f432790f'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:58.447259 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-1d1900ff-2a06-497d-83a9-a2ff9384ab78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948dc6033c0e49caab64c386f432790f'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:58.514892 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-1d1900ff-2a06-497d-83a9-a2ff9384ab78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948dc6033c0e49caab64c386f432790f'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:58.532723 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1250/2525] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:37:58 2021] DELETE /identity/v3/users/948dc6033c0e49caab64c386f432790f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:37:58.537897 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469713f-fd2f-48df-a2dc-dbd65acead91 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:58.538247 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469713f-fd2f-48df-a2dc-dbd65acead91 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:58.538607 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469713f-fd2f-48df-a2dc-dbd65acead91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:58.560222 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f469713f-fd2f-48df-a2dc-dbd65acead91 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:37:58.561528 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f469713f-fd2f-48df-a2dc-dbd65acead91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:58.630909 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1276/2526] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:37:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:37:58.641157 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1900ff-2a06-497d-83a9-a2ff9384ab78 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:58.643351 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1d1900ff-2a06-497d-83a9-a2ff9384ab78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:58.719174 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1900ff-2a06-497d-83a9-a2ff9384ab78 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:58.723287 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad61aa7-56ed-4904-831b-f6ca0ce35bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:58.724538 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad61aa7-56ed-4904-831b-f6ca0ce35bff service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:58.724901 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad61aa7-56ed-4904-831b-f6ca0ce35bff service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:58.725236 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad61aa7-56ed-4904-831b-f6ca0ce35bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:58.735568 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad61aa7-56ed-4904-831b-f6ca0ce35bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:58.737009 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad61aa7-56ed-4904-831b-f6ca0ce35bff service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:58.752851 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1251/2527] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:37:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:37:59.184506 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469713f-fd2f-48df-a2dc-dbd65acead91 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:59.184506 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f469713f-fd2f-48df-a2dc-dbd65acead91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:37:59.199553 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469713f-fd2f-48df-a2dc-dbd65acead91 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:59.204266 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c952cc7-5e51-4c74-a5fd-e0682aed2dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:59.205241 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c952cc7-5e51-4c74-a5fd-e0682aed2dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:59.205490 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c952cc7-5e51-4c74-a5fd-e0682aed2dce admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:59.205947 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c952cc7-5e51-4c74-a5fd-e0682aed2dce admin admin] PATH_INFO: `/v3/projects/1e4532d3ede34fe29d9aa3f40e5bdf14` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:59.207142 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c952cc7-5e51-4c74-a5fd-e0682aed2dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e4532d3ede34fe29d9aa3f40e5bdf14)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:59.209490 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c952cc7-5e51-4c74-a5fd-e0682aed2dce admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:59.334337 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-6c952cc7-5e51-4c74-a5fd-e0682aed2dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e4532d3ede34fe29d9aa3f40e5bdf14', 'request_id': 'req-6c952cc7-5e51-4c74-a5fd-e0682aed2dce'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:59.340506 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-6c952cc7-5e51-4c74-a5fd-e0682aed2dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e4532d3ede34fe29d9aa3f40e5bdf14', 'request_id': 'req-6c952cc7-5e51-4c74-a5fd-e0682aed2dce'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:59.407321 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-6c952cc7-5e51-4c74-a5fd-e0682aed2dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e4532d3ede34fe29d9aa3f40e5bdf14', 'request_id': 'req-6c952cc7-5e51-4c74-a5fd-e0682aed2dce'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:59.419472 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-6c952cc7-5e51-4c74-a5fd-e0682aed2dce admin admin] The token cache is being invalidate because project 1e4532d3ede34fe29d9aa3f40e5bdf14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:37:59.419765 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-6c952cc7-5e51-4c74-a5fd-e0682aed2dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:59.420432 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-6c952cc7-5e51-4c74-a5fd-e0682aed2dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:59.425267 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1277/2528] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:37:59 2021] DELETE /identity/v3/projects/1e4532d3ede34fe29d9aa3f40e5bdf14 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:37:59.427194 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad61aa7-56ed-4904-831b-f6ca0ce35bff service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:37:59.437767 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad61aa7-56ed-4904-831b-f6ca0ce35bff service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:37:59.501084 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924eabd-e6b1-46c7-a3a0-bcf9f2487de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:37:59.501852 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924eabd-e6b1-46c7-a3a0-bcf9f2487de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:37:59.502128 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924eabd-e6b1-46c7-a3a0-bcf9f2487de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:37:59.502403 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924eabd-e6b1-46c7-a3a0-bcf9f2487de1 admin admin] PATH_INFO: `/v3/users/edf2272b3b4c43a4a343f930bbac1171` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:37:59.503634 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924eabd-e6b1-46c7-a3a0-bcf9f2487de1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edf2272b3b4c43a4a343f930bbac1171)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:37:59.505749 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924eabd-e6b1-46c7-a3a0-bcf9f2487de1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:37:59.747636 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-6924eabd-e6b1-46c7-a3a0-bcf9f2487de1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edf2272b3b4c43a4a343f930bbac1171'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:59.748310 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-6924eabd-e6b1-46c7-a3a0-bcf9f2487de1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edf2272b3b4c43a4a343f930bbac1171'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:59.756105 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-6924eabd-e6b1-46c7-a3a0-bcf9f2487de1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edf2272b3b4c43a4a343f930bbac1171'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:59.756853 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-6924eabd-e6b1-46c7-a3a0-bcf9f2487de1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edf2272b3b4c43a4a343f930bbac1171'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:59.840442 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-6924eabd-e6b1-46c7-a3a0-bcf9f2487de1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edf2272b3b4c43a4a343f930bbac1171'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:37:59.857935 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1252/2529] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:37:59 2021] DELETE /identity/v3/users/edf2272b3b4c43a4a343f930bbac1171 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:38:00.295013 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c952cc7-5e51-4c74-a5fd-e0682aed2dce admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:00.296529 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-6c952cc7-5e51-4c74-a5fd-e0682aed2dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:00.331772 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c952cc7-5e51-4c74-a5fd-e0682aed2dce admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:00.380948 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee6cf5-cb40-403d-b26a-9d85860c4874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:00.381817 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6cf5-cb40-403d-b26a-9d85860c4874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:00.382097 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6cf5-cb40-403d-b26a-9d85860c4874 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:00.382374 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6cf5-cb40-403d-b26a-9d85860c4874 admin admin] PATH_INFO: `/v3/projects/7017938b9fb74c67af24c6c18d5e0b4e` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:00.383685 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee6cf5-cb40-403d-b26a-9d85860c4874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7017938b9fb74c67af24c6c18d5e0b4e)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:00.385551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee6cf5-cb40-403d-b26a-9d85860c4874 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:00.513308 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-68ee6cf5-cb40-403d-b26a-9d85860c4874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7017938b9fb74c67af24c6c18d5e0b4e', 'request_id': 'req-68ee6cf5-cb40-403d-b26a-9d85860c4874'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:00.521102 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-68ee6cf5-cb40-403d-b26a-9d85860c4874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7017938b9fb74c67af24c6c18d5e0b4e', 'request_id': 'req-68ee6cf5-cb40-403d-b26a-9d85860c4874'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:00.584694 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-68ee6cf5-cb40-403d-b26a-9d85860c4874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7017938b9fb74c67af24c6c18d5e0b4e', 'request_id': 'req-68ee6cf5-cb40-403d-b26a-9d85860c4874'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:00.600208 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-68ee6cf5-cb40-403d-b26a-9d85860c4874 admin admin] The token cache is being invalidate because project 7017938b9fb74c67af24c6c18d5e0b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:38:00.600785 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-68ee6cf5-cb40-403d-b26a-9d85860c4874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:00.601481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-68ee6cf5-cb40-403d-b26a-9d85860c4874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:00.603286 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1278/2530] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:38:00 2021] DELETE /identity/v3/projects/7017938b9fb74c67af24c6c18d5e0b4e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:00.609198 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c6c65-b58a-4f6c-942e-7928ee461ef4 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:00.609708 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c6c65-b58a-4f6c-942e-7928ee461ef4 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:00.610117 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c6c65-b58a-4f6c-942e-7928ee461ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:00.633313 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-a14c6c65-b58a-4f6c-942e-7928ee461ef4 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:00.634553 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a14c6c65-b58a-4f6c-942e-7928ee461ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:00.702492 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1253/2531] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:38:00.710138 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f2013-3c1a-4911-8bbb-410daa1bd9ae None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:00.710451 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f2013-3c1a-4911-8bbb-410daa1bd9ae None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:00.710732 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f2013-3c1a-4911-8bbb-410daa1bd9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:00.731618 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-ea6f2013-3c1a-4911-8bbb-410daa1bd9ae None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:00.732982 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-ea6f2013-3c1a-4911-8bbb-410daa1bd9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:00.746091 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1279/2532] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:00.747714 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c6c65-b58a-4f6c-942e-7928ee461ef4 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:00.758794 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c6c65-b58a-4f6c-942e-7928ee461ef4 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:00.763668 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af693c3b-df19-42b6-8777-767432b391a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:00.764434 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af693c3b-df19-42b6-8777-767432b391a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:00.764806 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af693c3b-df19-42b6-8777-767432b391a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:00.765383 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af693c3b-df19-42b6-8777-767432b391a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:00.766177 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af693c3b-df19-42b6-8777-767432b391a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:38:00.766558 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af693c3b-df19-42b6-8777-767432b391a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:00.768325 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af693c3b-df19-42b6-8777-767432b391a6 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:00.783562 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1254/2533] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:38:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:38:00.784748 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f2013-3c1a-4911-8bbb-410daa1bd9ae None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:00.795329 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f2013-3c1a-4911-8bbb-410daa1bd9ae None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:00.800685 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060041f-f7c1-4ad6-af1b-0a60ceedd2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:00.802024 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060041f-f7c1-4ad6-af1b-0a60ceedd2df admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:00.802388 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060041f-f7c1-4ad6-af1b-0a60ceedd2df admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:00.802643 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060041f-f7c1-4ad6-af1b-0a60ceedd2df admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:00.803456 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060041f-f7c1-4ad6-af1b-0a60ceedd2df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:00.805907 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060041f-f7c1-4ad6-af1b-0a60ceedd2df admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:00.929147 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1280/2534] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:38:00 2021] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:38:00.932958 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af693c3b-df19-42b6-8777-767432b391a6 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:00.944365 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af693c3b-df19-42b6-8777-767432b391a6 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:01.003940 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe171f78-4e17-4c15-9bbf-01e99bd323ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:01.004885 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe171f78-4e17-4c15-9bbf-01e99bd323ab admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:01.005697 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe171f78-4e17-4c15-9bbf-01e99bd323ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:01.005972 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe171f78-4e17-4c15-9bbf-01e99bd323ab admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:01.006691 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe171f78-4e17-4c15-9bbf-01e99bd323ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:01.008623 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe171f78-4e17-4c15-9bbf-01e99bd323ab admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:01.128247 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1255/2535] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:38:00 2021] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:38:01.131569 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060041f-f7c1-4ad6-af1b-0a60ceedd2df admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:01.145839 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060041f-f7c1-4ad6-af1b-0a60ceedd2df admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:01.159184 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5019da-9885-4df8-9622-ea4e66f31fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:01.159882 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5019da-9885-4df8-9622-ea4e66f31fec admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:01.160174 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5019da-9885-4df8-9622-ea4e66f31fec admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:01.160449 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5019da-9885-4df8-9622-ea4e66f31fec admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:01.162441 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5019da-9885-4df8-9622-ea4e66f31fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:01.170519 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5019da-9885-4df8-9622-ea4e66f31fec admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:01.201494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1281/2536] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:01 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:01.203799 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe171f78-4e17-4c15-9bbf-01e99bd323ab admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:01.224184 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe171f78-4e17-4c15-9bbf-01e99bd323ab admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:01.230399 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58371462-ea73-4087-8262-0a75bd37d802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:01.231092 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58371462-ea73-4087-8262-0a75bd37d802 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:01.231375 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58371462-ea73-4087-8262-0a75bd37d802 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:01.231652 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58371462-ea73-4087-8262-0a75bd37d802 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:01.232485 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58371462-ea73-4087-8262-0a75bd37d802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:01.234840 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58371462-ea73-4087-8262-0a75bd37d802 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:01.250066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1256/2537] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:01 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:01.255833 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5019da-9885-4df8-9622-ea4e66f31fec admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:01.267754 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5019da-9885-4df8-9622-ea4e66f31fec admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:01.281217 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34540087-5622-413c-88fd-88b2af734053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:01.287662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34540087-5622-413c-88fd-88b2af734053 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:01.288401 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34540087-5622-413c-88fd-88b2af734053 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:01.288401 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34540087-5622-413c-88fd-88b2af734053 admin admin] PATH_INFO: `/v3/projects/32202421a25a4a958bc78bd469676289/users/2c03b952827e4233ab4af5fab63ba242/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:01.318455 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34540087-5622-413c-88fd-88b2af734053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32202421a25a4a958bc78bd469676289, user_id=2c03b952827e4233ab4af5fab63ba242, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:01.321558 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34540087-5622-413c-88fd-88b2af734053 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:01.397868 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1282/2538] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:01 2021] PUT /identity/v3/projects/32202421a25a4a958bc78bd469676289/users/2c03b952827e4233ab4af5fab63ba242/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:01.408070 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e484400-2f42-42bd-88be-a31fd298e796 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:01.408360 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e484400-2f42-42bd-88be-a31fd298e796 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:01.408638 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e484400-2f42-42bd-88be-a31fd298e796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:01.460271 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-1e484400-2f42-42bd-88be-a31fd298e796 None None] MFA Rules not processed for user `2c03b952827e4233ab4af5fab63ba242`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:01.461797 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1e484400-2f42-42bd-88be-a31fd298e796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:01.548883 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1257/2539] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:01 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:01.553977 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34540087-5622-413c-88fd-88b2af734053 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:01.624339 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34540087-5622-413c-88fd-88b2af734053 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:01.632058 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb29c93-2a53-461e-968f-06a08fe6921d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:01.632811 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb29c93-2a53-461e-968f-06a08fe6921d admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:01.633256 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb29c93-2a53-461e-968f-06a08fe6921d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:01.633738 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb29c93-2a53-461e-968f-06a08fe6921d admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:01.634361 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb29c93-2a53-461e-968f-06a08fe6921d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:01.636446 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb29c93-2a53-461e-968f-06a08fe6921d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:01.827205 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1283/2540] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:38:01 2021] POST /identity/v3/projects => generated 383 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:38:01.831534 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e484400-2f42-42bd-88be-a31fd298e796 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:01.843576 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e484400-2f42-42bd-88be-a31fd298e796 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:01.901047 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18581e0c-3740-4afe-9ed6-041748b23a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:01.901832 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18581e0c-3740-4afe-9ed6-041748b23a00 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:01.902193 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18581e0c-3740-4afe-9ed6-041748b23a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:01.902657 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18581e0c-3740-4afe-9ed6-041748b23a00 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:01.903369 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18581e0c-3740-4afe-9ed6-041748b23a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:01.905330 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18581e0c-3740-4afe-9ed6-041748b23a00 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:02.055990 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1258/2541] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:38:01 2021] POST /identity/v3/users => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:38:02.059713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb29c93-2a53-461e-968f-06a08fe6921d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:02.070465 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb29c93-2a53-461e-968f-06a08fe6921d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:02.075160 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036bdcc-3e39-4ca0-b1a3-1df98db1e880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:02.075852 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036bdcc-3e39-4ca0-b1a3-1df98db1e880 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:02.076130 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036bdcc-3e39-4ca0-b1a3-1df98db1e880 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:02.076403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036bdcc-3e39-4ca0-b1a3-1df98db1e880 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:02.077157 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036bdcc-3e39-4ca0-b1a3-1df98db1e880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:02.078735 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036bdcc-3e39-4ca0-b1a3-1df98db1e880 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:02.090059 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1284/2542] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:02.094417 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18581e0c-3740-4afe-9ed6-041748b23a00 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:02.106051 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18581e0c-3740-4afe-9ed6-041748b23a00 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:02.110780 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35544e6-cfcb-48d1-8386-1177875292fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:02.111667 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35544e6-cfcb-48d1-8386-1177875292fc admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:02.111954 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35544e6-cfcb-48d1-8386-1177875292fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:02.112233 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35544e6-cfcb-48d1-8386-1177875292fc admin admin] PATH_INFO: `/v3/projects/a7137a50258e47728a26dfbb5661dbd8/users/15b2aa4cf3ff445f90a590812aa00001/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:02.128441 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35544e6-cfcb-48d1-8386-1177875292fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7137a50258e47728a26dfbb5661dbd8, user_id=15b2aa4cf3ff445f90a590812aa00001, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:02.131135 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35544e6-cfcb-48d1-8386-1177875292fc admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:02.207997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1259/2543] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:02 2021] PUT /identity/v3/projects/a7137a50258e47728a26dfbb5661dbd8/users/15b2aa4cf3ff445f90a590812aa00001/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:02.212109 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036bdcc-3e39-4ca0-b1a3-1df98db1e880 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:02.224717 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036bdcc-3e39-4ca0-b1a3-1df98db1e880 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:02.284451 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae427297-d34c-4cb2-b695-81746feead30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:02.285159 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae427297-d34c-4cb2-b695-81746feead30 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:02.285442 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae427297-d34c-4cb2-b695-81746feead30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:02.286501 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae427297-d34c-4cb2-b695-81746feead30 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:02.287186 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae427297-d34c-4cb2-b695-81746feead30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:02.288791 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae427297-d34c-4cb2-b695-81746feead30 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:02.299613 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1285/2544] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:02 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:38:02.304692 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35544e6-cfcb-48d1-8386-1177875292fc admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:02.315650 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35544e6-cfcb-48d1-8386-1177875292fc admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:02.321356 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183e3a1-907b-421a-9750-1c5980315fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:02.322254 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183e3a1-907b-421a-9750-1c5980315fed admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:02.322539 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183e3a1-907b-421a-9750-1c5980315fed admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:02.322820 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183e3a1-907b-421a-9750-1c5980315fed admin admin] PATH_INFO: `/v3/projects/a7137a50258e47728a26dfbb5661dbd8/users/15b2aa4cf3ff445f90a590812aa00001/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:02.324823 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183e3a1-907b-421a-9750-1c5980315fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7137a50258e47728a26dfbb5661dbd8, user_id=15b2aa4cf3ff445f90a590812aa00001, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:02.327655 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183e3a1-907b-421a-9750-1c5980315fed admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:02.344254 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1260/2545] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:02 2021] PUT /identity/v3/projects/a7137a50258e47728a26dfbb5661dbd8/users/15b2aa4cf3ff445f90a590812aa00001/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:02.357198 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b91ffb-d271-4773-b198-f45982d351d1 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:02.358265 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b91ffb-d271-4773-b198-f45982d351d1 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:02.358762 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b91ffb-d271-4773-b198-f45982d351d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:02.440592 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-74b91ffb-d271-4773-b198-f45982d351d1 None None] MFA Rules not processed for user `15b2aa4cf3ff445f90a590812aa00001`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:02.442452 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-74b91ffb-d271-4773-b198-f45982d351d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:02.560747 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1286/2546] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:02 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:02.572138 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183e3a1-907b-421a-9750-1c5980315fed admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:02.575174 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d183e3a1-907b-421a-9750-1c5980315fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:02.650473 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183e3a1-907b-421a-9750-1c5980315fed admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:02.654391 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d869ae8-03a1-4169-ac6a-0319d3cafba3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:02.657014 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d869ae8-03a1-4169-ac6a-0319d3cafba3 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:02.657014 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d869ae8-03a1-4169-ac6a-0319d3cafba3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:02.657014 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d869ae8-03a1-4169-ac6a-0319d3cafba3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:02.666595 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d869ae8-03a1-4169-ac6a-0319d3cafba3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:02.668264 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d869ae8-03a1-4169-ac6a-0319d3cafba3 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:02.682228 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1261/2547] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:02 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:38:02.813569 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b91ffb-d271-4773-b198-f45982d351d1 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:02.825121 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b91ffb-d271-4773-b198-f45982d351d1 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:02.830070 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6b741-df8e-4a4f-8f53-e64a97a991de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:02.830982 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6b741-df8e-4a4f-8f53-e64a97a991de service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:02.831269 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6b741-df8e-4a4f-8f53-e64a97a991de service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:02.831547 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6b741-df8e-4a4f-8f53-e64a97a991de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:02.910956 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6b741-df8e-4a4f-8f53-e64a97a991de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:02.912991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6b741-df8e-4a4f-8f53-e64a97a991de service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:02.928910 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1287/2548] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:02 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:38:04.844785 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d869ae8-03a1-4169-ac6a-0319d3cafba3 service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:04.846347 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-1d869ae8-03a1-4169-ac6a-0319d3cafba3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:04.934855 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d869ae8-03a1-4169-ac6a-0319d3cafba3 service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:04.939803 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720b907-362c-4eb4-8fac-c6fb9f0c19b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:04.940556 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720b907-362c-4eb4-8fac-c6fb9f0c19b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:04.940857 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720b907-362c-4eb4-8fac-c6fb9f0c19b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:04.941136 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720b907-362c-4eb4-8fac-c6fb9f0c19b4 admin admin] PATH_INFO: `/v3/users/bf9f68a511284950bc6970d4280294a3` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:04.942333 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720b907-362c-4eb4-8fac-c6fb9f0c19b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf9f68a511284950bc6970d4280294a3)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:04.944347 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720b907-362c-4eb4-8fac-c6fb9f0c19b4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:05.238154 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b720b907-362c-4eb4-8fac-c6fb9f0c19b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf9f68a511284950bc6970d4280294a3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:05.238804 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b720b907-362c-4eb4-8fac-c6fb9f0c19b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf9f68a511284950bc6970d4280294a3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:05.246284 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b720b907-362c-4eb4-8fac-c6fb9f0c19b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf9f68a511284950bc6970d4280294a3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:05.246916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b720b907-362c-4eb4-8fac-c6fb9f0c19b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf9f68a511284950bc6970d4280294a3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:05.344417 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b720b907-362c-4eb4-8fac-c6fb9f0c19b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf9f68a511284950bc6970d4280294a3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:05.362618 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1262/2549] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:38:04 2021] DELETE /identity/v3/users/bf9f68a511284950bc6970d4280294a3 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:05.367555 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9328675-a55f-4f2f-b5e7-203beb58de84 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:05.368027 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9328675-a55f-4f2f-b5e7-203beb58de84 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:05.368123 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9328675-a55f-4f2f-b5e7-203beb58de84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:05.386023 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-a9328675-a55f-4f2f-b5e7-203beb58de84 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:05.387247 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a9328675-a55f-4f2f-b5e7-203beb58de84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:05.446865 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1288/2550] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:05.456655 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720b907-362c-4eb4-8fac-c6fb9f0c19b4 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:05.458661 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b720b907-362c-4eb4-8fac-c6fb9f0c19b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:05.514492 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720b907-362c-4eb4-8fac-c6fb9f0c19b4 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:05.518137 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a40a75-fb92-443e-aecc-af53db8f6dd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:05.518773 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a40a75-fb92-443e-aecc-af53db8f6dd9 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:05.519067 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a40a75-fb92-443e-aecc-af53db8f6dd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:05.519340 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a40a75-fb92-443e-aecc-af53db8f6dd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:05.528734 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a40a75-fb92-443e-aecc-af53db8f6dd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:05.530185 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a40a75-fb92-443e-aecc-af53db8f6dd9 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:05.540264 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1263/2551] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:38:05.956936 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9328675-a55f-4f2f-b5e7-203beb58de84 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:05.959795 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a9328675-a55f-4f2f-b5e7-203beb58de84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:05.974142 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9328675-a55f-4f2f-b5e7-203beb58de84 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:05.979534 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a645a-4879-4355-81e9-8642c0bf88d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:05.980393 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a645a-4879-4355-81e9-8642c0bf88d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:05.980676 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a645a-4879-4355-81e9-8642c0bf88d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:05.980983 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a645a-4879-4355-81e9-8642c0bf88d0 admin admin] PATH_INFO: `/v3/projects/cd65d5540e80463386d99d26ed4e4a67` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:05.982193 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a645a-4879-4355-81e9-8642c0bf88d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd65d5540e80463386d99d26ed4e4a67)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:05.984123 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a645a-4879-4355-81e9-8642c0bf88d0 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:06.098849 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-671a645a-4879-4355-81e9-8642c0bf88d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd65d5540e80463386d99d26ed4e4a67', 'request_id': 'req-671a645a-4879-4355-81e9-8642c0bf88d0'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:06.105134 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-671a645a-4879-4355-81e9-8642c0bf88d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd65d5540e80463386d99d26ed4e4a67', 'request_id': 'req-671a645a-4879-4355-81e9-8642c0bf88d0'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:06.178820 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a40a75-fb92-443e-aecc-af53db8f6dd9 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:06.180325 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-95a40a75-fb92-443e-aecc-af53db8f6dd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:06.193995 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a40a75-fb92-443e-aecc-af53db8f6dd9 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:06.224185 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-671a645a-4879-4355-81e9-8642c0bf88d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd65d5540e80463386d99d26ed4e4a67', 'request_id': 'req-671a645a-4879-4355-81e9-8642c0bf88d0'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:06.234978 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-671a645a-4879-4355-81e9-8642c0bf88d0 admin admin] The token cache is being invalidate because project cd65d5540e80463386d99d26ed4e4a67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:38:06.235299 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-671a645a-4879-4355-81e9-8642c0bf88d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:06.235918 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-671a645a-4879-4355-81e9-8642c0bf88d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:06.237717 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1289/2552] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:38:05 2021] DELETE /identity/v3/projects/cd65d5540e80463386d99d26ed4e4a67 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:06.250123 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8fca5-d90a-4cb0-a2db-fc444b979a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:06.251015 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8fca5-d90a-4cb0-a2db-fc444b979a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:06.251299 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8fca5-d90a-4cb0-a2db-fc444b979a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:06.251651 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8fca5-d90a-4cb0-a2db-fc444b979a62 admin admin] PATH_INFO: `/v3/users/2c03b952827e4233ab4af5fab63ba242` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:06.252996 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8fca5-d90a-4cb0-a2db-fc444b979a62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c03b952827e4233ab4af5fab63ba242)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:06.256048 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8fca5-d90a-4cb0-a2db-fc444b979a62 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:06.506813 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-89e8fca5-d90a-4cb0-a2db-fc444b979a62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c03b952827e4233ab4af5fab63ba242'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:06.507473 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-89e8fca5-d90a-4cb0-a2db-fc444b979a62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c03b952827e4233ab4af5fab63ba242'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:06.514055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-89e8fca5-d90a-4cb0-a2db-fc444b979a62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c03b952827e4233ab4af5fab63ba242'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:06.514691 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-89e8fca5-d90a-4cb0-a2db-fc444b979a62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c03b952827e4233ab4af5fab63ba242'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:06.641203 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-89e8fca5-d90a-4cb0-a2db-fc444b979a62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c03b952827e4233ab4af5fab63ba242'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:06.660289 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1264/2553] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:38:06 2021] DELETE /identity/v3/users/2c03b952827e4233ab4af5fab63ba242 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:38:06.665289 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f3561-767c-47f7-9377-2edc6abf588e None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:06.665815 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f3561-767c-47f7-9377-2edc6abf588e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:06.665916 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f3561-767c-47f7-9377-2edc6abf588e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:06.688850 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-ed2f3561-767c-47f7-9377-2edc6abf588e None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:06.690692 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-ed2f3561-767c-47f7-9377-2edc6abf588e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:06.749144 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1290/2554] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:06.762349 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8fca5-d90a-4cb0-a2db-fc444b979a62 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:06.763823 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-89e8fca5-d90a-4cb0-a2db-fc444b979a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:06.822760 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8fca5-d90a-4cb0-a2db-fc444b979a62 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:06.826569 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3385e2-c1b3-486f-8cec-a3c2278456b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:06.827238 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3385e2-c1b3-486f-8cec-a3c2278456b0 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:06.827508 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3385e2-c1b3-486f-8cec-a3c2278456b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:06.827787 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3385e2-c1b3-486f-8cec-a3c2278456b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:06.838808 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3385e2-c1b3-486f-8cec-a3c2278456b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:06.840315 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3385e2-c1b3-486f-8cec-a3c2278456b0 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:06.850635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1265/2555] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:38:07.290996 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f3561-767c-47f7-9377-2edc6abf588e None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:07.290996 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-ed2f3561-767c-47f7-9377-2edc6abf588e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:07.303837 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f3561-767c-47f7-9377-2edc6abf588e None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:07.308801 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0976bd-6e61-4bd3-b3cd-58bd6930da05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:07.313954 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0976bd-6e61-4bd3-b3cd-58bd6930da05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:07.313954 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0976bd-6e61-4bd3-b3cd-58bd6930da05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:07.313954 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0976bd-6e61-4bd3-b3cd-58bd6930da05 admin admin] PATH_INFO: `/v3/projects/32202421a25a4a958bc78bd469676289` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:07.313954 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0976bd-6e61-4bd3-b3cd-58bd6930da05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32202421a25a4a958bc78bd469676289)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:07.313954 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0976bd-6e61-4bd3-b3cd-58bd6930da05 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:07.452997 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-aa0976bd-6e61-4bd3-b3cd-58bd6930da05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32202421a25a4a958bc78bd469676289', 'request_id': 'req-aa0976bd-6e61-4bd3-b3cd-58bd6930da05'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:07.459810 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-aa0976bd-6e61-4bd3-b3cd-58bd6930da05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32202421a25a4a958bc78bd469676289', 'request_id': 'req-aa0976bd-6e61-4bd3-b3cd-58bd6930da05'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:07.554655 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-aa0976bd-6e61-4bd3-b3cd-58bd6930da05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32202421a25a4a958bc78bd469676289', 'request_id': 'req-aa0976bd-6e61-4bd3-b3cd-58bd6930da05'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:07.564816 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-aa0976bd-6e61-4bd3-b3cd-58bd6930da05 admin admin] The token cache is being invalidate because project 32202421a25a4a958bc78bd469676289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:38:07.565125 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-aa0976bd-6e61-4bd3-b3cd-58bd6930da05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:07.570086 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-aa0976bd-6e61-4bd3-b3cd-58bd6930da05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:07.570086 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1291/2556] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:38:07 2021] DELETE /identity/v3/projects/32202421a25a4a958bc78bd469676289 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:07.572035 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3385e2-c1b3-486f-8cec-a3c2278456b0 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:07.581687 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3385e2-c1b3-486f-8cec-a3c2278456b0 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:07.636553 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de8924-7790-420f-967a-7fb68e7b6519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:07.637461 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de8924-7790-420f-967a-7fb68e7b6519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:07.637748 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de8924-7790-420f-967a-7fb68e7b6519 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:07.638027 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de8924-7790-420f-967a-7fb68e7b6519 admin admin] PATH_INFO: `/v3/users/15b2aa4cf3ff445f90a590812aa00001` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:07.639214 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de8924-7790-420f-967a-7fb68e7b6519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b2aa4cf3ff445f90a590812aa00001)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:07.641213 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de8924-7790-420f-967a-7fb68e7b6519 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:07.814462 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b5de8924-7790-420f-967a-7fb68e7b6519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b2aa4cf3ff445f90a590812aa00001'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:07.815019 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b5de8924-7790-420f-967a-7fb68e7b6519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b2aa4cf3ff445f90a590812aa00001'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:07.822076 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b5de8924-7790-420f-967a-7fb68e7b6519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b2aa4cf3ff445f90a590812aa00001'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:07.822718 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b5de8924-7790-420f-967a-7fb68e7b6519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b2aa4cf3ff445f90a590812aa00001'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:07.903649 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-b5de8924-7790-420f-967a-7fb68e7b6519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b2aa4cf3ff445f90a590812aa00001'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:07.921092 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1266/2557] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:38:07 2021] DELETE /identity/v3/users/15b2aa4cf3ff445f90a590812aa00001 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:08.608890 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0976bd-6e61-4bd3-b3cd-58bd6930da05 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:08.610373 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-aa0976bd-6e61-4bd3-b3cd-58bd6930da05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:08.626215 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0976bd-6e61-4bd3-b3cd-58bd6930da05 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:08.681114 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b880a8-9243-45e2-ba39-5bc853e611dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:08.681908 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b880a8-9243-45e2-ba39-5bc853e611dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:08.682185 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b880a8-9243-45e2-ba39-5bc853e611dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:08.682458 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b880a8-9243-45e2-ba39-5bc853e611dc admin admin] PATH_INFO: `/v3/projects/a7137a50258e47728a26dfbb5661dbd8` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:08.683628 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b880a8-9243-45e2-ba39-5bc853e611dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7137a50258e47728a26dfbb5661dbd8)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:08.685609 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b880a8-9243-45e2-ba39-5bc853e611dc admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:08.769555 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-b1b880a8-9243-45e2-ba39-5bc853e611dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7137a50258e47728a26dfbb5661dbd8', 'request_id': 'req-b1b880a8-9243-45e2-ba39-5bc853e611dc'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:08.776572 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-b1b880a8-9243-45e2-ba39-5bc853e611dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7137a50258e47728a26dfbb5661dbd8', 'request_id': 'req-b1b880a8-9243-45e2-ba39-5bc853e611dc'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:08.847360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-b1b880a8-9243-45e2-ba39-5bc853e611dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7137a50258e47728a26dfbb5661dbd8', 'request_id': 'req-b1b880a8-9243-45e2-ba39-5bc853e611dc'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:08.858174 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-b1b880a8-9243-45e2-ba39-5bc853e611dc admin admin] The token cache is being invalidate because project a7137a50258e47728a26dfbb5661dbd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:38:08.858533 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-b1b880a8-9243-45e2-ba39-5bc853e611dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:08.859190 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-b1b880a8-9243-45e2-ba39-5bc853e611dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:08.860735 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1292/2558] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:38:08 2021] DELETE /identity/v3/projects/a7137a50258e47728a26dfbb5661dbd8 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:38:08.866605 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0f006-3c56-496d-a299-e78c415c04f6 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:08.867102 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0f006-3c56-496d-a299-e78c415c04f6 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:08.867212 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0f006-3c56-496d-a299-e78c415c04f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:08.885125 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-0bf0f006-3c56-496d-a299-e78c415c04f6 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:08.887816 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-0bf0f006-3c56-496d-a299-e78c415c04f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:08.947295 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1267/2559] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:08.955087 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1afa0a-868f-4a8c-99ad-ce85ba29568a None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:08.955406 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1afa0a-868f-4a8c-99ad-ce85ba29568a None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:08.955682 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1afa0a-868f-4a8c-99ad-ce85ba29568a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:08.974290 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-0e1afa0a-868f-4a8c-99ad-ce85ba29568a None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:08.975507 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-0e1afa0a-868f-4a8c-99ad-ce85ba29568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:08.983385 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1293/2560] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:38:08.987826 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0f006-3c56-496d-a299-e78c415c04f6 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:08.997680 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0f006-3c56-496d-a299-e78c415c04f6 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:09.002522 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068362c4-e0fc-48e7-bb03-7aad53ffb779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:09.003175 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068362c4-e0fc-48e7-bb03-7aad53ffb779 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:09.003453 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068362c4-e0fc-48e7-bb03-7aad53ffb779 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:09.003724 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068362c4-e0fc-48e7-bb03-7aad53ffb779 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:09.004430 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068362c4-e0fc-48e7-bb03-7aad53ffb779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:38:09.005262 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068362c4-e0fc-48e7-bb03-7aad53ffb779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:09.007005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068362c4-e0fc-48e7-bb03-7aad53ffb779 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:09.022784 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1268/2561] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:38:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:38:09.023923 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1afa0a-868f-4a8c-99ad-ce85ba29568a None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:09.033038 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1afa0a-868f-4a8c-99ad-ce85ba29568a None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:09.037968 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97ae49-111b-4fd6-a11d-c2ae3cf8cb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:09.038623 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97ae49-111b-4fd6-a11d-c2ae3cf8cb42 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:09.038925 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97ae49-111b-4fd6-a11d-c2ae3cf8cb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:09.039186 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97ae49-111b-4fd6-a11d-c2ae3cf8cb42 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:09.039881 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97ae49-111b-4fd6-a11d-c2ae3cf8cb42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:09.041817 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97ae49-111b-4fd6-a11d-c2ae3cf8cb42 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:09.162835 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1294/2562] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:38:09 2021] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:38:09.167180 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068362c4-e0fc-48e7-bb03-7aad53ffb779 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:09.179810 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068362c4-e0fc-48e7-bb03-7aad53ffb779 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:09.248397 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356143a-71dd-460d-89df-9372244a4cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:09.249103 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356143a-71dd-460d-89df-9372244a4cfa admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:09.249383 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356143a-71dd-460d-89df-9372244a4cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:09.250380 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356143a-71dd-460d-89df-9372244a4cfa admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:09.250380 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356143a-71dd-460d-89df-9372244a4cfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:09.252298 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356143a-71dd-460d-89df-9372244a4cfa admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:09.356293 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1269/2563] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:38:09 2021] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:38:09.360488 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97ae49-111b-4fd6-a11d-c2ae3cf8cb42 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:09.374339 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97ae49-111b-4fd6-a11d-c2ae3cf8cb42 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:09.378962 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2530b1-7d84-48f0-8831-884a4890db5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:09.379628 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2530b1-7d84-48f0-8831-884a4890db5d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:09.380408 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2530b1-7d84-48f0-8831-884a4890db5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:09.380679 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2530b1-7d84-48f0-8831-884a4890db5d admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:09.381437 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2530b1-7d84-48f0-8831-884a4890db5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:09.383193 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2530b1-7d84-48f0-8831-884a4890db5d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:09.395337 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1295/2564] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:09 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:09.407656 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356143a-71dd-460d-89df-9372244a4cfa admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:09.418581 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356143a-71dd-460d-89df-9372244a4cfa admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:09.423570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed3e61-2466-4291-9ae1-a746f94b6372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:09.424230 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed3e61-2466-4291-9ae1-a746f94b6372 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:09.424512 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed3e61-2466-4291-9ae1-a746f94b6372 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:09.424786 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed3e61-2466-4291-9ae1-a746f94b6372 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:09.425537 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed3e61-2466-4291-9ae1-a746f94b6372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:09.427374 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed3e61-2466-4291-9ae1-a746f94b6372 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:09.437814 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1270/2565] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:09 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:09.441962 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2530b1-7d84-48f0-8831-884a4890db5d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:09.452205 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2530b1-7d84-48f0-8831-884a4890db5d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:09.456615 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75065cb5-6fc5-456b-93e2-ce73b9e5c343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:09.457511 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75065cb5-6fc5-456b-93e2-ce73b9e5c343 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:09.468193 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75065cb5-6fc5-456b-93e2-ce73b9e5c343 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:09.468193 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75065cb5-6fc5-456b-93e2-ce73b9e5c343 admin admin] PATH_INFO: `/v3/projects/4175d9ac69614ad29e24b8b686c64b22/users/5d05c1108bbb42b99db790495e595566/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:09.472320 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75065cb5-6fc5-456b-93e2-ce73b9e5c343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4175d9ac69614ad29e24b8b686c64b22, user_id=5d05c1108bbb42b99db790495e595566, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:09.475560 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75065cb5-6fc5-456b-93e2-ce73b9e5c343 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:09.550694 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1296/2566] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:09 2021] PUT /identity/v3/projects/4175d9ac69614ad29e24b8b686c64b22/users/5d05c1108bbb42b99db790495e595566/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:09.562020 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89d8ab-4e7a-4a95-89bb-7551fc277e45 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:09.562307 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89d8ab-4e7a-4a95-89bb-7551fc277e45 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:09.562583 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89d8ab-4e7a-4a95-89bb-7551fc277e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:09.590350 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-ac89d8ab-4e7a-4a95-89bb-7551fc277e45 None None] MFA Rules not processed for user `5d05c1108bbb42b99db790495e595566`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:09.591562 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ac89d8ab-4e7a-4a95-89bb-7551fc277e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:09.655994 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1271/2567] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:09 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:09.660474 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75065cb5-6fc5-456b-93e2-ce73b9e5c343 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:09.719990 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75065cb5-6fc5-456b-93e2-ce73b9e5c343 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:09.725159 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a2ec4-f950-463e-ad1f-77b5e8985421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:09.725803 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a2ec4-f950-463e-ad1f-77b5e8985421 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:09.726081 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a2ec4-f950-463e-ad1f-77b5e8985421 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:09.726351 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a2ec4-f950-463e-ad1f-77b5e8985421 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:09.727062 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a2ec4-f950-463e-ad1f-77b5e8985421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:09.729029 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a2ec4-f950-463e-ad1f-77b5e8985421 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:09.809398 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1297/2568] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:38:09 2021] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:38:09.813450 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89d8ab-4e7a-4a95-89bb-7551fc277e45 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:09.824771 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89d8ab-4e7a-4a95-89bb-7551fc277e45 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:09.881817 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0981ad-e3f3-4328-8cdc-8b8856ca815f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:09.882518 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0981ad-e3f3-4328-8cdc-8b8856ca815f admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:09.882825 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0981ad-e3f3-4328-8cdc-8b8856ca815f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:09.883113 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0981ad-e3f3-4328-8cdc-8b8856ca815f admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:09.883808 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0981ad-e3f3-4328-8cdc-8b8856ca815f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:09.885855 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0981ad-e3f3-4328-8cdc-8b8856ca815f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:10.001690 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1272/2569] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:38:09 2021] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:38:10.005555 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a2ec4-f950-463e-ad1f-77b5e8985421 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:10.015743 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a2ec4-f950-463e-ad1f-77b5e8985421 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:10.020916 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb0b3c-cbc3-4336-aa47-00c4cfbf0727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:10.021802 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb0b3c-cbc3-4336-aa47-00c4cfbf0727 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:10.022083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb0b3c-cbc3-4336-aa47-00c4cfbf0727 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:10.022359 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb0b3c-cbc3-4336-aa47-00c4cfbf0727 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:10.023114 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb0b3c-cbc3-4336-aa47-00c4cfbf0727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:10.024715 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb0b3c-cbc3-4336-aa47-00c4cfbf0727 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:10.035494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1298/2570] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:10.040385 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0981ad-e3f3-4328-8cdc-8b8856ca815f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:10.050697 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0981ad-e3f3-4328-8cdc-8b8856ca815f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:10.055507 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f0c99-be94-4037-b966-7d66824ace5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:10.056386 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f0c99-be94-4037-b966-7d66824ace5e admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:10.056666 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f0c99-be94-4037-b966-7d66824ace5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:10.056966 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f0c99-be94-4037-b966-7d66824ace5e admin admin] PATH_INFO: `/v3/projects/8a2f4c351ff342c59dbff93427a69a5f/users/3c8ec319684a4a1fa519fa5bc9983c6e/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:10.071636 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f0c99-be94-4037-b966-7d66824ace5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a2f4c351ff342c59dbff93427a69a5f, user_id=3c8ec319684a4a1fa519fa5bc9983c6e, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:10.074358 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f0c99-be94-4037-b966-7d66824ace5e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:10.179001 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1273/2571] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:10 2021] PUT /identity/v3/projects/8a2f4c351ff342c59dbff93427a69a5f/users/3c8ec319684a4a1fa519fa5bc9983c6e/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:38:10.182912 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb0b3c-cbc3-4336-aa47-00c4cfbf0727 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:10.193118 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb0b3c-cbc3-4336-aa47-00c4cfbf0727 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:10.249135 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7a990-bc3b-4cee-9ce9-c4fe85452417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:10.249815 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7a990-bc3b-4cee-9ce9-c4fe85452417 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:10.250093 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7a990-bc3b-4cee-9ce9-c4fe85452417 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:10.250361 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7a990-bc3b-4cee-9ce9-c4fe85452417 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:10.251086 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7a990-bc3b-4cee-9ce9-c4fe85452417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:10.257659 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7a990-bc3b-4cee-9ce9-c4fe85452417 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:10.266154 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1299/2572] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:10 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:10.267908 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f0c99-be94-4037-b966-7d66824ace5e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:10.279046 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f0c99-be94-4037-b966-7d66824ace5e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:10.283697 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d64c3-241f-45ae-9934-06cdb7b07400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:10.284576 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d64c3-241f-45ae-9934-06cdb7b07400 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:10.284883 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d64c3-241f-45ae-9934-06cdb7b07400 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:10.285608 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d64c3-241f-45ae-9934-06cdb7b07400 admin admin] PATH_INFO: `/v3/projects/8a2f4c351ff342c59dbff93427a69a5f/users/3c8ec319684a4a1fa519fa5bc9983c6e/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:10.287272 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d64c3-241f-45ae-9934-06cdb7b07400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a2f4c351ff342c59dbff93427a69a5f, user_id=3c8ec319684a4a1fa519fa5bc9983c6e, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:10.289954 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d64c3-241f-45ae-9934-06cdb7b07400 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:10.300256 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1274/2573] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:10 2021] PUT /identity/v3/projects/8a2f4c351ff342c59dbff93427a69a5f/users/3c8ec319684a4a1fa519fa5bc9983c6e/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:10.318714 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39c196-d250-4d3a-9047-5efe97048bde None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:10.319006 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39c196-d250-4d3a-9047-5efe97048bde None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:10.319295 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39c196-d250-4d3a-9047-5efe97048bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:10.348920 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-fc39c196-d250-4d3a-9047-5efe97048bde None None] MFA Rules not processed for user `3c8ec319684a4a1fa519fa5bc9983c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:10.350258 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-fc39c196-d250-4d3a-9047-5efe97048bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:10.386191 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14525950-8999-435a-a229-a3b925b33cb9 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:10.386191 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14525950-8999-435a-a229-a3b925b33cb9 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:10.386191 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14525950-8999-435a-a229-a3b925b33cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:10.406811 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-14525950-8999-435a-a229-a3b925b33cb9 None None] MFA Rules not processed for user `3f65fb7e73db469f8b171c3126005427`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:10.408022 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-14525950-8999-435a-a229-a3b925b33cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:10.424460 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1300/2574] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:10 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:10.435517 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39c196-d250-4d3a-9047-5efe97048bde None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:10.436976 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-fc39c196-d250-4d3a-9047-5efe97048bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:10.464593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1275/2575] 10.222.0.25 () {58 vars in 968 bytes} [Fri Aug 27 01:38:10 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:38:10.487230 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14525950-8999-435a-a229-a3b925b33cb9 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:10.488725 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-14525950-8999-435a-a229-a3b925b33cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:10.493058 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39c196-d250-4d3a-9047-5efe97048bde None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:10.496676 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583657b7-c1de-466d-ab29-e402daff6d5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:10.497412 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583657b7-c1de-466d-ab29-e402daff6d5f service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:10.502340 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583657b7-c1de-466d-ab29-e402daff6d5f service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:10.502340 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583657b7-c1de-466d-ab29-e402daff6d5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:10.507678 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583657b7-c1de-466d-ab29-e402daff6d5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:10.509138 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583657b7-c1de-466d-ab29-e402daff6d5f service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:10.518397 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1301/2576] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:10 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:38:10.557929 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14525950-8999-435a-a229-a3b925b33cb9 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:10.562918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480a340-24ea-4133-ad82-407a7bdf4889 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48536f4437240b79cf10961de9cc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:10.563560 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480a340-24ea-4133-ad82-407a7bdf4889 service swift] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:10.563843 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480a340-24ea-4133-ad82-407a7bdf4889 service swift] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:10.564121 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480a340-24ea-4133-ad82-407a7bdf4889 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:10.572969 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480a340-24ea-4133-ad82-407a7bdf4889 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:10.574559 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480a340-24ea-4133-ad82-407a7bdf4889 service swift] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:10.582374 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1276/2577] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 01:38:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 01:38:10.994331 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583657b7-c1de-466d-ab29-e402daff6d5f service cinder] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:11.060058 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583657b7-c1de-466d-ab29-e402daff6d5f service cinder] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:11.064588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d22c5-51b5-441a-b565-b1e47ef47166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:11.065487 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d22c5-51b5-441a-b565-b1e47ef47166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:11.065772 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d22c5-51b5-441a-b565-b1e47ef47166 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:11.066048 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d22c5-51b5-441a-b565-b1e47ef47166 admin admin] PATH_INFO: `/v3/users/5d05c1108bbb42b99db790495e595566` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:11.067665 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d22c5-51b5-441a-b565-b1e47ef47166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d05c1108bbb42b99db790495e595566)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:11.069625 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d22c5-51b5-441a-b565-b1e47ef47166 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:11.248324 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-365d22c5-51b5-441a-b565-b1e47ef47166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d05c1108bbb42b99db790495e595566'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:11.260134 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-365d22c5-51b5-441a-b565-b1e47ef47166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d05c1108bbb42b99db790495e595566'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:11.267351 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-365d22c5-51b5-441a-b565-b1e47ef47166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d05c1108bbb42b99db790495e595566'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:11.268096 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-365d22c5-51b5-441a-b565-b1e47ef47166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d05c1108bbb42b99db790495e595566'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:11.372880 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-365d22c5-51b5-441a-b565-b1e47ef47166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d05c1108bbb42b99db790495e595566'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:11.379173 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1302/2578] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:38:10 2021] DELETE /identity/v3/users/5d05c1108bbb42b99db790495e595566 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:11.383811 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e1166-44b1-4e33-ab70-9b024c4849da None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:11.384298 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e1166-44b1-4e33-ab70-9b024c4849da None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:11.384396 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e1166-44b1-4e33-ab70-9b024c4849da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:11.404735 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-895e1166-44b1-4e33-ab70-9b024c4849da None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:11.406021 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-895e1166-44b1-4e33-ab70-9b024c4849da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:11.464522 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1277/2579] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:38:11.474888 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d22c5-51b5-441a-b565-b1e47ef47166 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:11.476281 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-365d22c5-51b5-441a-b565-b1e47ef47166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:11.530363 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d22c5-51b5-441a-b565-b1e47ef47166 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:11.533957 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3759f-af1d-4772-90cc-ba4181010d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:11.534593 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3759f-af1d-4772-90cc-ba4181010d6e service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:11.534870 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3759f-af1d-4772-90cc-ba4181010d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:11.535141 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3759f-af1d-4772-90cc-ba4181010d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:11.544418 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3759f-af1d-4772-90cc-ba4181010d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:11.545862 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3759f-af1d-4772-90cc-ba4181010d6e service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:11.555330 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1303/2580] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:38:12.026245 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e1166-44b1-4e33-ab70-9b024c4849da None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:12.027689 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-895e1166-44b1-4e33-ab70-9b024c4849da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:12.039509 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e1166-44b1-4e33-ab70-9b024c4849da None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:12.044282 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6073602-843b-4cb3-ae53-5c6e27495b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:12.055308 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6073602-843b-4cb3-ae53-5c6e27495b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:12.055601 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6073602-843b-4cb3-ae53-5c6e27495b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:12.055889 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6073602-843b-4cb3-ae53-5c6e27495b9a admin admin] PATH_INFO: `/v3/projects/4175d9ac69614ad29e24b8b686c64b22` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:12.057254 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6073602-843b-4cb3-ae53-5c6e27495b9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4175d9ac69614ad29e24b8b686c64b22)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:12.059361 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6073602-843b-4cb3-ae53-5c6e27495b9a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:12.206466 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d6073602-843b-4cb3-ae53-5c6e27495b9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4175d9ac69614ad29e24b8b686c64b22', 'request_id': 'req-d6073602-843b-4cb3-ae53-5c6e27495b9a'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:12.210431 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d6073602-843b-4cb3-ae53-5c6e27495b9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4175d9ac69614ad29e24b8b686c64b22', 'request_id': 'req-d6073602-843b-4cb3-ae53-5c6e27495b9a'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:12.315500 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d6073602-843b-4cb3-ae53-5c6e27495b9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4175d9ac69614ad29e24b8b686c64b22', 'request_id': 'req-d6073602-843b-4cb3-ae53-5c6e27495b9a'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:12.332801 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d6073602-843b-4cb3-ae53-5c6e27495b9a admin admin] The token cache is being invalidate because project 4175d9ac69614ad29e24b8b686c64b22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:38:12.333134 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d6073602-843b-4cb3-ae53-5c6e27495b9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:12.333795 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-d6073602-843b-4cb3-ae53-5c6e27495b9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:12.335427 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1278/2581] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:38:12 2021] DELETE /identity/v3/projects/4175d9ac69614ad29e24b8b686c64b22 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:12.339446 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3759f-af1d-4772-90cc-ba4181010d6e service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:12.351779 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3759f-af1d-4772-90cc-ba4181010d6e service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:12.416752 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbf3d3-c3a7-4eb9-9c90-34674bff9344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:12.419056 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbf3d3-c3a7-4eb9-9c90-34674bff9344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:12.419350 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbf3d3-c3a7-4eb9-9c90-34674bff9344 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:12.419630 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbf3d3-c3a7-4eb9-9c90-34674bff9344 admin admin] PATH_INFO: `/v3/users/3c8ec319684a4a1fa519fa5bc9983c6e` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:12.420989 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbf3d3-c3a7-4eb9-9c90-34674bff9344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c8ec319684a4a1fa519fa5bc9983c6e)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:12.422961 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbf3d3-c3a7-4eb9-9c90-34674bff9344 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:12.628845 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-fabbf3d3-c3a7-4eb9-9c90-34674bff9344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c8ec319684a4a1fa519fa5bc9983c6e'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:12.641700 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-fabbf3d3-c3a7-4eb9-9c90-34674bff9344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c8ec319684a4a1fa519fa5bc9983c6e'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:12.649425 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-fabbf3d3-c3a7-4eb9-9c90-34674bff9344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c8ec319684a4a1fa519fa5bc9983c6e'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:12.650169 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-fabbf3d3-c3a7-4eb9-9c90-34674bff9344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c8ec319684a4a1fa519fa5bc9983c6e'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:12.715763 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-fabbf3d3-c3a7-4eb9-9c90-34674bff9344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c8ec319684a4a1fa519fa5bc9983c6e'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:12.723875 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1304/2582] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:38:12 2021] DELETE /identity/v3/users/3c8ec319684a4a1fa519fa5bc9983c6e => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:38:13.274065 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6073602-843b-4cb3-ae53-5c6e27495b9a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:13.275489 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d6073602-843b-4cb3-ae53-5c6e27495b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:13.289786 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6073602-843b-4cb3-ae53-5c6e27495b9a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:13.351812 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8793893-b30f-4411-9a01-84629de17ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:13.352593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8793893-b30f-4411-9a01-84629de17ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:13.352906 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8793893-b30f-4411-9a01-84629de17ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:13.353179 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8793893-b30f-4411-9a01-84629de17ad7 admin admin] PATH_INFO: `/v3/projects/8a2f4c351ff342c59dbff93427a69a5f` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:13.354359 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8793893-b30f-4411-9a01-84629de17ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a2f4c351ff342c59dbff93427a69a5f)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:13.356238 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8793893-b30f-4411-9a01-84629de17ad7 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:13.485339 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-f8793893-b30f-4411-9a01-84629de17ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a2f4c351ff342c59dbff93427a69a5f', 'request_id': 'req-f8793893-b30f-4411-9a01-84629de17ad7'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:13.494434 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-f8793893-b30f-4411-9a01-84629de17ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a2f4c351ff342c59dbff93427a69a5f', 'request_id': 'req-f8793893-b30f-4411-9a01-84629de17ad7'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:13.589840 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-f8793893-b30f-4411-9a01-84629de17ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a2f4c351ff342c59dbff93427a69a5f', 'request_id': 'req-f8793893-b30f-4411-9a01-84629de17ad7'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:13.601913 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-f8793893-b30f-4411-9a01-84629de17ad7 admin admin] The token cache is being invalidate because project 8a2f4c351ff342c59dbff93427a69a5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:38:13.602199 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-f8793893-b30f-4411-9a01-84629de17ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:13.604918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-f8793893-b30f-4411-9a01-84629de17ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:13.604918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1279/2583] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:38:13 2021] DELETE /identity/v3/projects/8a2f4c351ff342c59dbff93427a69a5f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:13.613094 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8635d-d847-4445-899f-388015fe0ccc None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:13.613094 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8635d-d847-4445-899f-388015fe0ccc None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:13.613094 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8635d-d847-4445-899f-388015fe0ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:13.638415 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-34b8635d-d847-4445-899f-388015fe0ccc None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:13.639684 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-34b8635d-d847-4445-899f-388015fe0ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:13.700509 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1305/2584] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:13.715943 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e4f60-05d9-4045-b511-39111a78c478 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:13.716699 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e4f60-05d9-4045-b511-39111a78c478 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:13.717702 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e4f60-05d9-4045-b511-39111a78c478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:13.740089 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-257e4f60-05d9-4045-b511-39111a78c478 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:13.741417 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-257e4f60-05d9-4045-b511-39111a78c478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:13.749601 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1280/2585] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:13.753607 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8635d-d847-4445-899f-388015fe0ccc None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:13.763390 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8635d-d847-4445-899f-388015fe0ccc None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:13.768617 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d2143-4968-428d-b484-fb3c62c576ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:13.769498 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d2143-4968-428d-b484-fb3c62c576ca admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:13.769847 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d2143-4968-428d-b484-fb3c62c576ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:13.770756 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d2143-4968-428d-b484-fb3c62c576ca admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:13.771542 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d2143-4968-428d-b484-fb3c62c576ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:38:13.771919 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d2143-4968-428d-b484-fb3c62c576ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:13.773536 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d2143-4968-428d-b484-fb3c62c576ca admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:13.786434 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1306/2586] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:38:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:38:13.790893 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e4f60-05d9-4045-b511-39111a78c478 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:13.800072 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e4f60-05d9-4045-b511-39111a78c478 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:13.805329 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34392a50-174a-4413-82c8-bcc6645ddbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:13.805556 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34392a50-174a-4413-82c8-bcc6645ddbe9 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:13.805801 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34392a50-174a-4413-82c8-bcc6645ddbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:13.806072 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34392a50-174a-4413-82c8-bcc6645ddbe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:13.806894 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34392a50-174a-4413-82c8-bcc6645ddbe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:13.808638 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34392a50-174a-4413-82c8-bcc6645ddbe9 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:13.918992 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1281/2587] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:38:13 2021] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:38:13.922383 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d2143-4968-428d-b484-fb3c62c576ca admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:13.933033 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d2143-4968-428d-b484-fb3c62c576ca admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:14.007130 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8e848-439a-47e4-bb83-eb91f9f3351f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:14.008213 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8e848-439a-47e4-bb83-eb91f9f3351f admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:14.011621 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8e848-439a-47e4-bb83-eb91f9f3351f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:14.011621 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8e848-439a-47e4-bb83-eb91f9f3351f admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:14.011621 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8e848-439a-47e4-bb83-eb91f9f3351f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:14.013150 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8e848-439a-47e4-bb83-eb91f9f3351f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:14.107813 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1307/2588] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:38:13 2021] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:38:14.109199 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34392a50-174a-4413-82c8-bcc6645ddbe9 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:14.119747 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34392a50-174a-4413-82c8-bcc6645ddbe9 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:14.125041 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c9537-1352-428a-892f-da72cba92656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:14.125925 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c9537-1352-428a-892f-da72cba92656 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:14.126364 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c9537-1352-428a-892f-da72cba92656 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:14.126806 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c9537-1352-428a-892f-da72cba92656 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:14.127684 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c9537-1352-428a-892f-da72cba92656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:14.129318 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c9537-1352-428a-892f-da72cba92656 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:14.145863 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1282/2589] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:14 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:14.146927 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8e848-439a-47e4-bb83-eb91f9f3351f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:14.157542 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8e848-439a-47e4-bb83-eb91f9f3351f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:14.163215 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871435a-9225-4b41-bb3a-5098ad641f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:14.163659 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871435a-9225-4b41-bb3a-5098ad641f15 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:14.164009 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871435a-9225-4b41-bb3a-5098ad641f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:14.164355 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871435a-9225-4b41-bb3a-5098ad641f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:14.165186 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871435a-9225-4b41-bb3a-5098ad641f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:14.167067 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871435a-9225-4b41-bb3a-5098ad641f15 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:14.179185 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1308/2590] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:14 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:38:14.183286 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c9537-1352-428a-892f-da72cba92656 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:14.195447 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c9537-1352-428a-892f-da72cba92656 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:14.201185 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c016a1-9e79-418d-ad57-6b9dc3dd3658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:14.202163 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c016a1-9e79-418d-ad57-6b9dc3dd3658 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:14.202707 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c016a1-9e79-418d-ad57-6b9dc3dd3658 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:14.203061 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c016a1-9e79-418d-ad57-6b9dc3dd3658 admin admin] PATH_INFO: `/v3/projects/43b2fb7f66034d64b2917979ab53c744/users/059c9faf7e4e4170a233b117b7477d31/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:14.222444 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c016a1-9e79-418d-ad57-6b9dc3dd3658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b2fb7f66034d64b2917979ab53c744, user_id=059c9faf7e4e4170a233b117b7477d31, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:14.225477 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c016a1-9e79-418d-ad57-6b9dc3dd3658 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:14.333795 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1283/2591] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:14 2021] PUT /identity/v3/projects/43b2fb7f66034d64b2917979ab53c744/users/059c9faf7e4e4170a233b117b7477d31/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:14.345230 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332044ab-4d84-4c54-adc8-93a89c5a719f None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:14.345567 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332044ab-4d84-4c54-adc8-93a89c5a719f None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:14.345849 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332044ab-4d84-4c54-adc8-93a89c5a719f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:14.378376 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-332044ab-4d84-4c54-adc8-93a89c5a719f None None] MFA Rules not processed for user `059c9faf7e4e4170a233b117b7477d31`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:14.378376 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-332044ab-4d84-4c54-adc8-93a89c5a719f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:14.453378 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1309/2592] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:14 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:14.464132 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c016a1-9e79-418d-ad57-6b9dc3dd3658 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:14.466105 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-42c016a1-9e79-418d-ad57-6b9dc3dd3658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:14.549115 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c016a1-9e79-418d-ad57-6b9dc3dd3658 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:14.554277 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc48ea3-f206-4367-8d51-13e09bd1ebc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:14.555016 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc48ea3-f206-4367-8d51-13e09bd1ebc0 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:14.555437 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc48ea3-f206-4367-8d51-13e09bd1ebc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:14.555924 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc48ea3-f206-4367-8d51-13e09bd1ebc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:14.573766 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc48ea3-f206-4367-8d51-13e09bd1ebc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:14.575221 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc48ea3-f206-4367-8d51-13e09bd1ebc0 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:14.611912 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1284/2593] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:14 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:38:20.172639 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332044ab-4d84-4c54-adc8-93a89c5a719f None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:20.174423 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-332044ab-4d84-4c54-adc8-93a89c5a719f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:20.238482 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332044ab-4d84-4c54-adc8-93a89c5a719f None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:20.243498 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12b5e1-6fb3-4c57-b8f9-eee4012fbc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:20.244354 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12b5e1-6fb3-4c57-b8f9-eee4012fbc50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:20.244634 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12b5e1-6fb3-4c57-b8f9-eee4012fbc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:20.244941 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12b5e1-6fb3-4c57-b8f9-eee4012fbc50 admin admin] PATH_INFO: `/v3/users/34172ab8bb0942fda2a6aeda56a3bf21` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:20.246108 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12b5e1-6fb3-4c57-b8f9-eee4012fbc50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34172ab8bb0942fda2a6aeda56a3bf21)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:20.248047 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12b5e1-6fb3-4c57-b8f9-eee4012fbc50 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:20.439115 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-5e12b5e1-6fb3-4c57-b8f9-eee4012fbc50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34172ab8bb0942fda2a6aeda56a3bf21'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:20.452129 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-5e12b5e1-6fb3-4c57-b8f9-eee4012fbc50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34172ab8bb0942fda2a6aeda56a3bf21'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:20.459236 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-5e12b5e1-6fb3-4c57-b8f9-eee4012fbc50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34172ab8bb0942fda2a6aeda56a3bf21'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:20.459987 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-5e12b5e1-6fb3-4c57-b8f9-eee4012fbc50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34172ab8bb0942fda2a6aeda56a3bf21'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:20.567532 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-5e12b5e1-6fb3-4c57-b8f9-eee4012fbc50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34172ab8bb0942fda2a6aeda56a3bf21'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:20.573915 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1310/2594] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:38:20 2021] DELETE /identity/v3/users/34172ab8bb0942fda2a6aeda56a3bf21 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:20.797172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc48ea3-f206-4367-8d51-13e09bd1ebc0 service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:20.808852 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc48ea3-f206-4367-8d51-13e09bd1ebc0 service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:20.867824 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf83cd-5106-4c15-9bfb-84a2cf7efd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:20.868673 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf83cd-5106-4c15-9bfb-84a2cf7efd04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:20.868988 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf83cd-5106-4c15-9bfb-84a2cf7efd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:20.869268 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf83cd-5106-4c15-9bfb-84a2cf7efd04 admin admin] PATH_INFO: `/v3/projects/0c906f0891a04908acd7dc34d1953279` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:20.870428 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf83cd-5106-4c15-9bfb-84a2cf7efd04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c906f0891a04908acd7dc34d1953279)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:20.872381 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf83cd-5106-4c15-9bfb-84a2cf7efd04 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:20.955840 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-41bf83cd-5106-4c15-9bfb-84a2cf7efd04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c906f0891a04908acd7dc34d1953279', 'request_id': 'req-41bf83cd-5106-4c15-9bfb-84a2cf7efd04'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:20.962672 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-41bf83cd-5106-4c15-9bfb-84a2cf7efd04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c906f0891a04908acd7dc34d1953279', 'request_id': 'req-41bf83cd-5106-4c15-9bfb-84a2cf7efd04'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:21.025362 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-41bf83cd-5106-4c15-9bfb-84a2cf7efd04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c906f0891a04908acd7dc34d1953279', 'request_id': 'req-41bf83cd-5106-4c15-9bfb-84a2cf7efd04'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:21.038440 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-41bf83cd-5106-4c15-9bfb-84a2cf7efd04 admin admin] The token cache is being invalidate because project 0c906f0891a04908acd7dc34d1953279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:38:21.038732 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-41bf83cd-5106-4c15-9bfb-84a2cf7efd04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:21.039442 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-41bf83cd-5106-4c15-9bfb-84a2cf7efd04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:21.041022 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1285/2595] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:38:20 2021] DELETE /identity/v3/projects/0c906f0891a04908acd7dc34d1953279 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:21.044986 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12b5e1-6fb3-4c57-b8f9-eee4012fbc50 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:21.046403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-5e12b5e1-6fb3-4c57-b8f9-eee4012fbc50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:21.060347 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12b5e1-6fb3-4c57-b8f9-eee4012fbc50 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:21.119708 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512641a-e6ca-4d72-8ce0-5662b8d0050b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:21.121011 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512641a-e6ca-4d72-8ce0-5662b8d0050b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:21.121405 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512641a-e6ca-4d72-8ce0-5662b8d0050b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:21.121788 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512641a-e6ca-4d72-8ce0-5662b8d0050b admin admin] PATH_INFO: `/v3/users/ae86afc9d10c45bb87afd7ccef20db9c` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:21.123434 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512641a-e6ca-4d72-8ce0-5662b8d0050b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae86afc9d10c45bb87afd7ccef20db9c)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:21.126363 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512641a-e6ca-4d72-8ce0-5662b8d0050b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:21.327682 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f512641a-e6ca-4d72-8ce0-5662b8d0050b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae86afc9d10c45bb87afd7ccef20db9c'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:21.340712 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f512641a-e6ca-4d72-8ce0-5662b8d0050b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae86afc9d10c45bb87afd7ccef20db9c'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:21.347715 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f512641a-e6ca-4d72-8ce0-5662b8d0050b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae86afc9d10c45bb87afd7ccef20db9c'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:21.349334 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f512641a-e6ca-4d72-8ce0-5662b8d0050b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae86afc9d10c45bb87afd7ccef20db9c'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:21.435731 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f512641a-e6ca-4d72-8ce0-5662b8d0050b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae86afc9d10c45bb87afd7ccef20db9c'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:21.443014 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1311/2596] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:38:21 2021] DELETE /identity/v3/users/ae86afc9d10c45bb87afd7ccef20db9c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:21.701205 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf83cd-5106-4c15-9bfb-84a2cf7efd04 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:21.703379 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-41bf83cd-5106-4c15-9bfb-84a2cf7efd04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:21.717779 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf83cd-5106-4c15-9bfb-84a2cf7efd04 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:21.778258 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e30f3-6d19-4482-aa91-fc4df54079b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:21.778258 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e30f3-6d19-4482-aa91-fc4df54079b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:21.778258 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e30f3-6d19-4482-aa91-fc4df54079b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:21.778258 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e30f3-6d19-4482-aa91-fc4df54079b8 admin admin] PATH_INFO: `/v3/projects/81a1b072067240c39a1dd275789d04b5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:21.779430 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e30f3-6d19-4482-aa91-fc4df54079b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a1b072067240c39a1dd275789d04b5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:21.781689 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e30f3-6d19-4482-aa91-fc4df54079b8 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:21.903464 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-bd4e30f3-6d19-4482-aa91-fc4df54079b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a1b072067240c39a1dd275789d04b5', 'request_id': 'req-bd4e30f3-6d19-4482-aa91-fc4df54079b8'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:21.910427 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-bd4e30f3-6d19-4482-aa91-fc4df54079b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a1b072067240c39a1dd275789d04b5', 'request_id': 'req-bd4e30f3-6d19-4482-aa91-fc4df54079b8'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:21.973238 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-bd4e30f3-6d19-4482-aa91-fc4df54079b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a1b072067240c39a1dd275789d04b5', 'request_id': 'req-bd4e30f3-6d19-4482-aa91-fc4df54079b8'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:21.984525 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-bd4e30f3-6d19-4482-aa91-fc4df54079b8 admin admin] The token cache is being invalidate because project 81a1b072067240c39a1dd275789d04b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:38:21.984813 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-bd4e30f3-6d19-4482-aa91-fc4df54079b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:21.985487 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-bd4e30f3-6d19-4482-aa91-fc4df54079b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:21.987154 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1286/2597] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:38:21 2021] DELETE /identity/v3/projects/81a1b072067240c39a1dd275789d04b5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:21.993769 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30735e-35ba-41a2-8029-6d978fe4c703 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:21.997548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30735e-35ba-41a2-8029-6d978fe4c703 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:21.997548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30735e-35ba-41a2-8029-6d978fe4c703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:22.013310 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-2c30735e-35ba-41a2-8029-6d978fe4c703 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:22.014551 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-2c30735e-35ba-41a2-8029-6d978fe4c703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:22.078119 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1312/2598] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:22.088676 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a86a4-ed37-4aa3-8ecc-41e2426e8d30 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:22.089115 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a86a4-ed37-4aa3-8ecc-41e2426e8d30 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:22.089499 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a86a4-ed37-4aa3-8ecc-41e2426e8d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:22.113244 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-221a86a4-ed37-4aa3-8ecc-41e2426e8d30 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:22.115371 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-221a86a4-ed37-4aa3-8ecc-41e2426e8d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:22.125389 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1287/2599] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:22.130258 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30735e-35ba-41a2-8029-6d978fe4c703 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:22.140005 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30735e-35ba-41a2-8029-6d978fe4c703 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:22.144784 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efae6c-cb6a-4cba-8448-551e9778854b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:22.146000 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efae6c-cb6a-4cba-8448-551e9778854b admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:22.146294 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efae6c-cb6a-4cba-8448-551e9778854b admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:22.146576 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efae6c-cb6a-4cba-8448-551e9778854b admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:22.150705 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efae6c-cb6a-4cba-8448-551e9778854b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:38:22.150705 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efae6c-cb6a-4cba-8448-551e9778854b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:22.150705 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efae6c-cb6a-4cba-8448-551e9778854b admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:22.163726 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1313/2600] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:38:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:38:22.171158 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a86a4-ed37-4aa3-8ecc-41e2426e8d30 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:22.182189 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a86a4-ed37-4aa3-8ecc-41e2426e8d30 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:22.186949 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f29d3-1149-41d6-a84a-98c09f1c4214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:22.187608 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f29d3-1149-41d6-a84a-98c09f1c4214 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:22.187890 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f29d3-1149-41d6-a84a-98c09f1c4214 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:22.188173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f29d3-1149-41d6-a84a-98c09f1c4214 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:22.188927 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f29d3-1149-41d6-a84a-98c09f1c4214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:22.190827 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f29d3-1149-41d6-a84a-98c09f1c4214 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:22.277262 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1288/2601] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:38:22 2021] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:38:22.281035 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efae6c-cb6a-4cba-8448-551e9778854b admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:22.292793 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efae6c-cb6a-4cba-8448-551e9778854b admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:22.351469 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6012f-bca7-4b29-a0d7-100d8d7684da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:22.352554 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6012f-bca7-4b29-a0d7-100d8d7684da admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:22.353055 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6012f-bca7-4b29-a0d7-100d8d7684da admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:22.353484 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6012f-bca7-4b29-a0d7-100d8d7684da admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:22.354550 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6012f-bca7-4b29-a0d7-100d8d7684da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:22.357403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6012f-bca7-4b29-a0d7-100d8d7684da admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:22.460494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1314/2602] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:38:22 2021] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:38:22.465799 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f29d3-1149-41d6-a84a-98c09f1c4214 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:22.476650 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f29d3-1149-41d6-a84a-98c09f1c4214 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:22.481711 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcb1ab-b954-4c45-b716-055de75116ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:22.482419 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcb1ab-b954-4c45-b716-055de75116ff admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:22.482701 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcb1ab-b954-4c45-b716-055de75116ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:22.482975 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcb1ab-b954-4c45-b716-055de75116ff admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:22.483697 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcb1ab-b954-4c45-b716-055de75116ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:22.485640 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcb1ab-b954-4c45-b716-055de75116ff admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:22.488568 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6012f-bca7-4b29-a0d7-100d8d7684da admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:22.491296 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-15a6012f-bca7-4b29-a0d7-100d8d7684da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:22.507479 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1289/2603] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:22 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:22.513396 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcb1ab-b954-4c45-b716-055de75116ff admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:22.526755 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcb1ab-b954-4c45-b716-055de75116ff admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:22.533914 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8170a5-1edd-415f-adcd-1c32b0e51eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:22.534849 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8170a5-1edd-415f-adcd-1c32b0e51eee admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:22.535231 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8170a5-1edd-415f-adcd-1c32b0e51eee admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:22.536196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8170a5-1edd-415f-adcd-1c32b0e51eee admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:22.537331 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8170a5-1edd-415f-adcd-1c32b0e51eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:22.539731 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8170a5-1edd-415f-adcd-1c32b0e51eee admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:22.552660 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6012f-bca7-4b29-a0d7-100d8d7684da admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:22.555813 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1290/2604] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:22 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:22.556677 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a8126-46c7-43c9-be20-60a5edaa676e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:22.557357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a8126-46c7-43c9-be20-60a5edaa676e service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:22.557638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a8126-46c7-43c9-be20-60a5edaa676e service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:22.557913 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a8126-46c7-43c9-be20-60a5edaa676e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:22.559835 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-1d9a8126-46c7-43c9-be20-60a5edaa676e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:22.560087 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8170a5-1edd-415f-adcd-1c32b0e51eee admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:22.571740 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a8126-46c7-43c9-be20-60a5edaa676e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:22.573197 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a8126-46c7-43c9-be20-60a5edaa676e service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:22.573395 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8170a5-1edd-415f-adcd-1c32b0e51eee admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:22.579955 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fb86e-4cd9-414b-b382-a92647afb42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:22.580895 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fb86e-4cd9-414b-b382-a92647afb42c admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:22.581184 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fb86e-4cd9-414b-b382-a92647afb42c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:22.581468 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fb86e-4cd9-414b-b382-a92647afb42c admin admin] PATH_INFO: `/v3/projects/d683ea4300b545fda6f56b5c11ee189c/users/ded8a106d4d64603a7c87306eae430b7/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:22.583438 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1315/2605] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:38:22.597560 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fb86e-4cd9-414b-b382-a92647afb42c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d683ea4300b545fda6f56b5c11ee189c, user_id=ded8a106d4d64603a7c87306eae430b7, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:22.601074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fb86e-4cd9-414b-b382-a92647afb42c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:22.704581 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1291/2606] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:22 2021] PUT /identity/v3/projects/d683ea4300b545fda6f56b5c11ee189c/users/ded8a106d4d64603a7c87306eae430b7/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:38:22.710574 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e657c-979e-4f99-8643-ef4d60d6715b None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:22.710867 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e657c-979e-4f99-8643-ef4d60d6715b None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:22.711630 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e657c-979e-4f99-8643-ef4d60d6715b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:22.730098 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-290e657c-979e-4f99-8643-ef4d60d6715b None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:22.731330 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-290e657c-979e-4f99-8643-ef4d60d6715b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:22.792502 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1316/2607] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:38:22.803180 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fb86e-4cd9-414b-b382-a92647afb42c admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:22.805012 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ab2fb86e-4cd9-414b-b382-a92647afb42c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:22.877930 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fb86e-4cd9-414b-b382-a92647afb42c admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:22.883845 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03d575-9fa5-4195-88ba-84b455b4de10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:22.884656 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03d575-9fa5-4195-88ba-84b455b4de10 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:22.884969 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03d575-9fa5-4195-88ba-84b455b4de10 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:22.885354 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03d575-9fa5-4195-88ba-84b455b4de10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:22.899990 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03d575-9fa5-4195-88ba-84b455b4de10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:22.902149 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03d575-9fa5-4195-88ba-84b455b4de10 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:22.916702 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1292/2608] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:38:24.984487 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e657c-979e-4f99-8643-ef4d60d6715b None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:24.986019 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-290e657c-979e-4f99-8643-ef4d60d6715b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:24.998068 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e657c-979e-4f99-8643-ef4d60d6715b None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:25.004326 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2daf3-1a7a-40b4-a21d-94724fceb63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:25.005459 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2daf3-1a7a-40b4-a21d-94724fceb63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:25.006503 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2daf3-1a7a-40b4-a21d-94724fceb63e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:25.007044 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2daf3-1a7a-40b4-a21d-94724fceb63e admin admin] PATH_INFO: `/v3/users/059c9faf7e4e4170a233b117b7477d31` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:25.008493 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2daf3-1a7a-40b4-a21d-94724fceb63e admin admin] RBAC: Authorizing `identity:delete_user(user_id=059c9faf7e4e4170a233b117b7477d31)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:25.012557 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2daf3-1a7a-40b4-a21d-94724fceb63e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:25.270603 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-45b2daf3-1a7a-40b4-a21d-94724fceb63e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '059c9faf7e4e4170a233b117b7477d31'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:25.284481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-45b2daf3-1a7a-40b4-a21d-94724fceb63e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '059c9faf7e4e4170a233b117b7477d31'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:25.293174 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-45b2daf3-1a7a-40b4-a21d-94724fceb63e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '059c9faf7e4e4170a233b117b7477d31'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:25.294961 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-45b2daf3-1a7a-40b4-a21d-94724fceb63e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '059c9faf7e4e4170a233b117b7477d31'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:25.456971 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-45b2daf3-1a7a-40b4-a21d-94724fceb63e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '059c9faf7e4e4170a233b117b7477d31'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:25.468343 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1317/2609] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:38:24 2021] DELETE /identity/v3/users/059c9faf7e4e4170a233b117b7477d31 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:38:25.470454 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa3bb9-4afc-4591-b420-09bb83b33951 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:25.470916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa3bb9-4afc-4591-b420-09bb83b33951 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:25.470999 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa3bb9-4afc-4591-b420-09bb83b33951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:25.496674 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-fbfa3bb9-4afc-4591-b420-09bb83b33951 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:25.498295 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-fbfa3bb9-4afc-4591-b420-09bb83b33951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:25.577165 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1293/2610] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:25.586329 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2daf3-1a7a-40b4-a21d-94724fceb63e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:25.587862 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-45b2daf3-1a7a-40b4-a21d-94724fceb63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:25.675473 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2daf3-1a7a-40b4-a21d-94724fceb63e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:25.684524 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e9a15-592c-4d21-8606-29e3926bd6f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:25.685750 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e9a15-592c-4d21-8606-29e3926bd6f8 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:25.686348 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e9a15-592c-4d21-8606-29e3926bd6f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:25.686901 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e9a15-592c-4d21-8606-29e3926bd6f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:25.702421 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e9a15-592c-4d21-8606-29e3926bd6f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:25.704305 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e9a15-592c-4d21-8606-29e3926bd6f8 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:25.716237 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1318/2611] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:38:26.544755 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa3bb9-4afc-4591-b420-09bb83b33951 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:26.546283 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-fbfa3bb9-4afc-4591-b420-09bb83b33951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:26.559758 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa3bb9-4afc-4591-b420-09bb83b33951 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:26.566403 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4fedf-c870-408b-a6b0-a0eea652b0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:26.568276 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4fedf-c870-408b-a6b0-a0eea652b0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:26.568733 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4fedf-c870-408b-a6b0-a0eea652b0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:26.570030 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4fedf-c870-408b-a6b0-a0eea652b0cd admin admin] PATH_INFO: `/v3/projects/43b2fb7f66034d64b2917979ab53c744` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:26.570964 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4fedf-c870-408b-a6b0-a0eea652b0cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=43b2fb7f66034d64b2917979ab53c744)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:26.572938 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4fedf-c870-408b-a6b0-a0eea652b0cd admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:26.726998 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-54b4fedf-c870-408b-a6b0-a0eea652b0cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43b2fb7f66034d64b2917979ab53c744', 'request_id': 'req-54b4fedf-c870-408b-a6b0-a0eea652b0cd'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:26.734514 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-54b4fedf-c870-408b-a6b0-a0eea652b0cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43b2fb7f66034d64b2917979ab53c744', 'request_id': 'req-54b4fedf-c870-408b-a6b0-a0eea652b0cd'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:26.858873 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-54b4fedf-c870-408b-a6b0-a0eea652b0cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43b2fb7f66034d64b2917979ab53c744', 'request_id': 'req-54b4fedf-c870-408b-a6b0-a0eea652b0cd'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:26.873860 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-54b4fedf-c870-408b-a6b0-a0eea652b0cd admin admin] The token cache is being invalidate because project 43b2fb7f66034d64b2917979ab53c744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:38:26.874812 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-54b4fedf-c870-408b-a6b0-a0eea652b0cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:26.875856 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-54b4fedf-c870-408b-a6b0-a0eea652b0cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:26.877686 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1294/2612] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:38:26 2021] DELETE /identity/v3/projects/43b2fb7f66034d64b2917979ab53c744 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:26.884288 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f060bae-669e-4335-9deb-3f41313fab70 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:26.885589 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f060bae-669e-4335-9deb-3f41313fab70 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:26.885881 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f060bae-669e-4335-9deb-3f41313fab70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:26.906179 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-7f060bae-669e-4335-9deb-3f41313fab70 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:26.908168 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-7f060bae-669e-4335-9deb-3f41313fab70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:27.007032 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1319/2613] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:27.016069 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abab34-e4ec-44bc-9969-1060d97aedaa None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:27.016367 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abab34-e4ec-44bc-9969-1060d97aedaa None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:27.016732 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abab34-e4ec-44bc-9969-1060d97aedaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:27.042072 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-84abab34-e4ec-44bc-9969-1060d97aedaa None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:27.043693 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-84abab34-e4ec-44bc-9969-1060d97aedaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:27.055491 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1295/2614] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:27.060145 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f060bae-669e-4335-9deb-3f41313fab70 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:27.075415 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f060bae-669e-4335-9deb-3f41313fab70 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:27.093018 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35839636-83a8-4950-afe3-55bd1afab293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:27.093708 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35839636-83a8-4950-afe3-55bd1afab293 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:27.093993 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35839636-83a8-4950-afe3-55bd1afab293 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:27.094278 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35839636-83a8-4950-afe3-55bd1afab293 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:27.095012 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35839636-83a8-4950-afe3-55bd1afab293 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:38:27.095374 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35839636-83a8-4950-afe3-55bd1afab293 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:27.097022 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35839636-83a8-4950-afe3-55bd1afab293 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:27.106858 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abab34-e4ec-44bc-9969-1060d97aedaa None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:27.108735 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-84abab34-e4ec-44bc-9969-1060d97aedaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:27.123690 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1320/2615] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:38:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:38:27.128706 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abab34-e4ec-44bc-9969-1060d97aedaa None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:27.133814 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35839636-83a8-4950-afe3-55bd1afab293 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:27.147068 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a2e94-59eb-4f7d-b9ab-53ba20d156e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:27.147972 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a2e94-59eb-4f7d-b9ab-53ba20d156e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:27.148259 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a2e94-59eb-4f7d-b9ab-53ba20d156e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:27.148904 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a2e94-59eb-4f7d-b9ab-53ba20d156e8 admin admin] PATH_INFO: `/v3/users/9032bdd7ffde4d3f9b500974a4c17c67` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:27.151715 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35839636-83a8-4950-afe3-55bd1afab293 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:27.153209 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a2e94-59eb-4f7d-b9ab-53ba20d156e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9032bdd7ffde4d3f9b500974a4c17c67)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:27.155248 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a2e94-59eb-4f7d-b9ab-53ba20d156e8 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:27.165247 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b375db-3e2b-46ac-b060-27b8e1e95c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:27.166195 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b375db-3e2b-46ac-b060-27b8e1e95c8e admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:27.166628 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b375db-3e2b-46ac-b060-27b8e1e95c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:27.167083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b375db-3e2b-46ac-b060-27b8e1e95c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:27.168946 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b375db-3e2b-46ac-b060-27b8e1e95c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:27.171061 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b375db-3e2b-46ac-b060-27b8e1e95c8e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:27.284979 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1321/2616] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:38:27 2021] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:38:27.291494 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b375db-3e2b-46ac-b060-27b8e1e95c8e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:27.365771 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b375db-3e2b-46ac-b060-27b8e1e95c8e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:27.370954 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bd221-4b83-4fec-bdbd-e83db1addcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:27.374511 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bd221-4b83-4fec-bdbd-e83db1addcf6 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:27.374511 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bd221-4b83-4fec-bdbd-e83db1addcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:27.374511 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bd221-4b83-4fec-bdbd-e83db1addcf6 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:27.374511 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bd221-4b83-4fec-bdbd-e83db1addcf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:27.375383 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bd221-4b83-4fec-bdbd-e83db1addcf6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:27.413656 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-094a2e94-59eb-4f7d-b9ab-53ba20d156e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9032bdd7ffde4d3f9b500974a4c17c67'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:27.414928 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-094a2e94-59eb-4f7d-b9ab-53ba20d156e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9032bdd7ffde4d3f9b500974a4c17c67'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:27.427397 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-094a2e94-59eb-4f7d-b9ab-53ba20d156e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9032bdd7ffde4d3f9b500974a4c17c67'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:27.431862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-094a2e94-59eb-4f7d-b9ab-53ba20d156e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9032bdd7ffde4d3f9b500974a4c17c67'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:27.466542 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1322/2617] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:38:27 2021] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:38:27.468172 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bd221-4b83-4fec-bdbd-e83db1addcf6 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:27.473640 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-323bd221-4b83-4fec-bdbd-e83db1addcf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:27.487303 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bd221-4b83-4fec-bdbd-e83db1addcf6 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:27.493705 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878d615-cd11-41e4-a971-b417253c68e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:27.494133 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878d615-cd11-41e4-a971-b417253c68e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:27.495014 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878d615-cd11-41e4-a971-b417253c68e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:27.495014 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878d615-cd11-41e4-a971-b417253c68e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:27.495808 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878d615-cd11-41e4-a971-b417253c68e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:27.497577 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878d615-cd11-41e4-a971-b417253c68e5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:27.504142 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-094a2e94-59eb-4f7d-b9ab-53ba20d156e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9032bdd7ffde4d3f9b500974a4c17c67'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:27.517789 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1323/2618] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:27 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:27.532152 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878d615-cd11-41e4-a971-b417253c68e5 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:27.539543 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1296/2619] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:38:27 2021] DELETE /identity/v3/users/9032bdd7ffde4d3f9b500974a4c17c67 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:27.545178 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878d615-cd11-41e4-a971-b417253c68e5 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:27.634049 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1a483-1356-40d1-a111-a770e97d9223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:27.634846 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1a483-1356-40d1-a111-a770e97d9223 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:27.635205 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1a483-1356-40d1-a111-a770e97d9223 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:27.635552 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1a483-1356-40d1-a111-a770e97d9223 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:27.636426 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1a483-1356-40d1-a111-a770e97d9223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:27.643481 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1a483-1356-40d1-a111-a770e97d9223 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:27.665783 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a2e94-59eb-4f7d-b9ab-53ba20d156e8 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:27.666349 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1324/2620] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:27 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:27.679634 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a2e94-59eb-4f7d-b9ab-53ba20d156e8 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:27.685541 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436b910-9dd7-4310-ac68-67352f26f093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:27.686948 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436b910-9dd7-4310-ac68-67352f26f093 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:27.687393 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436b910-9dd7-4310-ac68-67352f26f093 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:27.687897 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436b910-9dd7-4310-ac68-67352f26f093 admin admin] PATH_INFO: `/v3/projects/acd42545c9da44c5836d14a0ef617cb1/users/6b99317d89884b428b545f93cab24628/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:27.713306 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436b910-9dd7-4310-ac68-67352f26f093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd42545c9da44c5836d14a0ef617cb1, user_id=6b99317d89884b428b545f93cab24628, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:27.716863 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436b910-9dd7-4310-ac68-67352f26f093 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:27.806416 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1297/2621] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:27 2021] PUT /identity/v3/projects/acd42545c9da44c5836d14a0ef617cb1/users/6b99317d89884b428b545f93cab24628/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:27.816475 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c053177-0b93-4757-9029-ec8a8d0ccfda None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:27.817420 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c053177-0b93-4757-9029-ec8a8d0ccfda None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:27.817420 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c053177-0b93-4757-9029-ec8a8d0ccfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:27.845588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-5c053177-0b93-4757-9029-ec8a8d0ccfda None None] MFA Rules not processed for user `6b99317d89884b428b545f93cab24628`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:27.846813 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-5c053177-0b93-4757-9029-ec8a8d0ccfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:27.894014 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436b910-9dd7-4310-ac68-67352f26f093 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:27.897144 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d436b910-9dd7-4310-ac68-67352f26f093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:27.936868 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1325/2622] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:27 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:27.942733 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c053177-0b93-4757-9029-ec8a8d0ccfda None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:27.990211 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436b910-9dd7-4310-ac68-67352f26f093 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:27.995556 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a7c50-26d5-43ca-b741-5dd5e50f26a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:27.996418 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a7c50-26d5-43ca-b741-5dd5e50f26a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:27.996701 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a7c50-26d5-43ca-b741-5dd5e50f26a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:27.997076 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a7c50-26d5-43ca-b741-5dd5e50f26a3 admin admin] PATH_INFO: `/v3/projects/9cbe428e1f9c456087aa6ec677fe0330` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:27.998248 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a7c50-26d5-43ca-b741-5dd5e50f26a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cbe428e1f9c456087aa6ec677fe0330)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:28.000348 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a7c50-26d5-43ca-b741-5dd5e50f26a3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:28.027571 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c053177-0b93-4757-9029-ec8a8d0ccfda None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:28.034020 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a5d98-4ee7-4a4e-b6d3-a37dff2b433f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:28.034744 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a5d98-4ee7-4a4e-b6d3-a37dff2b433f admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:28.035029 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a5d98-4ee7-4a4e-b6d3-a37dff2b433f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:28.035345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a5d98-4ee7-4a4e-b6d3-a37dff2b433f admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:28.036715 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a5d98-4ee7-4a4e-b6d3-a37dff2b433f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:28.038803 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a5d98-4ee7-4a4e-b6d3-a37dff2b433f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:28.185986 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-553a7c50-26d5-43ca-b741-5dd5e50f26a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cbe428e1f9c456087aa6ec677fe0330', 'request_id': 'req-553a7c50-26d5-43ca-b741-5dd5e50f26a3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:28.193192 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-553a7c50-26d5-43ca-b741-5dd5e50f26a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cbe428e1f9c456087aa6ec677fe0330', 'request_id': 'req-553a7c50-26d5-43ca-b741-5dd5e50f26a3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:28.235964 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1326/2623] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:38:27 2021] POST /identity/v3/projects => generated 373 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:38:28.237085 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a5d98-4ee7-4a4e-b6d3-a37dff2b433f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:28.309921 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-553a7c50-26d5-43ca-b741-5dd5e50f26a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cbe428e1f9c456087aa6ec677fe0330', 'request_id': 'req-553a7c50-26d5-43ca-b741-5dd5e50f26a3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:28.311482 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a5d98-4ee7-4a4e-b6d3-a37dff2b433f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:28.317592 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c18d50-0873-4d9e-ab02-f9b41c3fbbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:28.318276 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c18d50-0873-4d9e-ab02-f9b41c3fbbd3 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:28.318546 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c18d50-0873-4d9e-ab02-f9b41c3fbbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:28.318852 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c18d50-0873-4d9e-ab02-f9b41c3fbbd3 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:28.319630 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c18d50-0873-4d9e-ab02-f9b41c3fbbd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:28.321674 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c18d50-0873-4d9e-ab02-f9b41c3fbbd3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:28.323520 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-553a7c50-26d5-43ca-b741-5dd5e50f26a3 admin admin] The token cache is being invalidate because project 9cbe428e1f9c456087aa6ec677fe0330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:38:28.323885 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-553a7c50-26d5-43ca-b741-5dd5e50f26a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:28.324478 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-553a7c50-26d5-43ca-b741-5dd5e50f26a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:28.326342 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1298/2624] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:38:27 2021] DELETE /identity/v3/projects/9cbe428e1f9c456087aa6ec677fe0330 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:28.338091 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8b109-bff2-4392-b15b-b12576236f03 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:28.345102 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8b109-bff2-4392-b15b-b12576236f03 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:28.345645 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8b109-bff2-4392-b15b-b12576236f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:28.375573 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-4db8b109-bff2-4392-b15b-b12576236f03 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:28.377042 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-4db8b109-bff2-4392-b15b-b12576236f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:28.389495 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1299/2625] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:38:28.398596 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c301cb1-66d1-4c18-addd-5c00fa0aecf9 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:28.398893 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c301cb1-66d1-4c18-addd-5c00fa0aecf9 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:28.405560 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c301cb1-66d1-4c18-addd-5c00fa0aecf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:28.420616 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-4c301cb1-66d1-4c18-addd-5c00fa0aecf9 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:28.421888 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-4c301cb1-66d1-4c18-addd-5c00fa0aecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:28.437242 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1300/2626] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:28.438338 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c301cb1-66d1-4c18-addd-5c00fa0aecf9 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:28.449999 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c301cb1-66d1-4c18-addd-5c00fa0aecf9 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:28.454950 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de8fe3-6d93-4af2-9bef-d1de47d2dc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:28.455753 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de8fe3-6d93-4af2-9bef-d1de47d2dc94 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:28.456161 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de8fe3-6d93-4af2-9bef-d1de47d2dc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:28.456934 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de8fe3-6d93-4af2-9bef-d1de47d2dc94 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:28.458357 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de8fe3-6d93-4af2-9bef-d1de47d2dc94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:38:28.458783 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de8fe3-6d93-4af2-9bef-d1de47d2dc94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:28.460667 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de8fe3-6d93-4af2-9bef-d1de47d2dc94 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:28.480219 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1301/2627] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:38:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:38:28.481150 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1327/2628] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:38:28 2021] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:38:28.481273 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de8fe3-6d93-4af2-9bef-d1de47d2dc94 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:28.483229 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c18d50-0873-4d9e-ab02-f9b41c3fbbd3 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:28.485971 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-b7c18d50-0873-4d9e-ab02-f9b41c3fbbd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:28.494631 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de8fe3-6d93-4af2-9bef-d1de47d2dc94 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:28.500965 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7321bf9-2515-41cc-a668-9a627f467808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:28.503509 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7321bf9-2515-41cc-a668-9a627f467808 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:28.503509 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7321bf9-2515-41cc-a668-9a627f467808 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:28.503509 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7321bf9-2515-41cc-a668-9a627f467808 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:28.503509 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7321bf9-2515-41cc-a668-9a627f467808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:28.506046 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7321bf9-2515-41cc-a668-9a627f467808 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:28.507035 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c18d50-0873-4d9e-ab02-f9b41c3fbbd3 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:28.513066 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc33c2b-58eb-423f-976a-15c03c9ddb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:28.514011 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc33c2b-58eb-423f-976a-15c03c9ddb3d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:28.514837 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc33c2b-58eb-423f-976a-15c03c9ddb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:28.515377 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc33c2b-58eb-423f-976a-15c03c9ddb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:28.516987 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc33c2b-58eb-423f-976a-15c03c9ddb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:28.520411 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc33c2b-58eb-423f-976a-15c03c9ddb3d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:28.533888 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1328/2629] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:28 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:28.538520 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc33c2b-58eb-423f-976a-15c03c9ddb3d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:28.549692 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc33c2b-58eb-423f-976a-15c03c9ddb3d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:28.555507 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b29e4-00b3-4f5e-bfca-e650f28a369a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:28.556621 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b29e4-00b3-4f5e-bfca-e650f28a369a admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:28.557201 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b29e4-00b3-4f5e-bfca-e650f28a369a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:28.557919 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b29e4-00b3-4f5e-bfca-e650f28a369a admin admin] PATH_INFO: `/v3/projects/5039c55f9423475dbda98f3f61db5e9f/users/7b570872bad64372b130e2e6888a65ad/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:28.577889 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b29e4-00b3-4f5e-bfca-e650f28a369a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5039c55f9423475dbda98f3f61db5e9f, user_id=7b570872bad64372b130e2e6888a65ad, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:28.581040 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b29e4-00b3-4f5e-bfca-e650f28a369a admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:28.639515 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1302/2630] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:38:28 2021] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:38:28.641715 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7321bf9-2515-41cc-a668-9a627f467808 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:28.690719 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1329/2631] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:28 2021] PUT /identity/v3/projects/5039c55f9423475dbda98f3f61db5e9f/users/7b570872bad64372b130e2e6888a65ad/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:38:28.692123 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b29e4-00b3-4f5e-bfca-e650f28a369a admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:28.717969 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7321bf9-2515-41cc-a668-9a627f467808 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:28.766936 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b29e4-00b3-4f5e-bfca-e650f28a369a admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:28.774040 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b137d3-b843-4e89-8ccc-9dd0974df58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:28.774915 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b137d3-b843-4e89-8ccc-9dd0974df58f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:28.775196 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b137d3-b843-4e89-8ccc-9dd0974df58f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:28.775475 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b137d3-b843-4e89-8ccc-9dd0974df58f admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:28.777243 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b137d3-b843-4e89-8ccc-9dd0974df58f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:28.779429 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b137d3-b843-4e89-8ccc-9dd0974df58f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:28.794719 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1330/2632] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:28 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:28.796220 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b137d3-b843-4e89-8ccc-9dd0974df58f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:28.811683 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91fe89-f1a9-44af-be89-126f90d425e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:28.812132 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b137d3-b843-4e89-8ccc-9dd0974df58f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:28.813513 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91fe89-f1a9-44af-be89-126f90d425e1 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:28.813982 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91fe89-f1a9-44af-be89-126f90d425e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:28.814417 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91fe89-f1a9-44af-be89-126f90d425e1 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:28.815459 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91fe89-f1a9-44af-be89-126f90d425e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:28.818085 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91fe89-f1a9-44af-be89-126f90d425e1 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:28.819074 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fec952-9ac5-4a24-a021-a04dac3fed60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:28.820319 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fec952-9ac5-4a24-a021-a04dac3fed60 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:28.821170 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fec952-9ac5-4a24-a021-a04dac3fed60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:28.821814 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fec952-9ac5-4a24-a021-a04dac3fed60 admin admin] PATH_INFO: `/v3/projects/5039c55f9423475dbda98f3f61db5e9f/users/7b570872bad64372b130e2e6888a65ad/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:28.824385 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fec952-9ac5-4a24-a021-a04dac3fed60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5039c55f9423475dbda98f3f61db5e9f, user_id=7b570872bad64372b130e2e6888a65ad, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:28.828087 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fec952-9ac5-4a24-a021-a04dac3fed60 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:28.844869 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1331/2633] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:28 2021] PUT /identity/v3/projects/5039c55f9423475dbda98f3f61db5e9f/users/7b570872bad64372b130e2e6888a65ad/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:38:28.856997 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b7552-5c81-44b6-b1a4-c63dc09c245f None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:28.857293 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b7552-5c81-44b6-b1a4-c63dc09c245f None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:28.857573 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b7552-5c81-44b6-b1a4-c63dc09c245f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:28.891480 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-ca0b7552-5c81-44b6-b1a4-c63dc09c245f None None] MFA Rules not processed for user `7b570872bad64372b130e2e6888a65ad`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:28.892976 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-ca0b7552-5c81-44b6-b1a4-c63dc09c245f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:28.939657 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1303/2634] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:38:28 2021] POST /identity/v3/users => generated 288 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:38:28.943984 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91fe89-f1a9-44af-be89-126f90d425e1 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:28.964253 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91fe89-f1a9-44af-be89-126f90d425e1 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:29.034780 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1332/2635] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:28 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:38:29.042992 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b7552-5c81-44b6-b1a4-c63dc09c245f None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:29.045441 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-ca0b7552-5c81-44b6-b1a4-c63dc09c245f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:29.055353 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13779eef-5f02-4146-ac7b-5dfccbb15eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:29.056301 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13779eef-5f02-4146-ac7b-5dfccbb15eac admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:29.057073 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13779eef-5f02-4146-ac7b-5dfccbb15eac admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:29.057682 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13779eef-5f02-4146-ac7b-5dfccbb15eac admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:29.058593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13779eef-5f02-4146-ac7b-5dfccbb15eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:29.061254 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13779eef-5f02-4146-ac7b-5dfccbb15eac admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:29.076379 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1304/2636] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:28 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:38:29.080608 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13779eef-5f02-4146-ac7b-5dfccbb15eac admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:29.107610 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13779eef-5f02-4146-ac7b-5dfccbb15eac admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:29.114802 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead75b7-3bdb-4e8b-bf43-0f64c7c4031f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:29.115644 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead75b7-3bdb-4e8b-bf43-0f64c7c4031f admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:29.116118 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead75b7-3bdb-4e8b-bf43-0f64c7c4031f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:29.116778 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead75b7-3bdb-4e8b-bf43-0f64c7c4031f admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:29.117823 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead75b7-3bdb-4e8b-bf43-0f64c7c4031f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:29.119624 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead75b7-3bdb-4e8b-bf43-0f64c7c4031f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:29.132066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1305/2637] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:29 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:38:29.135884 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead75b7-3bdb-4e8b-bf43-0f64c7c4031f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:29.149447 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead75b7-3bdb-4e8b-bf43-0f64c7c4031f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:29.155291 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945f47a-e3d9-4485-80a4-365b81156615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:29.156542 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945f47a-e3d9-4485-80a4-365b81156615 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:29.156975 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945f47a-e3d9-4485-80a4-365b81156615 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:29.157324 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945f47a-e3d9-4485-80a4-365b81156615 admin admin] PATH_INFO: `/v3/projects/4f1c338823a34f149491a347c340470a/users/749f5aa9f7774c7abcd824fc5f9d27fc/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:29.165988 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b7552-5c81-44b6-b1a4-c63dc09c245f None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:29.175750 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945f47a-e3d9-4485-80a4-365b81156615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1c338823a34f149491a347c340470a, user_id=749f5aa9f7774c7abcd824fc5f9d27fc, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:29.181148 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d70c80-86ed-409c-9786-0a45c61aebad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:29.181819 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d70c80-86ed-409c-9786-0a45c61aebad service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:29.182101 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d70c80-86ed-409c-9786-0a45c61aebad service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:29.183191 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d70c80-86ed-409c-9786-0a45c61aebad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:29.183693 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945f47a-e3d9-4485-80a4-365b81156615 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:29.186555 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-d5d70c80-86ed-409c-9786-0a45c61aebad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:29.275687 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1306/2638] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:29 2021] PUT /identity/v3/projects/4f1c338823a34f149491a347c340470a/users/749f5aa9f7774c7abcd824fc5f9d27fc/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:38:29.275881 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d70c80-86ed-409c-9786-0a45c61aebad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:29.275881 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d70c80-86ed-409c-9786-0a45c61aebad service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:29.278269 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616ff24-766e-4d4a-8a7a-f295baf6313b None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:29.278725 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616ff24-766e-4d4a-8a7a-f295baf6313b None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:29.279156 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616ff24-766e-4d4a-8a7a-f295baf6313b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:29.283099 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1333/2639] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:29 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:38:29.337074 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebab18-c532-4632-9d1e-96347ca75f79 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:29.344259 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebab18-c532-4632-9d1e-96347ca75f79 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:29.344259 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebab18-c532-4632-9d1e-96347ca75f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:29.358411 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-8616ff24-766e-4d4a-8a7a-f295baf6313b None None] MFA Rules not processed for user `749f5aa9f7774c7abcd824fc5f9d27fc`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:29.359690 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8616ff24-766e-4d4a-8a7a-f295baf6313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:29.433072 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-b3ebab18-c532-4632-9d1e-96347ca75f79 None None] MFA Rules not processed for user `ded8a106d4d64603a7c87306eae430b7`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:29.436628 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-b3ebab18-c532-4632-9d1e-96347ca75f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:29.476984 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1307/2640] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:29 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:38:29.491101 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616ff24-766e-4d4a-8a7a-f295baf6313b None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:29.493285 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8616ff24-766e-4d4a-8a7a-f295baf6313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:29.525021 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1334/2641] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:29 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:29.534427 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebab18-c532-4632-9d1e-96347ca75f79 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:29.534427 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-b3ebab18-c532-4632-9d1e-96347ca75f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:29.585480 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616ff24-766e-4d4a-8a7a-f295baf6313b None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:29.592171 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb203c-7139-44d0-8444-609a77ba4f2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:29.592973 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb203c-7139-44d0-8444-609a77ba4f2c service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:29.593331 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb203c-7139-44d0-8444-609a77ba4f2c service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:29.593725 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb203c-7139-44d0-8444-609a77ba4f2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:29.602965 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebab18-c532-4632-9d1e-96347ca75f79 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:29.603179 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb203c-7139-44d0-8444-609a77ba4f2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:29.604825 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb203c-7139-44d0-8444-609a77ba4f2c service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:29.609426 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7e8d6-2663-4a8e-afed-a4bb61450403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:29.610098 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7e8d6-2663-4a8e-afed-a4bb61450403 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:29.610379 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7e8d6-2663-4a8e-afed-a4bb61450403 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:29.610652 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7e8d6-2663-4a8e-afed-a4bb61450403 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:29.611448 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7e8d6-2663-4a8e-afed-a4bb61450403 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:29.614056 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7e8d6-2663-4a8e-afed-a4bb61450403 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:29.615298 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1308/2642] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:29 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:38:29.787756 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1335/2643] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:38:29 2021] POST /identity/v3/projects => generated 371 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:38:29.791480 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb203c-7139-44d0-8444-609a77ba4f2c service nova] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:29.811337 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7e8d6-2663-4a8e-afed-a4bb61450403 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:29.814685 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb203c-7139-44d0-8444-609a77ba4f2c service nova] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:29.919767 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7e8d6-2663-4a8e-afed-a4bb61450403 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:29.925116 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e7fa7-8884-4d77-9b00-f7ad061940a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:29.927165 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e7fa7-8884-4d77-9b00-f7ad061940a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:29.927452 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e7fa7-8884-4d77-9b00-f7ad061940a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:29.927728 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e7fa7-8884-4d77-9b00-f7ad061940a8 admin admin] PATH_INFO: `/v3/users/749f5aa9f7774c7abcd824fc5f9d27fc` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:29.929027 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e7fa7-8884-4d77-9b00-f7ad061940a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=749f5aa9f7774c7abcd824fc5f9d27fc)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:29.931032 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e7fa7-8884-4d77-9b00-f7ad061940a8 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:29.934745 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed99ac-be88-4cdc-b5a4-8c0ff5e56878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:29.935503 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed99ac-be88-4cdc-b5a4-8c0ff5e56878 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:29.935857 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed99ac-be88-4cdc-b5a4-8c0ff5e56878 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:29.936202 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed99ac-be88-4cdc-b5a4-8c0ff5e56878 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:29.937037 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed99ac-be88-4cdc-b5a4-8c0ff5e56878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:29.939785 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed99ac-be88-4cdc-b5a4-8c0ff5e56878 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:30.071286 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1309/2644] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:38:29 2021] POST /identity/v3/users => generated 292 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:38:30.074992 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed99ac-be88-4cdc-b5a4-8c0ff5e56878 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:30.087612 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed99ac-be88-4cdc-b5a4-8c0ff5e56878 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:30.092767 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c37b8-1a4a-4521-a1ef-f79abd2d7bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:30.093406 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c37b8-1a4a-4521-a1ef-f79abd2d7bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:30.093688 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c37b8-1a4a-4521-a1ef-f79abd2d7bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:30.093963 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c37b8-1a4a-4521-a1ef-f79abd2d7bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:30.094707 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c37b8-1a4a-4521-a1ef-f79abd2d7bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:30.096348 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c37b8-1a4a-4521-a1ef-f79abd2d7bc4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:30.107589 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1310/2645] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:30 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:38:30.112198 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c37b8-1a4a-4521-a1ef-f79abd2d7bc4 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:30.123303 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c37b8-1a4a-4521-a1ef-f79abd2d7bc4 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:30.128730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c619b4-2517-4107-b97a-6e53a797cf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:30.130586 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c619b4-2517-4107-b97a-6e53a797cf53 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:30.130890 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c619b4-2517-4107-b97a-6e53a797cf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:30.131141 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c619b4-2517-4107-b97a-6e53a797cf53 admin admin] PATH_INFO: `/v3/projects/5300ebf3b4fe4d50a207577cae0856a2/users/e3bfcf334f4b4a9bbacb09949fca8d65/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:30.148149 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c619b4-2517-4107-b97a-6e53a797cf53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5300ebf3b4fe4d50a207577cae0856a2, user_id=e3bfcf334f4b4a9bbacb09949fca8d65, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:30.153657 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c619b4-2517-4107-b97a-6e53a797cf53 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:30.194134 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3a9e7fa7-8884-4d77-9b00-f7ad061940a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '749f5aa9f7774c7abcd824fc5f9d27fc'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:30.205936 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3a9e7fa7-8884-4d77-9b00-f7ad061940a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '749f5aa9f7774c7abcd824fc5f9d27fc'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:30.213396 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3a9e7fa7-8884-4d77-9b00-f7ad061940a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '749f5aa9f7774c7abcd824fc5f9d27fc'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:30.214434 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3a9e7fa7-8884-4d77-9b00-f7ad061940a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '749f5aa9f7774c7abcd824fc5f9d27fc'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:30.339286 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-3a9e7fa7-8884-4d77-9b00-f7ad061940a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '749f5aa9f7774c7abcd824fc5f9d27fc'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:30.345346 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1311/2646] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:30 2021] PUT /identity/v3/projects/5300ebf3b4fe4d50a207577cae0856a2/users/e3bfcf334f4b4a9bbacb09949fca8d65/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:30.354552 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c619b4-2517-4107-b97a-6e53a797cf53 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:30.356665 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1336/2647] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:38:29 2021] DELETE /identity/v3/users/749f5aa9f7774c7abcd824fc5f9d27fc => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:30.357053 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-26c619b4-2517-4107-b97a-6e53a797cf53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:30.359216 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c47f6-43bc-4a54-82be-7e29ecf09d00 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:30.359942 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c47f6-43bc-4a54-82be-7e29ecf09d00 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:30.360392 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c47f6-43bc-4a54-82be-7e29ecf09d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:30.392012 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-764c47f6-43bc-4a54-82be-7e29ecf09d00 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:30.392012 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-764c47f6-43bc-4a54-82be-7e29ecf09d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:30.466581 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c619b4-2517-4107-b97a-6e53a797cf53 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:30.497263 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1337/2648] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:30.509040 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c47f6-43bc-4a54-82be-7e29ecf09d00 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:30.510858 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-764c47f6-43bc-4a54-82be-7e29ecf09d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:30.558316 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d593f8-9aac-4a79-8a0b-c61e14300d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:30.558993 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d593f8-9aac-4a79-8a0b-c61e14300d75 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:30.559277 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d593f8-9aac-4a79-8a0b-c61e14300d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:30.560071 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d593f8-9aac-4a79-8a0b-c61e14300d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:30.560800 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d593f8-9aac-4a79-8a0b-c61e14300d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:30.563518 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d593f8-9aac-4a79-8a0b-c61e14300d75 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:30.572745 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1312/2649] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:30 2021] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:38:30.576788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d593f8-9aac-4a79-8a0b-c61e14300d75 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:30.582466 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c47f6-43bc-4a54-82be-7e29ecf09d00 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:30.586379 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e6812-5eed-41a1-832d-17ab3fe98064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:30.586625 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d593f8-9aac-4a79-8a0b-c61e14300d75 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:30.587070 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e6812-5eed-41a1-832d-17ab3fe98064 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:30.587357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e6812-5eed-41a1-832d-17ab3fe98064 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:30.587635 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e6812-5eed-41a1-832d-17ab3fe98064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:30.591449 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9ee39-2bc4-47a4-9a74-3b30831fdae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:30.592307 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9ee39-2bc4-47a4-9a74-3b30831fdae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:30.592908 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9ee39-2bc4-47a4-9a74-3b30831fdae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:30.592908 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9ee39-2bc4-47a4-9a74-3b30831fdae3 admin admin] PATH_INFO: `/v3/projects/5300ebf3b4fe4d50a207577cae0856a2/users/e3bfcf334f4b4a9bbacb09949fca8d65/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:30.594874 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9ee39-2bc4-47a4-9a74-3b30831fdae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5300ebf3b4fe4d50a207577cae0856a2, user_id=e3bfcf334f4b4a9bbacb09949fca8d65, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:30.596970 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e6812-5eed-41a1-832d-17ab3fe98064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:30.597544 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9ee39-2bc4-47a4-9a74-3b30831fdae3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:30.599124 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e6812-5eed-41a1-832d-17ab3fe98064 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:30.608897 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1313/2650] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:30 2021] PUT /identity/v3/projects/5300ebf3b4fe4d50a207577cae0856a2/users/e3bfcf334f4b4a9bbacb09949fca8d65/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:38:30.609061 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1338/2651] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:38:31.220325 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9ee39-2bc4-47a4-9a74-3b30831fdae3 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:31.222339 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-4db9ee39-2bc4-47a4-9a74-3b30831fdae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:31.306834 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9ee39-2bc4-47a4-9a74-3b30831fdae3 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:31.312342 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b539c30-6256-40b8-b1e3-b27723714908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:31.313032 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b539c30-6256-40b8-b1e3-b27723714908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:31.313430 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b539c30-6256-40b8-b1e3-b27723714908 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:31.313713 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b539c30-6256-40b8-b1e3-b27723714908 admin admin] PATH_INFO: `/v3/projects/4f1c338823a34f149491a347c340470a` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:31.314919 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b539c30-6256-40b8-b1e3-b27723714908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1c338823a34f149491a347c340470a)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:31.317050 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b539c30-6256-40b8-b1e3-b27723714908 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:31.529828 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3b539c30-6256-40b8-b1e3-b27723714908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1c338823a34f149491a347c340470a', 'request_id': 'req-3b539c30-6256-40b8-b1e3-b27723714908'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:31.538707 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3b539c30-6256-40b8-b1e3-b27723714908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1c338823a34f149491a347c340470a', 'request_id': 'req-3b539c30-6256-40b8-b1e3-b27723714908'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:31.658681 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3b539c30-6256-40b8-b1e3-b27723714908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1c338823a34f149491a347c340470a', 'request_id': 'req-3b539c30-6256-40b8-b1e3-b27723714908'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:31.672323 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3b539c30-6256-40b8-b1e3-b27723714908 admin admin] The token cache is being invalidate because project 4f1c338823a34f149491a347c340470a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:38:31.672938 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3b539c30-6256-40b8-b1e3-b27723714908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:31.674163 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3b539c30-6256-40b8-b1e3-b27723714908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:31.676911 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1314/2652] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:38:31 2021] DELETE /identity/v3/projects/4f1c338823a34f149491a347c340470a => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:31.681723 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63a859-8d18-4c78-9912-c93381379efb None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:31.682221 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63a859-8d18-4c78-9912-c93381379efb None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:31.682316 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63a859-8d18-4c78-9912-c93381379efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:31.700822 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-bc63a859-8d18-4c78-9912-c93381379efb None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:31.702136 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-bc63a859-8d18-4c78-9912-c93381379efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:31.798990 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1339/2653] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:31.800856 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74947ec-e018-4e4a-a773-6787f996f9b8 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:31.801739 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74947ec-e018-4e4a-a773-6787f996f9b8 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:31.802026 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74947ec-e018-4e4a-a773-6787f996f9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:31.828190 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-a74947ec-e018-4e4a-a773-6787f996f9b8 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:31.829414 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-a74947ec-e018-4e4a-a773-6787f996f9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:31.853856 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1315/2654] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:31.855057 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63a859-8d18-4c78-9912-c93381379efb None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:31.866446 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63a859-8d18-4c78-9912-c93381379efb None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:31.871397 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b4592-d128-4e50-924c-0c9a75665ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:31.872144 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b4592-d128-4e50-924c-0c9a75665ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:31.872530 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b4592-d128-4e50-924c-0c9a75665ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:31.872909 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b4592-d128-4e50-924c-0c9a75665ad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:31.873850 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b4592-d128-4e50-924c-0c9a75665ad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:38:31.874158 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b4592-d128-4e50-924c-0c9a75665ad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:31.875895 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b4592-d128-4e50-924c-0c9a75665ad6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:31.888800 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1340/2655] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:38:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:38:31.892811 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74947ec-e018-4e4a-a773-6787f996f9b8 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:31.902786 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74947ec-e018-4e4a-a773-6787f996f9b8 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:31.908579 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3e577-a4b6-462b-80ef-dc0d8c4f2ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:31.908579 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3e577-a4b6-462b-80ef-dc0d8c4f2ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:31.908579 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3e577-a4b6-462b-80ef-dc0d8c4f2ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:31.908994 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3e577-a4b6-462b-80ef-dc0d8c4f2ca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:31.909645 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3e577-a4b6-462b-80ef-dc0d8c4f2ca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:31.912429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3e577-a4b6-462b-80ef-dc0d8c4f2ca8 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:32.049338 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1316/2656] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:38:31 2021] POST /identity/v3/projects => generated 403 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:38:32.053486 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b4592-d128-4e50-924c-0c9a75665ad6 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:32.063701 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b4592-d128-4e50-924c-0c9a75665ad6 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:32.124463 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d93b30-3bbc-45de-bc20-593f4392520f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:32.125189 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d93b30-3bbc-45de-bc20-593f4392520f admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:32.125468 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d93b30-3bbc-45de-bc20-593f4392520f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:32.125834 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d93b30-3bbc-45de-bc20-593f4392520f admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:32.126738 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d93b30-3bbc-45de-bc20-593f4392520f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:32.128673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d93b30-3bbc-45de-bc20-593f4392520f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:32.318063 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1341/2657] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:38:32 2021] POST /identity/v3/users => generated 302 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:38:32.322130 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3e577-a4b6-462b-80ef-dc0d8c4f2ca8 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:32.341425 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3e577-a4b6-462b-80ef-dc0d8c4f2ca8 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:32.347334 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1c486-da3b-414a-ad26-f8986d4f648c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:32.348315 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1c486-da3b-414a-ad26-f8986d4f648c admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:32.348589 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1c486-da3b-414a-ad26-f8986d4f648c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:32.348938 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1c486-da3b-414a-ad26-f8986d4f648c admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:32.349639 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1c486-da3b-414a-ad26-f8986d4f648c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:32.351372 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1c486-da3b-414a-ad26-f8986d4f648c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:32.368426 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1317/2658] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:32 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:32.369475 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d93b30-3bbc-45de-bc20-593f4392520f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:32.383316 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d93b30-3bbc-45de-bc20-593f4392520f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:32.388297 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fa1e8-df6e-43ed-91e6-d5e9f6a49686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:32.389024 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fa1e8-df6e-43ed-91e6-d5e9f6a49686 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:32.389314 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fa1e8-df6e-43ed-91e6-d5e9f6a49686 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:32.389596 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fa1e8-df6e-43ed-91e6-d5e9f6a49686 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:32.390359 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fa1e8-df6e-43ed-91e6-d5e9f6a49686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:32.396968 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fa1e8-df6e-43ed-91e6-d5e9f6a49686 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:32.428693 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1342/2659] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:32 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:38:32.430635 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1c486-da3b-414a-ad26-f8986d4f648c admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:32.441397 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1c486-da3b-414a-ad26-f8986d4f648c admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:32.453126 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9e7cb-b2a4-4f6c-a7ae-3ca4dec67e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:32.454165 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9e7cb-b2a4-4f6c-a7ae-3ca4dec67e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:32.454522 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9e7cb-b2a4-4f6c-a7ae-3ca4dec67e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:32.455011 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9e7cb-b2a4-4f6c-a7ae-3ca4dec67e15 admin admin] PATH_INFO: `/v3/projects/82e6c6b4895840a0ad07201549366768/users/ff54628780b94d3bb9d142028bc6403e/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:32.471878 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9e7cb-b2a4-4f6c-a7ae-3ca4dec67e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e6c6b4895840a0ad07201549366768, user_id=ff54628780b94d3bb9d142028bc6403e, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:32.478944 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9e7cb-b2a4-4f6c-a7ae-3ca4dec67e15 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:32.599286 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1318/2660] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:32 2021] PUT /identity/v3/projects/82e6c6b4895840a0ad07201549366768/users/ff54628780b94d3bb9d142028bc6403e/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:32.610232 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a39a24-b0cc-409d-9f3c-e8234af6eeff None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:32.610521 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a39a24-b0cc-409d-9f3c-e8234af6eeff None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:32.610802 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a39a24-b0cc-409d-9f3c-e8234af6eeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:32.662164 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-34a39a24-b0cc-409d-9f3c-e8234af6eeff None None] MFA Rules not processed for user `ff54628780b94d3bb9d142028bc6403e`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:32.663793 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-34a39a24-b0cc-409d-9f3c-e8234af6eeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:32.748119 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1343/2661] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:32 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:32.752784 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9e7cb-b2a4-4f6c-a7ae-3ca4dec67e15 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:32.863231 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a39a24-b0cc-409d-9f3c-e8234af6eeff None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:32.865895 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-34a39a24-b0cc-409d-9f3c-e8234af6eeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:32.867695 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9e7cb-b2a4-4f6c-a7ae-3ca4dec67e15 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:32.873116 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fd238-3259-4993-9ea3-7aafbeec506c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:32.874082 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fd238-3259-4993-9ea3-7aafbeec506c admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:32.874599 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fd238-3259-4993-9ea3-7aafbeec506c admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:32.875108 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fd238-3259-4993-9ea3-7aafbeec506c admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:32.876027 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fd238-3259-4993-9ea3-7aafbeec506c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:32.878492 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fd238-3259-4993-9ea3-7aafbeec506c admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:32.897665 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a39a24-b0cc-409d-9f3c-e8234af6eeff None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:32.902643 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c5ab3-54af-4182-86f9-b2bb4ff395a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:32.903529 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c5ab3-54af-4182-86f9-b2bb4ff395a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:32.903810 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c5ab3-54af-4182-86f9-b2bb4ff395a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:32.904229 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c5ab3-54af-4182-86f9-b2bb4ff395a8 admin admin] PATH_INFO: `/v3/users/6b99317d89884b428b545f93cab24628` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:32.905514 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c5ab3-54af-4182-86f9-b2bb4ff395a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b99317d89884b428b545f93cab24628)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:32.907439 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c5ab3-54af-4182-86f9-b2bb4ff395a8 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:32.969755 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1319/2662] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:38:32 2021] POST /identity/v3/projects => generated 403 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:38:32.974217 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fd238-3259-4993-9ea3-7aafbeec506c admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:33.048934 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fd238-3259-4993-9ea3-7aafbeec506c admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:33.054872 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a54c9b-668b-4dea-91ce-9de254b8c36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:33.055560 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a54c9b-668b-4dea-91ce-9de254b8c36d admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:33.055850 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a54c9b-668b-4dea-91ce-9de254b8c36d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:33.056120 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a54c9b-668b-4dea-91ce-9de254b8c36d admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:33.056819 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a54c9b-668b-4dea-91ce-9de254b8c36d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:33.058842 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a54c9b-668b-4dea-91ce-9de254b8c36d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:33.146501 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d97c5ab3-54af-4182-86f9-b2bb4ff395a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b99317d89884b428b545f93cab24628'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:33.159317 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d97c5ab3-54af-4182-86f9-b2bb4ff395a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b99317d89884b428b545f93cab24628'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:33.166739 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d97c5ab3-54af-4182-86f9-b2bb4ff395a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b99317d89884b428b545f93cab24628'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:33.167759 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d97c5ab3-54af-4182-86f9-b2bb4ff395a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b99317d89884b428b545f93cab24628'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:33.177073 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1320/2663] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:38:32 2021] POST /identity/v3/users => generated 308 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:38:33.180437 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a54c9b-668b-4dea-91ce-9de254b8c36d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:33.190672 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a54c9b-668b-4dea-91ce-9de254b8c36d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:33.196616 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892675a-4bda-421f-8952-f4fcc685cec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:33.197419 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892675a-4bda-421f-8952-f4fcc685cec5 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:33.197774 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892675a-4bda-421f-8952-f4fcc685cec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:33.198122 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892675a-4bda-421f-8952-f4fcc685cec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:33.198927 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892675a-4bda-421f-8952-f4fcc685cec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:33.200614 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892675a-4bda-421f-8952-f4fcc685cec5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:33.215293 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1321/2664] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:33 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:38:33.216204 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892675a-4bda-421f-8952-f4fcc685cec5 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:33.226862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892675a-4bda-421f-8952-f4fcc685cec5 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:33.232275 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5971940-e3be-4ae7-adfd-0eacc5375db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:33.233391 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5971940-e3be-4ae7-adfd-0eacc5375db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:33.233682 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5971940-e3be-4ae7-adfd-0eacc5375db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:33.233964 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5971940-e3be-4ae7-adfd-0eacc5375db4 admin admin] PATH_INFO: `/v3/projects/360909d4c8c9447ea46e046bfc5e0709/users/5d45d3b3a1ed4b6f93aa49e416b31ea3/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:33.241978 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d97c5ab3-54af-4182-86f9-b2bb4ff395a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b99317d89884b428b545f93cab24628'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:33.249071 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1344/2665] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:38:32 2021] DELETE /identity/v3/users/6b99317d89884b428b545f93cab24628 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:38:33.253792 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b992f30-6737-43df-b008-65c68c66b45f None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:33.254790 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b992f30-6737-43df-b008-65c68c66b45f None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:33.255335 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b992f30-6737-43df-b008-65c68c66b45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:33.262411 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5971940-e3be-4ae7-adfd-0eacc5375db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=360909d4c8c9447ea46e046bfc5e0709, user_id=5d45d3b3a1ed4b6f93aa49e416b31ea3, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:33.265927 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5971940-e3be-4ae7-adfd-0eacc5375db4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:33.287271 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-2b992f30-6737-43df-b008-65c68c66b45f None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:33.290042 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-2b992f30-6737-43df-b008-65c68c66b45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:33.351735 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1322/2666] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:33 2021] PUT /identity/v3/projects/360909d4c8c9447ea46e046bfc5e0709/users/5d45d3b3a1ed4b6f93aa49e416b31ea3/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:33.356116 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5971940-e3be-4ae7-adfd-0eacc5375db4 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:33.358160 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e5971940-e3be-4ae7-adfd-0eacc5375db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:33.386602 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1345/2667] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:38:33.402117 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b992f30-6737-43df-b008-65c68c66b45f None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:33.403991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-2b992f30-6737-43df-b008-65c68c66b45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:33.464811 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5971940-e3be-4ae7-adfd-0eacc5375db4 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:33.476586 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ecca5-a623-4595-98e9-8619fe93d582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:33.478073 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ecca5-a623-4595-98e9-8619fe93d582 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:33.481207 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ecca5-a623-4595-98e9-8619fe93d582 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:33.481705 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ecca5-a623-4595-98e9-8619fe93d582 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:33.483251 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ecca5-a623-4595-98e9-8619fe93d582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:33.485699 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ecca5-a623-4595-98e9-8619fe93d582 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:33.491150 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b992f30-6737-43df-b008-65c68c66b45f None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:33.501580 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1323/2668] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:33 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:33.502813 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ecca5-a623-4595-98e9-8619fe93d582 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:33.518530 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ecca5-a623-4595-98e9-8619fe93d582 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:33.523850 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5f9cb-3a10-4087-96ba-1e951ea56de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:33.524821 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5f9cb-3a10-4087-96ba-1e951ea56de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:33.525139 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5f9cb-3a10-4087-96ba-1e951ea56de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:33.525419 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5f9cb-3a10-4087-96ba-1e951ea56de3 admin admin] PATH_INFO: `/v3/projects/360909d4c8c9447ea46e046bfc5e0709/users/5d45d3b3a1ed4b6f93aa49e416b31ea3/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:33.527618 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5f9cb-3a10-4087-96ba-1e951ea56de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=360909d4c8c9447ea46e046bfc5e0709, user_id=5d45d3b3a1ed4b6f93aa49e416b31ea3, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:33.530727 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5f9cb-3a10-4087-96ba-1e951ea56de3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:33.544590 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1324/2669] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:33 2021] PUT /identity/v3/projects/360909d4c8c9447ea46e046bfc5e0709/users/5d45d3b3a1ed4b6f93aa49e416b31ea3/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:38:33.557529 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085cddb-789a-493e-8e03-485a91423ceb None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:33.557812 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085cddb-789a-493e-8e03-485a91423ceb None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:33.558094 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085cddb-789a-493e-8e03-485a91423ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:33.569641 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758833e-f43e-4080-805f-740d654e729f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:33.570793 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758833e-f43e-4080-805f-740d654e729f service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:33.571084 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758833e-f43e-4080-805f-740d654e729f service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:33.571361 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758833e-f43e-4080-805f-740d654e729f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:33.584986 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758833e-f43e-4080-805f-740d654e729f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:33.587269 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758833e-f43e-4080-805f-740d654e729f service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:33.593736 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-0085cddb-789a-493e-8e03-485a91423ceb None None] MFA Rules not processed for user `5d45d3b3a1ed4b6f93aa49e416b31ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:33.604901 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1346/2670] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:38:33.607532 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-0085cddb-789a-493e-8e03-485a91423ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:33.711631 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1325/2671] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:33 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:38:33.718880 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758833e-f43e-4080-805f-740d654e729f service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:33.720403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-3758833e-f43e-4080-805f-740d654e729f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:33.784071 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758833e-f43e-4080-805f-740d654e729f service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:33.840700 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a29a24-9ca3-4db4-8eb3-4c9aafac8182 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:33.841415 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a29a24-9ca3-4db4-8eb3-4c9aafac8182 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:33.841702 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a29a24-9ca3-4db4-8eb3-4c9aafac8182 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:33.841985 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a29a24-9ca3-4db4-8eb3-4c9aafac8182 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:33.887460 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a29a24-9ca3-4db4-8eb3-4c9aafac8182 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:33.889082 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a29a24-9ca3-4db4-8eb3-4c9aafac8182 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:33.900794 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1347/2672] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:33 2021] GET /identity/v3/auth/tokens => generated 3490 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:38:34.063672 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085cddb-789a-493e-8e03-485a91423ceb None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:34.124649 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085cddb-789a-493e-8e03-485a91423ceb None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:34.129219 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42211345-044c-454a-936c-e7959c495f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:34.130249 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42211345-044c-454a-936c-e7959c495f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:34.130523 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42211345-044c-454a-936c-e7959c495f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:34.130795 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42211345-044c-454a-936c-e7959c495f92 admin admin] PATH_INFO: `/v3/users/ff54628780b94d3bb9d142028bc6403e` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:34.132013 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42211345-044c-454a-936c-e7959c495f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff54628780b94d3bb9d142028bc6403e)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:34.133975 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42211345-044c-454a-936c-e7959c495f92 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:34.220672 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a29a24-9ca3-4db4-8eb3-4c9aafac8182 service cinder] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:34.222467 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f3a29a24-9ca3-4db4-8eb3-4c9aafac8182 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:34.259066 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a29a24-9ca3-4db4-8eb3-4c9aafac8182 service cinder] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:34.264692 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc4160-33a9-4bd8-b543-c309ee99f11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:34.265605 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc4160-33a9-4bd8-b543-c309ee99f11f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:34.265881 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc4160-33a9-4bd8-b543-c309ee99f11f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:34.266151 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc4160-33a9-4bd8-b543-c309ee99f11f admin admin] PATH_INFO: `/v3/projects/acd42545c9da44c5836d14a0ef617cb1` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:34.267730 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc4160-33a9-4bd8-b543-c309ee99f11f admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd42545c9da44c5836d14a0ef617cb1)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:34.270462 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc4160-33a9-4bd8-b543-c309ee99f11f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:34.434927 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-42211345-044c-454a-936c-e7959c495f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff54628780b94d3bb9d142028bc6403e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:34.436562 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-42211345-044c-454a-936c-e7959c495f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff54628780b94d3bb9d142028bc6403e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:34.467584 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-42211345-044c-454a-936c-e7959c495f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff54628780b94d3bb9d142028bc6403e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:34.471143 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-cfbc4160-33a9-4bd8-b543-c309ee99f11f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd42545c9da44c5836d14a0ef617cb1', 'request_id': 'req-cfbc4160-33a9-4bd8-b543-c309ee99f11f'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:34.476284 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-42211345-044c-454a-936c-e7959c495f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff54628780b94d3bb9d142028bc6403e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:34.481289 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-cfbc4160-33a9-4bd8-b543-c309ee99f11f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd42545c9da44c5836d14a0ef617cb1', 'request_id': 'req-cfbc4160-33a9-4bd8-b543-c309ee99f11f'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:34.590654 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-42211345-044c-454a-936c-e7959c495f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff54628780b94d3bb9d142028bc6403e'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:34.641494 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1326/2673] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:38:34 2021] DELETE /identity/v3/users/ff54628780b94d3bb9d142028bc6403e => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:34.646090 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba763b-197a-4392-b41c-28d75347ae14 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:34.646627 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba763b-197a-4392-b41c-28d75347ae14 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:34.647325 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba763b-197a-4392-b41c-28d75347ae14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:34.653987 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-cfbc4160-33a9-4bd8-b543-c309ee99f11f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd42545c9da44c5836d14a0ef617cb1', 'request_id': 'req-cfbc4160-33a9-4bd8-b543-c309ee99f11f'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:34.679438 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-cfbc4160-33a9-4bd8-b543-c309ee99f11f admin admin] The token cache is being invalidate because project acd42545c9da44c5836d14a0ef617cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:38:34.680138 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-cfbc4160-33a9-4bd8-b543-c309ee99f11f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:34.680404 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-c0ba763b-197a-4392-b41c-28d75347ae14 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:34.681176 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-cfbc4160-33a9-4bd8-b543-c309ee99f11f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:34.681992 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-c0ba763b-197a-4392-b41c-28d75347ae14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:34.683380 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1348/2674] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:38:34 2021] DELETE /identity/v3/projects/acd42545c9da44c5836d14a0ef617cb1 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:34.687246 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc4160-33a9-4bd8-b543-c309ee99f11f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:34.689023 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-cfbc4160-33a9-4bd8-b543-c309ee99f11f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:34.767864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1327/2675] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:34.780067 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba763b-197a-4392-b41c-28d75347ae14 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:34.782541 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-c0ba763b-197a-4392-b41c-28d75347ae14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:34.805783 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc4160-33a9-4bd8-b543-c309ee99f11f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:34.813079 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f9d00-beac-4efa-940d-3a1d36748f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:34.814158 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f9d00-beac-4efa-940d-3a1d36748f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:34.814524 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f9d00-beac-4efa-940d-3a1d36748f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:34.814718 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f9d00-beac-4efa-940d-3a1d36748f76 admin admin] PATH_INFO: `/v3/users/7b570872bad64372b130e2e6888a65ad` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:34.817588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f9d00-beac-4efa-940d-3a1d36748f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b570872bad64372b130e2e6888a65ad)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:34.821337 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f9d00-beac-4efa-940d-3a1d36748f76 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:34.849002 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba763b-197a-4392-b41c-28d75347ae14 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:34.854770 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc40506-267b-486e-90ba-1b3adc72b7c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:34.855637 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc40506-267b-486e-90ba-1b3adc72b7c6 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:34.856049 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc40506-267b-486e-90ba-1b3adc72b7c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:34.856398 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc40506-267b-486e-90ba-1b3adc72b7c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:34.867711 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc40506-267b-486e-90ba-1b3adc72b7c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:34.869700 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc40506-267b-486e-90ba-1b3adc72b7c6 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:34.881531 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1328/2676] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:38:35.112317 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d97f9d00-beac-4efa-940d-3a1d36748f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b570872bad64372b130e2e6888a65ad'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:35.134287 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d97f9d00-beac-4efa-940d-3a1d36748f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b570872bad64372b130e2e6888a65ad'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:35.142034 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d97f9d00-beac-4efa-940d-3a1d36748f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b570872bad64372b130e2e6888a65ad'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:35.143106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d97f9d00-beac-4efa-940d-3a1d36748f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b570872bad64372b130e2e6888a65ad'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:35.241566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-d97f9d00-beac-4efa-940d-3a1d36748f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b570872bad64372b130e2e6888a65ad'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:35.254096 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1349/2677] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:38:34 2021] DELETE /identity/v3/users/7b570872bad64372b130e2e6888a65ad => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:35.533077 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc40506-267b-486e-90ba-1b3adc72b7c6 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:35.534642 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-cbc40506-267b-486e-90ba-1b3adc72b7c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:35.562501 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc40506-267b-486e-90ba-1b3adc72b7c6 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:35.671153 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8da8cc-545f-4659-b95d-e9b2dad99155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:35.672032 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8da8cc-545f-4659-b95d-e9b2dad99155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:35.672318 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8da8cc-545f-4659-b95d-e9b2dad99155 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:35.672597 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8da8cc-545f-4659-b95d-e9b2dad99155 admin admin] PATH_INFO: `/v3/projects/82e6c6b4895840a0ad07201549366768` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:35.674120 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8da8cc-545f-4659-b95d-e9b2dad99155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e6c6b4895840a0ad07201549366768)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:35.676709 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8da8cc-545f-4659-b95d-e9b2dad99155 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:35.789201 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cd8da8cc-545f-4659-b95d-e9b2dad99155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e6c6b4895840a0ad07201549366768', 'request_id': 'req-cd8da8cc-545f-4659-b95d-e9b2dad99155'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:35.795879 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cd8da8cc-545f-4659-b95d-e9b2dad99155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e6c6b4895840a0ad07201549366768', 'request_id': 'req-cd8da8cc-545f-4659-b95d-e9b2dad99155'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:35.842812 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f9d00-beac-4efa-940d-3a1d36748f76 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:35.845118 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-d97f9d00-beac-4efa-940d-3a1d36748f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:35.860717 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f9d00-beac-4efa-940d-3a1d36748f76 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:35.898693 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cd8da8cc-545f-4659-b95d-e9b2dad99155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e6c6b4895840a0ad07201549366768', 'request_id': 'req-cd8da8cc-545f-4659-b95d-e9b2dad99155'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:35.914470 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cd8da8cc-545f-4659-b95d-e9b2dad99155 admin admin] The token cache is being invalidate because project 82e6c6b4895840a0ad07201549366768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:38:35.914792 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cd8da8cc-545f-4659-b95d-e9b2dad99155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:35.915668 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-cd8da8cc-545f-4659-b95d-e9b2dad99155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:35.921821 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1329/2678] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:38:35 2021] DELETE /identity/v3/projects/82e6c6b4895840a0ad07201549366768 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:35.923227 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8da8cc-545f-4659-b95d-e9b2dad99155 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:35.924692 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-cd8da8cc-545f-4659-b95d-e9b2dad99155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:35.927278 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d65cf2-4907-4a19-b526-d54af9ef02d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:35.929416 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d65cf2-4907-4a19-b526-d54af9ef02d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:35.930884 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d65cf2-4907-4a19-b526-d54af9ef02d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:35.931345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d65cf2-4907-4a19-b526-d54af9ef02d8 admin admin] PATH_INFO: `/v3/projects/5039c55f9423475dbda98f3f61db5e9f` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:35.933819 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d65cf2-4907-4a19-b526-d54af9ef02d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5039c55f9423475dbda98f3f61db5e9f)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:35.936896 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d65cf2-4907-4a19-b526-d54af9ef02d8 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:35.943439 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8da8cc-545f-4659-b95d-e9b2dad99155 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:35.949074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413503c-8de2-4910-8d75-489ab13cb066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:35.949998 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413503c-8de2-4910-8d75-489ab13cb066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:35.950281 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413503c-8de2-4910-8d75-489ab13cb066 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:35.950555 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413503c-8de2-4910-8d75-489ab13cb066 admin admin] PATH_INFO: `/v3/users/5d45d3b3a1ed4b6f93aa49e416b31ea3` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:35.952561 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413503c-8de2-4910-8d75-489ab13cb066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d45d3b3a1ed4b6f93aa49e416b31ea3)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:35.954167 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413503c-8de2-4910-8d75-489ab13cb066 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:36.054078 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-66d65cf2-4907-4a19-b526-d54af9ef02d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5039c55f9423475dbda98f3f61db5e9f', 'request_id': 'req-66d65cf2-4907-4a19-b526-d54af9ef02d8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:36.060000 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-66d65cf2-4907-4a19-b526-d54af9ef02d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5039c55f9423475dbda98f3f61db5e9f', 'request_id': 'req-66d65cf2-4907-4a19-b526-d54af9ef02d8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:36.178577 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-66d65cf2-4907-4a19-b526-d54af9ef02d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5039c55f9423475dbda98f3f61db5e9f', 'request_id': 'req-66d65cf2-4907-4a19-b526-d54af9ef02d8'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:36.189730 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-66d65cf2-4907-4a19-b526-d54af9ef02d8 admin admin] The token cache is being invalidate because project 5039c55f9423475dbda98f3f61db5e9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:38:36.190023 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-66d65cf2-4907-4a19-b526-d54af9ef02d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:36.190692 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-66d65cf2-4907-4a19-b526-d54af9ef02d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:36.193797 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1350/2679] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:38:35 2021] DELETE /identity/v3/projects/5039c55f9423475dbda98f3f61db5e9f => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:36.199038 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d8ff-ed5b-44f6-83dc-43b7d2cb90fc None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:36.199393 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d8ff-ed5b-44f6-83dc-43b7d2cb90fc None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:36.199677 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d8ff-ed5b-44f6-83dc-43b7d2cb90fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:36.218138 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-d745d8ff-ed5b-44f6-83dc-43b7d2cb90fc None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:36.219335 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-d745d8ff-ed5b-44f6-83dc-43b7d2cb90fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:36.219681 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2413503c-8de2-4910-8d75-489ab13cb066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d45d3b3a1ed4b6f93aa49e416b31ea3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:36.220330 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2413503c-8de2-4910-8d75-489ab13cb066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d45d3b3a1ed4b6f93aa49e416b31ea3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:36.227320 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2413503c-8de2-4910-8d75-489ab13cb066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d45d3b3a1ed4b6f93aa49e416b31ea3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:36.227952 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2413503c-8de2-4910-8d75-489ab13cb066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d45d3b3a1ed4b6f93aa49e416b31ea3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:36.278887 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1351/2680] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:38:36.286764 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e845a7-98e7-420c-850b-00e790a1aa02 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:36.287057 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e845a7-98e7-420c-850b-00e790a1aa02 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:36.287336 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e845a7-98e7-420c-850b-00e790a1aa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:36.306783 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-93e845a7-98e7-420c-850b-00e790a1aa02 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:36.308028 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-93e845a7-98e7-420c-850b-00e790a1aa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:36.318153 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1352/2681] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:38:36.323597 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e845a7-98e7-420c-850b-00e790a1aa02 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:36.336050 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e845a7-98e7-420c-850b-00e790a1aa02 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:36.341484 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0c902-caf9-46f3-9f51-5f56ff393010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:36.342164 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0c902-caf9-46f3-9f51-5f56ff393010 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:36.342848 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0c902-caf9-46f3-9f51-5f56ff393010 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:36.343278 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0c902-caf9-46f3-9f51-5f56ff393010 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:36.344156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0c902-caf9-46f3-9f51-5f56ff393010 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:38:36.344468 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0c902-caf9-46f3-9f51-5f56ff393010 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:36.346110 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0c902-caf9-46f3-9f51-5f56ff393010 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:36.359596 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1353/2682] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:38:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:38:36.364506 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0c902-caf9-46f3-9f51-5f56ff393010 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:36.375900 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0c902-caf9-46f3-9f51-5f56ff393010 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:36.390619 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-2413503c-8de2-4910-8d75-489ab13cb066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d45d3b3a1ed4b6f93aa49e416b31ea3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:36.396234 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffc25b-f0c6-4f9b-9f91-59dfacfbfce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:36.401839 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffc25b-f0c6-4f9b-9f91-59dfacfbfce8 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:36.406718 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffc25b-f0c6-4f9b-9f91-59dfacfbfce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:36.410903 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffc25b-f0c6-4f9b-9f91-59dfacfbfce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:36.410903 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffc25b-f0c6-4f9b-9f91-59dfacfbfce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:36.413522 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffc25b-f0c6-4f9b-9f91-59dfacfbfce8 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:36.425588 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1330/2683] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:38:35 2021] DELETE /identity/v3/users/5d45d3b3a1ed4b6f93aa49e416b31ea3 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:36.531762 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1354/2684] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:38:36 2021] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:38:36.533302 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413503c-8de2-4910-8d75-489ab13cb066 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:36.600108 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413503c-8de2-4910-8d75-489ab13cb066 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:36.656657 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ad6b5-0d71-4815-9298-275dc8ec2542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:36.657363 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ad6b5-0d71-4815-9298-275dc8ec2542 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:36.657648 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ad6b5-0d71-4815-9298-275dc8ec2542 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:36.657923 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ad6b5-0d71-4815-9298-275dc8ec2542 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:36.658610 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ad6b5-0d71-4815-9298-275dc8ec2542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:36.661093 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ad6b5-0d71-4815-9298-275dc8ec2542 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:36.786725 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1331/2685] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:38:36 2021] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:38:36.793592 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffc25b-f0c6-4f9b-9f91-59dfacfbfce8 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:36.807465 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffc25b-f0c6-4f9b-9f91-59dfacfbfce8 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:36.812196 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc0441-fa2a-4e18-83fb-de460948d8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:36.813199 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc0441-fa2a-4e18-83fb-de460948d8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:36.813609 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc0441-fa2a-4e18-83fb-de460948d8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:36.814438 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc0441-fa2a-4e18-83fb-de460948d8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:36.814703 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc0441-fa2a-4e18-83fb-de460948d8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:36.816493 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc0441-fa2a-4e18-83fb-de460948d8d5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:36.830197 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1355/2686] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:36 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:36.832935 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ad6b5-0d71-4815-9298-275dc8ec2542 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:36.847032 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ad6b5-0d71-4815-9298-275dc8ec2542 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:36.853079 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3fe57-a86b-4851-950e-31aed80b4196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:36.853949 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3fe57-a86b-4851-950e-31aed80b4196 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:36.854562 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3fe57-a86b-4851-950e-31aed80b4196 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:36.854994 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3fe57-a86b-4851-950e-31aed80b4196 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:36.856089 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3fe57-a86b-4851-950e-31aed80b4196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:36.858242 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3fe57-a86b-4851-950e-31aed80b4196 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:36.877258 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1332/2687] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:36 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:36.878102 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc0441-fa2a-4e18-83fb-de460948d8d5 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:36.889108 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc0441-fa2a-4e18-83fb-de460948d8d5 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:36.893821 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a8328-9fd9-499f-864b-1c2c00fd7fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:36.895366 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8328-9fd9-499f-864b-1c2c00fd7fa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:36.895750 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8328-9fd9-499f-864b-1c2c00fd7fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:36.896243 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8328-9fd9-499f-864b-1c2c00fd7fa5 admin admin] PATH_INFO: `/v3/projects/d72e10657fb743329337e869d71860f6/users/6373463a7b8e4a0c96d35aa88b16cd9b/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:36.912795 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a8328-9fd9-499f-864b-1c2c00fd7fa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d72e10657fb743329337e869d71860f6, user_id=6373463a7b8e4a0c96d35aa88b16cd9b, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:36.915574 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a8328-9fd9-499f-864b-1c2c00fd7fa5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:36.986797 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1356/2688] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:36 2021] PUT /identity/v3/projects/d72e10657fb743329337e869d71860f6/users/6373463a7b8e4a0c96d35aa88b16cd9b/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:36.998178 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f12a79-e37a-4fd5-b614-ffd11549a236 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:36.998467 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f12a79-e37a-4fd5-b614-ffd11549a236 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:36.998744 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f12a79-e37a-4fd5-b614-ffd11549a236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:37.031107 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-64f12a79-e37a-4fd5-b614-ffd11549a236 None None] MFA Rules not processed for user `6373463a7b8e4a0c96d35aa88b16cd9b`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:37.032320 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-64f12a79-e37a-4fd5-b614-ffd11549a236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:37.100890 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1333/2689] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:36 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:37.110056 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a8328-9fd9-499f-864b-1c2c00fd7fa5 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:37.111874 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-909a8328-9fd9-499f-864b-1c2c00fd7fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:37.126961 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f12a79-e37a-4fd5-b614-ffd11549a236 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:37.129489 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-64f12a79-e37a-4fd5-b614-ffd11549a236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:37.181615 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a8328-9fd9-499f-864b-1c2c00fd7fa5 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:37.186514 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8573d-86b7-45dc-b33c-c5010a543202 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:37.187741 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8573d-86b7-45dc-b33c-c5010a543202 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:37.188264 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8573d-86b7-45dc-b33c-c5010a543202 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:37.188785 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8573d-86b7-45dc-b33c-c5010a543202 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:37.203842 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8573d-86b7-45dc-b33c-c5010a543202 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:37.205622 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8573d-86b7-45dc-b33c-c5010a543202 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:37.218040 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1357/2690] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:37 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:38:37.246924 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f12a79-e37a-4fd5-b614-ffd11549a236 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:37.254853 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4c40d-4015-4805-a0fe-897494eb60ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:37.256554 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4c40d-4015-4805-a0fe-897494eb60ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:37.256968 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4c40d-4015-4805-a0fe-897494eb60ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:37.257514 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4c40d-4015-4805-a0fe-897494eb60ea admin admin] PATH_INFO: `/v3/projects/360909d4c8c9447ea46e046bfc5e0709` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:37.259155 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4c40d-4015-4805-a0fe-897494eb60ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=360909d4c8c9447ea46e046bfc5e0709)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:37.261211 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4c40d-4015-4805-a0fe-897494eb60ea admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:37.401622 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-74c4c40d-4015-4805-a0fe-897494eb60ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '360909d4c8c9447ea46e046bfc5e0709', 'request_id': 'req-74c4c40d-4015-4805-a0fe-897494eb60ea'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:37.409516 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-74c4c40d-4015-4805-a0fe-897494eb60ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '360909d4c8c9447ea46e046bfc5e0709', 'request_id': 'req-74c4c40d-4015-4805-a0fe-897494eb60ea'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:37.544490 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-74c4c40d-4015-4805-a0fe-897494eb60ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '360909d4c8c9447ea46e046bfc5e0709', 'request_id': 'req-74c4c40d-4015-4805-a0fe-897494eb60ea'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:37.676227 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-74c4c40d-4015-4805-a0fe-897494eb60ea admin admin] The token cache is being invalidate because project 360909d4c8c9447ea46e046bfc5e0709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:38:37.676227 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-74c4c40d-4015-4805-a0fe-897494eb60ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:37.676227 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-74c4c40d-4015-4805-a0fe-897494eb60ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:37.676227 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1334/2691] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:38:37 2021] DELETE /identity/v3/projects/360909d4c8c9447ea46e046bfc5e0709 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:37.677857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c60a08-fe22-43d1-b71b-f7b21ce26b77 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:37.677857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c60a08-fe22-43d1-b71b-f7b21ce26b77 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:37.677857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c60a08-fe22-43d1-b71b-f7b21ce26b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:37.678134 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0fcaa-33f6-49b8-994a-8c0ab47c7ba6 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:37.678134 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0fcaa-33f6-49b8-994a-8c0ab47c7ba6 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:37.678134 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0fcaa-33f6-49b8-994a-8c0ab47c7ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:37.678402 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-10c60a08-fe22-43d1-b71b-f7b21ce26b77 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:37.678402 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-10c60a08-fe22-43d1-b71b-f7b21ce26b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:37.678589 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-9ce0fcaa-33f6-49b8-994a-8c0ab47c7ba6 None None] MFA Rules not processed for user `e3bfcf334f4b4a9bbacb09949fca8d65`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:37.678589 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-9ce0fcaa-33f6-49b8-994a-8c0ab47c7ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:37.681619 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1358/2692] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:37.689456 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8046725-2eca-43ed-97dd-a65d214cce49 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:37.689746 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8046725-2eca-43ed-97dd-a65d214cce49 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:37.690029 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8046725-2eca-43ed-97dd-a65d214cce49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:37.709872 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-a8046725-2eca-43ed-97dd-a65d214cce49 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:37.710813 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1335/2693] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:37 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:37.711091 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-a8046725-2eca-43ed-97dd-a65d214cce49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:37.721549 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0fcaa-33f6-49b8-994a-8c0ab47c7ba6 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:37.725282 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1359/2694] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:37.727236 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-9ce0fcaa-33f6-49b8-994a-8c0ab47c7ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:37.728485 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8046725-2eca-43ed-97dd-a65d214cce49 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:37.745438 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8046725-2eca-43ed-97dd-a65d214cce49 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:37.750459 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447589f-248a-4890-99da-b84e124d874d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:37.751134 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447589f-248a-4890-99da-b84e124d874d admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:37.751420 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447589f-248a-4890-99da-b84e124d874d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:37.751700 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447589f-248a-4890-99da-b84e124d874d admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:37.752429 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447589f-248a-4890-99da-b84e124d874d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:38:37.752755 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447589f-248a-4890-99da-b84e124d874d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:37.755581 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447589f-248a-4890-99da-b84e124d874d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:37.768043 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1360/2695] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:38:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:38:37.772609 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447589f-248a-4890-99da-b84e124d874d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:37.782657 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447589f-248a-4890-99da-b84e124d874d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:37.788661 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d62a8-3da3-4cd8-9912-efc77578163e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:37.789301 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d62a8-3da3-4cd8-9912-efc77578163e admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:37.798392 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d62a8-3da3-4cd8-9912-efc77578163e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:37.798392 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d62a8-3da3-4cd8-9912-efc77578163e admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:37.798392 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d62a8-3da3-4cd8-9912-efc77578163e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:37.798392 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d62a8-3da3-4cd8-9912-efc77578163e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:37.819940 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0fcaa-33f6-49b8-994a-8c0ab47c7ba6 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:37.825936 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb9a6d-1ed3-4bdb-aea9-ac91ad654fd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:37.826601 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb9a6d-1ed3-4bdb-aea9-ac91ad654fd5 service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:37.826883 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb9a6d-1ed3-4bdb-aea9-ac91ad654fd5 service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:37.827161 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb9a6d-1ed3-4bdb-aea9-ac91ad654fd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:37.829014 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-54bb9a6d-1ed3-4bdb-aea9-ac91ad654fd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:37.890557 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb9a6d-1ed3-4bdb-aea9-ac91ad654fd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:37.892163 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb9a6d-1ed3-4bdb-aea9-ac91ad654fd5 service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:37.901553 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1336/2696] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:37 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:38:37.982636 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1361/2697] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:38:37 2021] POST /identity/v3/projects => generated 401 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:38:37.983773 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb9a6d-1ed3-4bdb-aea9-ac91ad654fd5 service nova] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:37.988470 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb9a6d-1ed3-4bdb-aea9-ac91ad654fd5 service nova] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:38.058221 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799d566-cc37-4217-be63-0b8dafa89c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:38.058486 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799d566-cc37-4217-be63-0b8dafa89c55 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:38.058724 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799d566-cc37-4217-be63-0b8dafa89c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:38.059005 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799d566-cc37-4217-be63-0b8dafa89c55 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:38.066522 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799d566-cc37-4217-be63-0b8dafa89c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:38.068509 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799d566-cc37-4217-be63-0b8dafa89c55 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:38.225279 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1337/2698] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:38:37 2021] POST /identity/v3/users => generated 301 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:38:38.229405 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d62a8-3da3-4cd8-9912-efc77578163e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:38.240198 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d62a8-3da3-4cd8-9912-efc77578163e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:38.244962 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db74f64-dbdf-4800-b5f3-6c7749f02026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:38.245627 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db74f64-dbdf-4800-b5f3-6c7749f02026 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:38.245909 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db74f64-dbdf-4800-b5f3-6c7749f02026 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:38.247038 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db74f64-dbdf-4800-b5f3-6c7749f02026 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:38.248519 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db74f64-dbdf-4800-b5f3-6c7749f02026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:38.252657 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db74f64-dbdf-4800-b5f3-6c7749f02026 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:38.266922 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1362/2699] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:38 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:38.268496 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799d566-cc37-4217-be63-0b8dafa89c55 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:38.283862 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799d566-cc37-4217-be63-0b8dafa89c55 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:38.288680 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5fc9f-7eae-4951-9581-c57799069c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:38.289816 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5fc9f-7eae-4951-9581-c57799069c94 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:38.290109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5fc9f-7eae-4951-9581-c57799069c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:38.290553 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5fc9f-7eae-4951-9581-c57799069c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:38.291418 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5fc9f-7eae-4951-9581-c57799069c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:38.293167 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5fc9f-7eae-4951-9581-c57799069c94 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:38.319081 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1338/2700] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:38 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:38:38.322072 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db74f64-dbdf-4800-b5f3-6c7749f02026 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:38.335198 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db74f64-dbdf-4800-b5f3-6c7749f02026 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:38.351246 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f46fba-c940-4f95-8182-d81a919591e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:38.352376 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f46fba-c940-4f95-8182-d81a919591e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:38.352751 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f46fba-c940-4f95-8182-d81a919591e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:38.353125 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f46fba-c940-4f95-8182-d81a919591e9 admin admin] PATH_INFO: `/v3/projects/fa111e4d8c9d48bbb4e07eee18698f2c/users/1cdd3848291d4a96b17c6cf67b8c356f/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:38.383377 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f46fba-c940-4f95-8182-d81a919591e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa111e4d8c9d48bbb4e07eee18698f2c, user_id=1cdd3848291d4a96b17c6cf67b8c356f, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:38.387041 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f46fba-c940-4f95-8182-d81a919591e9 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:38.537906 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1363/2701] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:38 2021] PUT /identity/v3/projects/fa111e4d8c9d48bbb4e07eee18698f2c/users/1cdd3848291d4a96b17c6cf67b8c356f/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:38:38.548412 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6baeea-92d0-4522-9252-62ed5af7cbef None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:38.548977 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6baeea-92d0-4522-9252-62ed5af7cbef None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:38.549073 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6baeea-92d0-4522-9252-62ed5af7cbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:38.579387 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-2b6baeea-92d0-4522-9252-62ed5af7cbef None None] MFA Rules not processed for user `1cdd3848291d4a96b17c6cf67b8c356f`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:38.580626 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-2b6baeea-92d0-4522-9252-62ed5af7cbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:38.645941 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1339/2702] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:38 2021] POST /identity/v3/auth/tokens => generated 3421 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:38:38.650455 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f46fba-c940-4f95-8182-d81a919591e9 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:38.723653 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f46fba-c940-4f95-8182-d81a919591e9 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:38.728769 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2c67d-2970-4b39-b9ae-822c30aac172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:38.734357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2c67d-2970-4b39-b9ae-822c30aac172 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:38.734357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2c67d-2970-4b39-b9ae-822c30aac172 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:38.734357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2c67d-2970-4b39-b9ae-822c30aac172 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:38.734357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2c67d-2970-4b39-b9ae-822c30aac172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:38.734357 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2c67d-2970-4b39-b9ae-822c30aac172 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:38.861434 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1364/2703] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:38:38 2021] POST /identity/v3/projects => generated 401 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:38:38.862602 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6baeea-92d0-4522-9252-62ed5af7cbef None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:38.874365 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6baeea-92d0-4522-9252-62ed5af7cbef None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:38.932903 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f6561-5b9a-4aa4-a2a9-088f5816efaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:38.933591 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f6561-5b9a-4aa4-a2a9-088f5816efaa admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:38.933870 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f6561-5b9a-4aa4-a2a9-088f5816efaa admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:38.934140 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f6561-5b9a-4aa4-a2a9-088f5816efaa admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:38.934986 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f6561-5b9a-4aa4-a2a9-088f5816efaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:38.937221 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f6561-5b9a-4aa4-a2a9-088f5816efaa admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:39.042480 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1340/2704] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:38:38 2021] POST /identity/v3/users => generated 307 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:38:39.046351 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2c67d-2970-4b39-b9ae-822c30aac172 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:39.057472 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2c67d-2970-4b39-b9ae-822c30aac172 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:39.062124 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c182a5-fb68-4c7c-b4c4-be3a951f4cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:39.062781 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c182a5-fb68-4c7c-b4c4-be3a951f4cad admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:39.063067 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c182a5-fb68-4c7c-b4c4-be3a951f4cad admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:39.063347 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c182a5-fb68-4c7c-b4c4-be3a951f4cad admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:39.064070 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c182a5-fb68-4c7c-b4c4-be3a951f4cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:39.065727 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c182a5-fb68-4c7c-b4c4-be3a951f4cad admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:39.076462 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1365/2705] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:39 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:39.083055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f6561-5b9a-4aa4-a2a9-088f5816efaa admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:39.092770 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f6561-5b9a-4aa4-a2a9-088f5816efaa admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:39.097353 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88e64d-ebe2-4a07-b36e-54c507022baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:39.098860 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88e64d-ebe2-4a07-b36e-54c507022baa admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:39.099140 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88e64d-ebe2-4a07-b36e-54c507022baa admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:39.099415 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88e64d-ebe2-4a07-b36e-54c507022baa admin admin] PATH_INFO: `/v3/projects/d2e01d5effb34c138e7bf9fe5a3913e4/users/4b787486d3fc4b408f29d3d6d58b43a1/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:39.116454 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88e64d-ebe2-4a07-b36e-54c507022baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e01d5effb34c138e7bf9fe5a3913e4, user_id=4b787486d3fc4b408f29d3d6d58b43a1, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:39.118869 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88e64d-ebe2-4a07-b36e-54c507022baa admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:39.224054 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1341/2706] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:39 2021] PUT /identity/v3/projects/d2e01d5effb34c138e7bf9fe5a3913e4/users/4b787486d3fc4b408f29d3d6d58b43a1/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:39.228134 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c182a5-fb68-4c7c-b4c4-be3a951f4cad admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:39.238225 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c182a5-fb68-4c7c-b4c4-be3a951f4cad admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:39.293380 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda55a5e-4748-4c55-a0c0-25e54cc4c240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:39.294054 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda55a5e-4748-4c55-a0c0-25e54cc4c240 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:39.295198 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda55a5e-4748-4c55-a0c0-25e54cc4c240 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:39.295198 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda55a5e-4748-4c55-a0c0-25e54cc4c240 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:39.295408 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda55a5e-4748-4c55-a0c0-25e54cc4c240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:39.296926 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda55a5e-4748-4c55-a0c0-25e54cc4c240 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:39.310283 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1366/2707] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:39 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:38:39.311727 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88e64d-ebe2-4a07-b36e-54c507022baa admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:39.322362 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88e64d-ebe2-4a07-b36e-54c507022baa admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:39.327074 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935a82d-d47a-49c5-a96e-9e90e211e3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:39.327946 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935a82d-d47a-49c5-a96e-9e90e211e3f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:39.328222 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935a82d-d47a-49c5-a96e-9e90e211e3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:39.328492 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935a82d-d47a-49c5-a96e-9e90e211e3f8 admin admin] PATH_INFO: `/v3/projects/d2e01d5effb34c138e7bf9fe5a3913e4/users/4b787486d3fc4b408f29d3d6d58b43a1/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:39.330447 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7935a82d-d47a-49c5-a96e-9e90e211e3f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e01d5effb34c138e7bf9fe5a3913e4, user_id=4b787486d3fc4b408f29d3d6d58b43a1, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:39.333896 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7935a82d-d47a-49c5-a96e-9e90e211e3f8 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:39.344438 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1342/2708] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:39 2021] PUT /identity/v3/projects/d2e01d5effb34c138e7bf9fe5a3913e4/users/4b787486d3fc4b408f29d3d6d58b43a1/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:39.355386 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7ef1c-6fae-4fbb-9623-f7f3d3899512 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:39.355680 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7ef1c-6fae-4fbb-9623-f7f3d3899512 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:39.355993 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7ef1c-6fae-4fbb-9623-f7f3d3899512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:39.383406 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-eac7ef1c-6fae-4fbb-9623-f7f3d3899512 None None] MFA Rules not processed for user `4b787486d3fc4b408f29d3d6d58b43a1`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:39.388118 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-eac7ef1c-6fae-4fbb-9623-f7f3d3899512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:39.405711 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f070-8ee6-4071-9385-de818c970c88 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:39.405995 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f070-8ee6-4071-9385-de818c970c88 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:39.406273 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f070-8ee6-4071-9385-de818c970c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:39.424770 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-f366f070-8ee6-4071-9385-de818c970c88 None None] MFA Rules not processed for user `6373463a7b8e4a0c96d35aa88b16cd9b`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:39.426000 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-f366f070-8ee6-4071-9385-de818c970c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:39.454404 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1367/2709] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:39 2021] POST /identity/v3/auth/tokens => generated 3488 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:39.468408 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7ef1c-6fae-4fbb-9623-f7f3d3899512 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:39.468408 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-eac7ef1c-6fae-4fbb-9623-f7f3d3899512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:39.482917 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1343/2710] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:39 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:38:39.524566 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7ef1c-6fae-4fbb-9623-f7f3d3899512 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:39.528486 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a7a54-f1fb-403a-b95f-5b73d61285a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:39.529097 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a7a54-f1fb-403a-b95f-5b73d61285a2 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:39.529382 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a7a54-f1fb-403a-b95f-5b73d61285a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:39.529719 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a7a54-f1fb-403a-b95f-5b73d61285a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:39.540328 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a7a54-f1fb-403a-b95f-5b73d61285a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:39.541821 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a7a54-f1fb-403a-b95f-5b73d61285a2 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:39.552453 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1368/2711] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:39 2021] GET /identity/v3/auth/tokens => generated 3488 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:38:39.852717 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f070-8ee6-4071-9385-de818c970c88 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:39.862094 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f070-8ee6-4071-9385-de818c970c88 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:39.865891 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eeb01-7877-4f5f-b0a8-c01363f9c34d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:39.867796 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eeb01-7877-4f5f-b0a8-c01363f9c34d service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:39.867796 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eeb01-7877-4f5f-b0a8-c01363f9c34d service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:39.867796 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eeb01-7877-4f5f-b0a8-c01363f9c34d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:39.934412 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5eeb01-7877-4f5f-b0a8-c01363f9c34d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:39.935854 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5eeb01-7877-4f5f-b0a8-c01363f9c34d service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:39.947030 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1344/2712] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:39 2021] GET /identity/v3/auth/tokens => generated 3421 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:38:41.556884 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae15e34-c645-437d-be47-148c6436cc08 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:41.558476 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae15e34-c645-437d-be47-148c6436cc08 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:41.558476 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae15e34-c645-437d-be47-148c6436cc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:41.576424 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-aae15e34-c645-437d-be47-148c6436cc08 None None] MFA Rules not processed for user `ded8a106d4d64603a7c87306eae430b7`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:41.577738 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-aae15e34-c645-437d-be47-148c6436cc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:41.634332 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1369/2713] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:41 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:45.535791 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eeb01-7877-4f5f-b0a8-c01363f9c34d service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:45.600539 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eeb01-7877-4f5f-b0a8-c01363f9c34d service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:45.605218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdccb73-f004-484a-8008-a06dc03ba5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:45.606079 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdccb73-f004-484a-8008-a06dc03ba5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:45.606362 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdccb73-f004-484a-8008-a06dc03ba5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:45.606632 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdccb73-f004-484a-8008-a06dc03ba5a6 admin admin] PATH_INFO: `/v3/users/1cdd3848291d4a96b17c6cf67b8c356f` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:45.607884 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdccb73-f004-484a-8008-a06dc03ba5a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cdd3848291d4a96b17c6cf67b8c356f)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:45.609905 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdccb73-f004-484a-8008-a06dc03ba5a6 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:45.836916 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4fdccb73-f004-484a-8008-a06dc03ba5a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cdd3848291d4a96b17c6cf67b8c356f'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:45.837693 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4fdccb73-f004-484a-8008-a06dc03ba5a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cdd3848291d4a96b17c6cf67b8c356f'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:45.844855 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4fdccb73-f004-484a-8008-a06dc03ba5a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cdd3848291d4a96b17c6cf67b8c356f'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:45.846915 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4fdccb73-f004-484a-8008-a06dc03ba5a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cdd3848291d4a96b17c6cf67b8c356f'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:45.944448 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4fdccb73-f004-484a-8008-a06dc03ba5a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cdd3848291d4a96b17c6cf67b8c356f'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:45.961711 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1345/2714] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:38:45 2021] DELETE /identity/v3/users/1cdd3848291d4a96b17c6cf67b8c356f => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:38:45.966484 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077a6c9-268f-46a4-b63a-10ab9ce671a1 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:45.967278 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077a6c9-268f-46a4-b63a-10ab9ce671a1 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:45.967278 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077a6c9-268f-46a4-b63a-10ab9ce671a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:45.984863 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-1077a6c9-268f-46a4-b63a-10ab9ce671a1 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:45.986076 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-1077a6c9-268f-46a4-b63a-10ab9ce671a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:46.044542 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1370/2715] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:38:46.055523 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdccb73-f004-484a-8008-a06dc03ba5a6 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:46.056955 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-4fdccb73-f004-484a-8008-a06dc03ba5a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:46.112410 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdccb73-f004-484a-8008-a06dc03ba5a6 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:46.117175 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6c542-01d9-44bf-8ee0-33809c4eb824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:46.117825 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6c542-01d9-44bf-8ee0-33809c4eb824 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:46.118113 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6c542-01d9-44bf-8ee0-33809c4eb824 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:46.118390 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6c542-01d9-44bf-8ee0-33809c4eb824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:46.127933 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6c542-01d9-44bf-8ee0-33809c4eb824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:46.129938 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6c542-01d9-44bf-8ee0-33809c4eb824 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:46.140463 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1346/2716] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:38:46.637562 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077a6c9-268f-46a4-b63a-10ab9ce671a1 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:46.638983 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-1077a6c9-268f-46a4-b63a-10ab9ce671a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:46.653301 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077a6c9-268f-46a4-b63a-10ab9ce671a1 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:46.657821 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d95f62-7c2c-45bf-8f74-7b833358510e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:46.658688 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d95f62-7c2c-45bf-8f74-7b833358510e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:46.658978 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d95f62-7c2c-45bf-8f74-7b833358510e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:46.659260 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d95f62-7c2c-45bf-8f74-7b833358510e admin admin] PATH_INFO: `/v3/projects/fa111e4d8c9d48bbb4e07eee18698f2c` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:46.660478 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d95f62-7c2c-45bf-8f74-7b833358510e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa111e4d8c9d48bbb4e07eee18698f2c)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:46.663565 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d95f62-7c2c-45bf-8f74-7b833358510e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:46.780451 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-c0d95f62-7c2c-45bf-8f74-7b833358510e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa111e4d8c9d48bbb4e07eee18698f2c', 'request_id': 'req-c0d95f62-7c2c-45bf-8f74-7b833358510e'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:46.787796 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-c0d95f62-7c2c-45bf-8f74-7b833358510e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa111e4d8c9d48bbb4e07eee18698f2c', 'request_id': 'req-c0d95f62-7c2c-45bf-8f74-7b833358510e'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:46.892403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-c0d95f62-7c2c-45bf-8f74-7b833358510e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa111e4d8c9d48bbb4e07eee18698f2c', 'request_id': 'req-c0d95f62-7c2c-45bf-8f74-7b833358510e'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:46.905279 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-c0d95f62-7c2c-45bf-8f74-7b833358510e admin admin] The token cache is being invalidate because project fa111e4d8c9d48bbb4e07eee18698f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:38:46.905569 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-c0d95f62-7c2c-45bf-8f74-7b833358510e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:46.906288 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-c0d95f62-7c2c-45bf-8f74-7b833358510e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:46.907960 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1371/2717] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:38:46 2021] DELETE /identity/v3/projects/fa111e4d8c9d48bbb4e07eee18698f2c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:46.912192 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6c542-01d9-44bf-8ee0-33809c4eb824 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:46.922080 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6c542-01d9-44bf-8ee0-33809c4eb824 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:46.984063 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7aaef-3121-4ae1-b579-0e6a2e48ba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:46.984979 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7aaef-3121-4ae1-b579-0e6a2e48ba43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:46.985266 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7aaef-3121-4ae1-b579-0e6a2e48ba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:46.985553 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7aaef-3121-4ae1-b579-0e6a2e48ba43 admin admin] PATH_INFO: `/v3/users/4b787486d3fc4b408f29d3d6d58b43a1` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:46.986827 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7aaef-3121-4ae1-b579-0e6a2e48ba43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b787486d3fc4b408f29d3d6d58b43a1)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:46.988779 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7aaef-3121-4ae1-b579-0e6a2e48ba43 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:47.190675 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4ac7aaef-3121-4ae1-b579-0e6a2e48ba43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b787486d3fc4b408f29d3d6d58b43a1'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:47.190912 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4ac7aaef-3121-4ae1-b579-0e6a2e48ba43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b787486d3fc4b408f29d3d6d58b43a1'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:47.198290 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4ac7aaef-3121-4ae1-b579-0e6a2e48ba43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b787486d3fc4b408f29d3d6d58b43a1'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:47.198936 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4ac7aaef-3121-4ae1-b579-0e6a2e48ba43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b787486d3fc4b408f29d3d6d58b43a1'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:47.275194 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4ac7aaef-3121-4ae1-b579-0e6a2e48ba43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b787486d3fc4b408f29d3d6d58b43a1'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:47.293498 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1347/2718] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:38:46 2021] DELETE /identity/v3/users/4b787486d3fc4b408f29d3d6d58b43a1 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:47.775205 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d95f62-7c2c-45bf-8f74-7b833358510e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:47.776901 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c0d95f62-7c2c-45bf-8f74-7b833358510e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:47.793777 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d95f62-7c2c-45bf-8f74-7b833358510e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:47.855656 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87809983-1e6d-4b23-8be3-c3bda5960ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:47.856522 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809983-1e6d-4b23-8be3-c3bda5960ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:47.856801 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809983-1e6d-4b23-8be3-c3bda5960ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:47.857106 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809983-1e6d-4b23-8be3-c3bda5960ad5 admin admin] PATH_INFO: `/v3/projects/d2e01d5effb34c138e7bf9fe5a3913e4` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:47.858276 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87809983-1e6d-4b23-8be3-c3bda5960ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e01d5effb34c138e7bf9fe5a3913e4)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:47.860164 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87809983-1e6d-4b23-8be3-c3bda5960ad5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:47.990963 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-87809983-1e6d-4b23-8be3-c3bda5960ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e01d5effb34c138e7bf9fe5a3913e4', 'request_id': 'req-87809983-1e6d-4b23-8be3-c3bda5960ad5'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:47.997022 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-87809983-1e6d-4b23-8be3-c3bda5960ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e01d5effb34c138e7bf9fe5a3913e4', 'request_id': 'req-87809983-1e6d-4b23-8be3-c3bda5960ad5'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:48.074633 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-87809983-1e6d-4b23-8be3-c3bda5960ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e01d5effb34c138e7bf9fe5a3913e4', 'request_id': 'req-87809983-1e6d-4b23-8be3-c3bda5960ad5'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:48.086722 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-87809983-1e6d-4b23-8be3-c3bda5960ad5 admin admin] The token cache is being invalidate because project d2e01d5effb34c138e7bf9fe5a3913e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:38:48.087015 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-87809983-1e6d-4b23-8be3-c3bda5960ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:48.087650 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-87809983-1e6d-4b23-8be3-c3bda5960ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:48.089223 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1372/2719] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:38:47 2021] DELETE /identity/v3/projects/d2e01d5effb34c138e7bf9fe5a3913e4 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:48.096011 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742590c-c097-47b8-a01f-6f8ef8e538a4 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:48.097148 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742590c-c097-47b8-a01f-6f8ef8e538a4 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:48.097419 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742590c-c097-47b8-a01f-6f8ef8e538a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:48.121110 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-8742590c-c097-47b8-a01f-6f8ef8e538a4 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:48.122346 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8742590c-c097-47b8-a01f-6f8ef8e538a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:48.182088 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1348/2720] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:48.190105 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5039c55-f5c9-4624-aaeb-8edefc92456f None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:48.190391 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5039c55-f5c9-4624-aaeb-8edefc92456f None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:48.190670 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5039c55-f5c9-4624-aaeb-8edefc92456f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:48.211144 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-b5039c55-f5c9-4624-aaeb-8edefc92456f None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:48.212446 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-b5039c55-f5c9-4624-aaeb-8edefc92456f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:48.220406 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1373/2721] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:48.225370 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742590c-c097-47b8-a01f-6f8ef8e538a4 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:48.235434 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742590c-c097-47b8-a01f-6f8ef8e538a4 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:48.240363 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70258279-76c7-474a-996b-7b91bd8b2629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:48.241047 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70258279-76c7-474a-996b-7b91bd8b2629 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:48.241336 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70258279-76c7-474a-996b-7b91bd8b2629 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:48.241614 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70258279-76c7-474a-996b-7b91bd8b2629 admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:48.242337 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70258279-76c7-474a-996b-7b91bd8b2629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:38:48.242645 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70258279-76c7-474a-996b-7b91bd8b2629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:48.244266 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70258279-76c7-474a-996b-7b91bd8b2629 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:48.256231 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1349/2722] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:38:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:38:48.260624 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5039c55-f5c9-4624-aaeb-8edefc92456f None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:48.270576 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5039c55-f5c9-4624-aaeb-8edefc92456f None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:48.275242 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1fbe3-26c8-473c-ae66-d0d4b7f4d281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:48.275889 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1fbe3-26c8-473c-ae66-d0d4b7f4d281 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:48.276167 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1fbe3-26c8-473c-ae66-d0d4b7f4d281 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:48.276439 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1fbe3-26c8-473c-ae66-d0d4b7f4d281 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:48.277193 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1fbe3-26c8-473c-ae66-d0d4b7f4d281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:48.279085 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1fbe3-26c8-473c-ae66-d0d4b7f4d281 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:48.373455 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1374/2723] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:38:48 2021] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:38:48.377541 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70258279-76c7-474a-996b-7b91bd8b2629 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:48.388195 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70258279-76c7-474a-996b-7b91bd8b2629 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:48.449147 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87468716-0f48-42d0-a7dd-a19888bc260a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:48.449868 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87468716-0f48-42d0-a7dd-a19888bc260a admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:48.450148 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87468716-0f48-42d0-a7dd-a19888bc260a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:48.450420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87468716-0f48-42d0-a7dd-a19888bc260a admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:48.451156 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87468716-0f48-42d0-a7dd-a19888bc260a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:48.453223 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87468716-0f48-42d0-a7dd-a19888bc260a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:48.537182 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1350/2724] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:38:48 2021] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:38:48.541368 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1fbe3-26c8-473c-ae66-d0d4b7f4d281 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:48.551976 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1fbe3-26c8-473c-ae66-d0d4b7f4d281 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:48.556548 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d3783-9ace-49cb-bd83-2abd89261b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:48.557226 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d3783-9ace-49cb-bd83-2abd89261b6f admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:48.557510 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d3783-9ace-49cb-bd83-2abd89261b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:48.557787 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d3783-9ace-49cb-bd83-2abd89261b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:48.558533 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d3783-9ace-49cb-bd83-2abd89261b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:48.560119 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d3783-9ace-49cb-bd83-2abd89261b6f admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:48.571929 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1375/2725] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:48 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:48.575653 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87468716-0f48-42d0-a7dd-a19888bc260a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:48.587130 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87468716-0f48-42d0-a7dd-a19888bc260a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:48.591755 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64b5d6-7502-4f2a-a2a7-ba3a4f6faaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:48.592551 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64b5d6-7502-4f2a-a2a7-ba3a4f6faaae admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:48.592873 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64b5d6-7502-4f2a-a2a7-ba3a4f6faaae admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:48.593171 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64b5d6-7502-4f2a-a2a7-ba3a4f6faaae admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:48.593918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64b5d6-7502-4f2a-a2a7-ba3a4f6faaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:48.595601 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64b5d6-7502-4f2a-a2a7-ba3a4f6faaae admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:48.606987 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1351/2726] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:48 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:48.611244 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d3783-9ace-49cb-bd83-2abd89261b6f admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:48.622713 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d3783-9ace-49cb-bd83-2abd89261b6f admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:48.627706 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5450f76-a3ed-4f76-8ac3-382b5c7efdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:48.628588 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5450f76-a3ed-4f76-8ac3-382b5c7efdb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:48.628899 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5450f76-a3ed-4f76-8ac3-382b5c7efdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:48.629215 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5450f76-a3ed-4f76-8ac3-382b5c7efdb2 admin admin] PATH_INFO: `/v3/projects/3358850d521a4ba6bde7d6ff1a0d1812/users/e8b84d195d204e42b5cb2dc1fee5d53d/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:48.646423 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5450f76-a3ed-4f76-8ac3-382b5c7efdb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3358850d521a4ba6bde7d6ff1a0d1812, user_id=e8b84d195d204e42b5cb2dc1fee5d53d, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:48.649088 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5450f76-a3ed-4f76-8ac3-382b5c7efdb2 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:48.748894 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1376/2727] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:48 2021] PUT /identity/v3/projects/3358850d521a4ba6bde7d6ff1a0d1812/users/e8b84d195d204e42b5cb2dc1fee5d53d/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:38:48.761482 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490770b-6afa-4243-9dd6-c8e09a797e54 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:48.761779 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490770b-6afa-4243-9dd6-c8e09a797e54 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:48.762058 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490770b-6afa-4243-9dd6-c8e09a797e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:48.789788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b490770b-6afa-4243-9dd6-c8e09a797e54 None None] MFA Rules not processed for user `e8b84d195d204e42b5cb2dc1fee5d53d`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:48.791076 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b490770b-6afa-4243-9dd6-c8e09a797e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:48.859873 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1352/2728] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:48 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:48.867783 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5450f76-a3ed-4f76-8ac3-382b5c7efdb2 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:48.869881 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-d5450f76-a3ed-4f76-8ac3-382b5c7efdb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:48.938296 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5450f76-a3ed-4f76-8ac3-382b5c7efdb2 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:48.943255 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ddc13-cd33-4dfb-9393-e485b40644d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:48.943909 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ddc13-cd33-4dfb-9393-e485b40644d4 service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:48.944192 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ddc13-cd33-4dfb-9393-e485b40644d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:48.944469 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ddc13-cd33-4dfb-9393-e485b40644d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:48.953093 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ddc13-cd33-4dfb-9393-e485b40644d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:48.954510 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ddc13-cd33-4dfb-9393-e485b40644d4 service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:48.963404 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1377/2729] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:48 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:38:53.072145 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490770b-6afa-4243-9dd6-c8e09a797e54 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:53.139995 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490770b-6afa-4243-9dd6-c8e09a797e54 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:53.145593 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ce15d-ecfe-47eb-801f-7b255dbaf852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:53.146701 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ce15d-ecfe-47eb-801f-7b255dbaf852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:53.146996 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ce15d-ecfe-47eb-801f-7b255dbaf852 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:53.147265 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ce15d-ecfe-47eb-801f-7b255dbaf852 admin admin] PATH_INFO: `/v3/users/e8b84d195d204e42b5cb2dc1fee5d53d` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:53.148500 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ce15d-ecfe-47eb-801f-7b255dbaf852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8b84d195d204e42b5cb2dc1fee5d53d)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:53.150461 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ce15d-ecfe-47eb-801f-7b255dbaf852 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:53.376156 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ae3ce15d-ecfe-47eb-801f-7b255dbaf852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b84d195d204e42b5cb2dc1fee5d53d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:53.376872 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ae3ce15d-ecfe-47eb-801f-7b255dbaf852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b84d195d204e42b5cb2dc1fee5d53d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:53.384779 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ae3ce15d-ecfe-47eb-801f-7b255dbaf852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b84d195d204e42b5cb2dc1fee5d53d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:53.389054 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ae3ce15d-ecfe-47eb-801f-7b255dbaf852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b84d195d204e42b5cb2dc1fee5d53d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:53.446809 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-ae3ce15d-ecfe-47eb-801f-7b255dbaf852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b84d195d204e42b5cb2dc1fee5d53d'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:53.464429 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1353/2730] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:38:53 2021] DELETE /identity/v3/users/e8b84d195d204e42b5cb2dc1fee5d53d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:53.469014 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e470441-0b63-4467-92f5-797ff3517ee7 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:53.469491 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e470441-0b63-4467-92f5-797ff3517ee7 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:53.469604 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e470441-0b63-4467-92f5-797ff3517ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:53.487527 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-4e470441-0b63-4467-92f5-797ff3517ee7 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:53.489264 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-4e470441-0b63-4467-92f5-797ff3517ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:53.548394 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1378/2731] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:53.558923 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ce15d-ecfe-47eb-801f-7b255dbaf852 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:53.560346 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ae3ce15d-ecfe-47eb-801f-7b255dbaf852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:53.616129 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ce15d-ecfe-47eb-801f-7b255dbaf852 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:53.619960 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61d53a-6e4b-412d-921e-b6f106be8f78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:53.620598 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61d53a-6e4b-412d-921e-b6f106be8f78 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:53.620921 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61d53a-6e4b-412d-921e-b6f106be8f78 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:53.621197 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61d53a-6e4b-412d-921e-b6f106be8f78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:53.631323 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61d53a-6e4b-412d-921e-b6f106be8f78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:53.632757 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61d53a-6e4b-412d-921e-b6f106be8f78 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:53.642173 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1354/2732] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:38:54.090289 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e470441-0b63-4467-92f5-797ff3517ee7 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:54.091721 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-4e470441-0b63-4467-92f5-797ff3517ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:54.105459 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e470441-0b63-4467-92f5-797ff3517ee7 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:54.110206 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44898a-f0fb-4693-9434-ef20c23eaf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:54.111084 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44898a-f0fb-4693-9434-ef20c23eaf86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:54.111364 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44898a-f0fb-4693-9434-ef20c23eaf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:54.111638 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44898a-f0fb-4693-9434-ef20c23eaf86 admin admin] PATH_INFO: `/v3/projects/3358850d521a4ba6bde7d6ff1a0d1812` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:54.113182 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44898a-f0fb-4693-9434-ef20c23eaf86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3358850d521a4ba6bde7d6ff1a0d1812)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:54.115216 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44898a-f0fb-4693-9434-ef20c23eaf86 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:54.230470 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-eb44898a-f0fb-4693-9434-ef20c23eaf86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3358850d521a4ba6bde7d6ff1a0d1812', 'request_id': 'req-eb44898a-f0fb-4693-9434-ef20c23eaf86'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:54.236845 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-eb44898a-f0fb-4693-9434-ef20c23eaf86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3358850d521a4ba6bde7d6ff1a0d1812', 'request_id': 'req-eb44898a-f0fb-4693-9434-ef20c23eaf86'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:54.304120 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-eb44898a-f0fb-4693-9434-ef20c23eaf86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3358850d521a4ba6bde7d6ff1a0d1812', 'request_id': 'req-eb44898a-f0fb-4693-9434-ef20c23eaf86'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:54.314658 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-eb44898a-f0fb-4693-9434-ef20c23eaf86 admin admin] The token cache is being invalidate because project 3358850d521a4ba6bde7d6ff1a0d1812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:38:54.315079 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-eb44898a-f0fb-4693-9434-ef20c23eaf86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:54.315925 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-eb44898a-f0fb-4693-9434-ef20c23eaf86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:38:54.317884 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1379/2733] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:38:54 2021] DELETE /identity/v3/projects/3358850d521a4ba6bde7d6ff1a0d1812 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:54.323974 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f7b50-4dba-49a2-8c7b-f47840d4ff5c None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:54.324532 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f7b50-4dba-49a2-8c7b-f47840d4ff5c None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:54.324532 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f7b50-4dba-49a2-8c7b-f47840d4ff5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:54.342311 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-540f7b50-4dba-49a2-8c7b-f47840d4ff5c None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:54.343751 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-540f7b50-4dba-49a2-8c7b-f47840d4ff5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:54.405326 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1355/2734] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:54.413388 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59811020-c9cf-4b6c-bc26-9bb0d58fde04 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:54.413667 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59811020-c9cf-4b6c-bc26-9bb0d58fde04 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:54.413961 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59811020-c9cf-4b6c-bc26-9bb0d58fde04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:54.434185 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-59811020-c9cf-4b6c-bc26-9bb0d58fde04 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:54.435403 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-59811020-c9cf-4b6c-bc26-9bb0d58fde04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:54.444156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1380/2735] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:54.448611 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f7b50-4dba-49a2-8c7b-f47840d4ff5c None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:54.459311 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f7b50-4dba-49a2-8c7b-f47840d4ff5c None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:54.464475 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf376424-7bf2-40ef-af41-ba68f923899e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:54.465186 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf376424-7bf2-40ef-af41-ba68f923899e admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:54.465469 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf376424-7bf2-40ef-af41-ba68f923899e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:54.465745 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf376424-7bf2-40ef-af41-ba68f923899e admin admin] PATH_INFO: `/v3/domains` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:54.466472 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf376424-7bf2-40ef-af41-ba68f923899e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:38:54.466784 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf376424-7bf2-40ef-af41-ba68f923899e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:54.468363 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf376424-7bf2-40ef-af41-ba68f923899e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:54.480570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1356/2736] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:38:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 01:38:54.484842 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59811020-c9cf-4b6c-bc26-9bb0d58fde04 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:54.494927 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59811020-c9cf-4b6c-bc26-9bb0d58fde04 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:54.501637 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2131b9-8ca8-4919-8f52-e853e193c5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:54.502312 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2131b9-8ca8-4919-8f52-e853e193c5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:54.504675 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2131b9-8ca8-4919-8f52-e853e193c5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:54.504675 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2131b9-8ca8-4919-8f52-e853e193c5c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:54.504675 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2131b9-8ca8-4919-8f52-e853e193c5c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:54.506096 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2131b9-8ca8-4919-8f52-e853e193c5c2 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:54.613141 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1381/2737] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:38:54 2021] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:38:54.617818 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf376424-7bf2-40ef-af41-ba68f923899e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:54.628775 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf376424-7bf2-40ef-af41-ba68f923899e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:54.688517 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d000ef-fe3f-4048-87c1-40c4888bfe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:54.689230 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d000ef-fe3f-4048-87c1-40c4888bfe8d admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:54.689516 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d000ef-fe3f-4048-87c1-40c4888bfe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:54.689797 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d000ef-fe3f-4048-87c1-40c4888bfe8d admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:54.690556 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d000ef-fe3f-4048-87c1-40c4888bfe8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:54.693209 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d000ef-fe3f-4048-87c1-40c4888bfe8d admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:54.846371 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1357/2738] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:38:54 2021] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:38:54.851269 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2131b9-8ca8-4919-8f52-e853e193c5c2 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:54.861383 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2131b9-8ca8-4919-8f52-e853e193c5c2 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:54.866102 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc47c42-bef4-4c0d-9e04-219c243b6fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:54.866725 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc47c42-bef4-4c0d-9e04-219c243b6fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:54.867009 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc47c42-bef4-4c0d-9e04-219c243b6fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:54.867287 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc47c42-bef4-4c0d-9e04-219c243b6fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:54.868013 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc47c42-bef4-4c0d-9e04-219c243b6fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:54.869726 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc47c42-bef4-4c0d-9e04-219c243b6fe3 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:54.880348 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1382/2739] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:54 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:38:54.884643 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d000ef-fe3f-4048-87c1-40c4888bfe8d admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:54.895235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d000ef-fe3f-4048-87c1-40c4888bfe8d admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:54.900057 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955e119-00f8-440e-961a-4f70551d44a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:54.900739 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955e119-00f8-440e-961a-4f70551d44a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:54.901055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955e119-00f8-440e-961a-4f70551d44a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:54.901333 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955e119-00f8-440e-961a-4f70551d44a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:54.902052 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955e119-00f8-440e-961a-4f70551d44a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:54.903651 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955e119-00f8-440e-961a-4f70551d44a3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:54.914247 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1358/2740] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:54 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:54.918493 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc47c42-bef4-4c0d-9e04-219c243b6fe3 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:54.929175 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc47c42-bef4-4c0d-9e04-219c243b6fe3 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:54.933673 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aeda53-8bf0-41ee-ad93-8521f25b9396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:54.934545 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aeda53-8bf0-41ee-ad93-8521f25b9396 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:54.934829 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aeda53-8bf0-41ee-ad93-8521f25b9396 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:54.935105 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aeda53-8bf0-41ee-ad93-8521f25b9396 admin admin] PATH_INFO: `/v3/projects/5b84c3bd6d8340a5bd9aa4f77ff20e91/users/45360969513b4afa8d1362ca9270c642/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:54.949407 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aeda53-8bf0-41ee-ad93-8521f25b9396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b84c3bd6d8340a5bd9aa4f77ff20e91, user_id=45360969513b4afa8d1362ca9270c642, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:54.952052 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aeda53-8bf0-41ee-ad93-8521f25b9396 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:55.042171 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1383/2741] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:54 2021] PUT /identity/v3/projects/5b84c3bd6d8340a5bd9aa4f77ff20e91/users/45360969513b4afa8d1362ca9270c642/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:38:55.059765 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158bc19-d999-4e68-974f-280bf2f973c7 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:55.060054 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158bc19-d999-4e68-974f-280bf2f973c7 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:55.060756 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158bc19-d999-4e68-974f-280bf2f973c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:55.087466 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-6158bc19-d999-4e68-974f-280bf2f973c7 None None] MFA Rules not processed for user `45360969513b4afa8d1362ca9270c642`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:55.088684 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-6158bc19-d999-4e68-974f-280bf2f973c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:55.158037 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1359/2742] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:55 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:55.162841 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aeda53-8bf0-41ee-ad93-8521f25b9396 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:55.234667 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aeda53-8bf0-41ee-ad93-8521f25b9396 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:55.240375 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4569c-7660-4b95-8bf6-1f91fd6db945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:55.241131 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4569c-7660-4b95-8bf6-1f91fd6db945 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:55.241419 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4569c-7660-4b95-8bf6-1f91fd6db945 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:55.241694 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4569c-7660-4b95-8bf6-1f91fd6db945 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:55.242389 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4569c-7660-4b95-8bf6-1f91fd6db945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:55.244319 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4569c-7660-4b95-8bf6-1f91fd6db945 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:55.374417 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1384/2743] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:38:55 2021] POST /identity/v3/projects => generated 377 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:38:55.378612 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158bc19-d999-4e68-974f-280bf2f973c7 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:55.390066 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158bc19-d999-4e68-974f-280bf2f973c7 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:55.455296 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94704be-f9d8-4260-9fa7-87a1a73fb955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:55.456182 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94704be-f9d8-4260-9fa7-87a1a73fb955 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:55.456612 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94704be-f9d8-4260-9fa7-87a1a73fb955 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:55.457070 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94704be-f9d8-4260-9fa7-87a1a73fb955 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:55.458007 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94704be-f9d8-4260-9fa7-87a1a73fb955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:55.460110 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94704be-f9d8-4260-9fa7-87a1a73fb955 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:55.544710 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1360/2744] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:38:55 2021] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:38:55.557693 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4569c-7660-4b95-8bf6-1f91fd6db945 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:55.560715 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4569c-7660-4b95-8bf6-1f91fd6db945 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:55.565973 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e771b4-95b2-4f47-a3b0-118e7b380dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:55.566682 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e771b4-95b2-4f47-a3b0-118e7b380dff admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:55.566968 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e771b4-95b2-4f47-a3b0-118e7b380dff admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:55.567249 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e771b4-95b2-4f47-a3b0-118e7b380dff admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:55.567981 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e771b4-95b2-4f47-a3b0-118e7b380dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:55.569631 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e771b4-95b2-4f47-a3b0-118e7b380dff admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:55.583586 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1385/2745] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:55 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:55.585855 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94704be-f9d8-4260-9fa7-87a1a73fb955 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:55.602035 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94704be-f9d8-4260-9fa7-87a1a73fb955 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:55.607864 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee1e71-1e25-4793-a0e4-8212ede1f6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:55.608655 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee1e71-1e25-4793-a0e4-8212ede1f6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:55.609036 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee1e71-1e25-4793-a0e4-8212ede1f6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:55.609380 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee1e71-1e25-4793-a0e4-8212ede1f6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:55.610178 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee1e71-1e25-4793-a0e4-8212ede1f6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:55.611928 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee1e71-1e25-4793-a0e4-8212ede1f6d0 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:55.627400 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1361/2746] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:55 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:38:55.628091 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e771b4-95b2-4f47-a3b0-118e7b380dff admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:55.638317 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e771b4-95b2-4f47-a3b0-118e7b380dff admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:55.643473 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f8fba-b575-4433-8a56-9d8ecb7b2ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:55.644376 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f8fba-b575-4433-8a56-9d8ecb7b2ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:55.645510 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f8fba-b575-4433-8a56-9d8ecb7b2ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:55.645847 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f8fba-b575-4433-8a56-9d8ecb7b2ad1 admin admin] PATH_INFO: `/v3/projects/3ddc8a04e940413bb999617a940f80de/users/f7897e2fee2b440c967686f00cfc5ab7/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:55.664477 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f8fba-b575-4433-8a56-9d8ecb7b2ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ddc8a04e940413bb999617a940f80de, user_id=f7897e2fee2b440c967686f00cfc5ab7, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:55.667204 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f8fba-b575-4433-8a56-9d8ecb7b2ad1 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:55.779258 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1386/2747] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:55 2021] PUT /identity/v3/projects/3ddc8a04e940413bb999617a940f80de/users/f7897e2fee2b440c967686f00cfc5ab7/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:55.791390 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abbf82-8cea-4cc7-a5af-63eeba1ac8e2 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:55.791768 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abbf82-8cea-4cc7-a5af-63eeba1ac8e2 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:55.799502 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abbf82-8cea-4cc7-a5af-63eeba1ac8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:55.819319 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b4abbf82-8cea-4cc7-a5af-63eeba1ac8e2 None None] MFA Rules not processed for user `f7897e2fee2b440c967686f00cfc5ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:55.820506 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b4abbf82-8cea-4cc7-a5af-63eeba1ac8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:55.884528 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1362/2748] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:55 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:55.889097 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f8fba-b575-4433-8a56-9d8ecb7b2ad1 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:55.922159 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abbf82-8cea-4cc7-a5af-63eeba1ac8e2 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:55.923804 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b4abbf82-8cea-4cc7-a5af-63eeba1ac8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:55.952726 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f8fba-b575-4433-8a56-9d8ecb7b2ad1 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:55.958858 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b952c-83bc-41e6-a4d2-781bcd1f6a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:55.959624 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b952c-83bc-41e6-a4d2-781bcd1f6a47 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:55.959985 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b952c-83bc-41e6-a4d2-781bcd1f6a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:55.960261 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b952c-83bc-41e6-a4d2-781bcd1f6a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:55.961006 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b952c-83bc-41e6-a4d2-781bcd1f6a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:55.962909 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b952c-83bc-41e6-a4d2-781bcd1f6a47 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:55.990416 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abbf82-8cea-4cc7-a5af-63eeba1ac8e2 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:55.995418 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2f21a-69e7-4e60-aaee-bdea721fc700 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd67c0b68ca7349399d9ea9f4a0b2b564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:55.996052 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2f21a-69e7-4e60-aaee-bdea721fc700 service placement] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:55.996331 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2f21a-69e7-4e60-aaee-bdea721fc700 service placement] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:55.996604 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2f21a-69e7-4e60-aaee-bdea721fc700 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:55.998378 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d7a2f21a-69e7-4e60-aaee-bdea721fc700 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:56.010080 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2f21a-69e7-4e60-aaee-bdea721fc700 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:56.011705 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2f21a-69e7-4e60-aaee-bdea721fc700 service placement] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:56.022086 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1363/2749] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:55 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:38:56.042363 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1387/2750] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:38:55 2021] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:38:56.050199 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2f21a-69e7-4e60-aaee-bdea721fc700 service placement] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:56.060766 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2f21a-69e7-4e60-aaee-bdea721fc700 service placement] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:56.117941 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f97cd-e8e6-4214-8ef9-7eb7e17657d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:56.118606 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f97cd-e8e6-4214-8ef9-7eb7e17657d5 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:56.118887 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f97cd-e8e6-4214-8ef9-7eb7e17657d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:56.119160 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f97cd-e8e6-4214-8ef9-7eb7e17657d5 admin admin] PATH_INFO: `/v3/users` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:56.119848 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f97cd-e8e6-4214-8ef9-7eb7e17657d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:56.121779 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f97cd-e8e6-4214-8ef9-7eb7e17657d5 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:56.196260 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1364/2751] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:38:56 2021] POST /identity/v3/users => generated 292 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:38:56.200776 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b952c-83bc-41e6-a4d2-781bcd1f6a47 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:56.211379 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b952c-83bc-41e6-a4d2-781bcd1f6a47 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:56.215876 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68445a07-319a-4cf2-9a5c-950f80724d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:56.234122 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68445a07-319a-4cf2-9a5c-950f80724d5a admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:56.234122 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68445a07-319a-4cf2-9a5c-950f80724d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:56.234122 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68445a07-319a-4cf2-9a5c-950f80724d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:56.234122 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68445a07-319a-4cf2-9a5c-950f80724d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:56.234122 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68445a07-319a-4cf2-9a5c-950f80724d5a admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:56.234122 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1388/2752] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:56 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:38:56.236438 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f97cd-e8e6-4214-8ef9-7eb7e17657d5 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:56.247024 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f97cd-e8e6-4214-8ef9-7eb7e17657d5 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:56.251810 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f733a5-0c67-4622-b72f-1aa163d70e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:56.252685 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f733a5-0c67-4622-b72f-1aa163d70e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:56.253010 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f733a5-0c67-4622-b72f-1aa163d70e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:56.253285 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f733a5-0c67-4622-b72f-1aa163d70e66 admin admin] PATH_INFO: `/v3/projects/03bb93442fe14e17a82910eafcba0c3d/users/5a446dc1c91345ddb49748f524ef2ae0/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:56.268058 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f733a5-0c67-4622-b72f-1aa163d70e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03bb93442fe14e17a82910eafcba0c3d, user_id=5a446dc1c91345ddb49748f524ef2ae0, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:56.270851 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f733a5-0c67-4622-b72f-1aa163d70e66 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:56.337229 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1365/2753] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:56 2021] PUT /identity/v3/projects/03bb93442fe14e17a82910eafcba0c3d/users/5a446dc1c91345ddb49748f524ef2ae0/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:56.341395 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68445a07-319a-4cf2-9a5c-950f80724d5a admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:56.352512 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68445a07-319a-4cf2-9a5c-950f80724d5a admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:56.407590 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92944d88-7e30-4667-97e6-6066803864b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:56.408181 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92944d88-7e30-4667-97e6-6066803864b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:56.408464 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92944d88-7e30-4667-97e6-6066803864b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:56.408741 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92944d88-7e30-4667-97e6-6066803864b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:56.409534 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92944d88-7e30-4667-97e6-6066803864b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:56.411254 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92944d88-7e30-4667-97e6-6066803864b2 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:56.427046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1389/2754] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:38:56 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:38:56.431288 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f733a5-0c67-4622-b72f-1aa163d70e66 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:56.442283 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f733a5-0c67-4622-b72f-1aa163d70e66 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:56.446936 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5698a8c-d4ed-4e7e-89df-b0778f098501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:56.447895 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5698a8c-d4ed-4e7e-89df-b0778f098501 admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:56.448172 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5698a8c-d4ed-4e7e-89df-b0778f098501 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:56.448442 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5698a8c-d4ed-4e7e-89df-b0778f098501 admin admin] PATH_INFO: `/v3/projects/03bb93442fe14e17a82910eafcba0c3d/users/5a446dc1c91345ddb49748f524ef2ae0/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:56.450432 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5698a8c-d4ed-4e7e-89df-b0778f098501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03bb93442fe14e17a82910eafcba0c3d, user_id=5a446dc1c91345ddb49748f524ef2ae0, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:56.453082 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5698a8c-d4ed-4e7e-89df-b0778f098501 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:56.463788 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1366/2755] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:38:56 2021] PUT /identity/v3/projects/03bb93442fe14e17a82910eafcba0c3d/users/5a446dc1c91345ddb49748f524ef2ae0/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:38:56.474021 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5976b-2dd9-4520-9d2f-c947901e92ab None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:56.474311 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5976b-2dd9-4520-9d2f-c947901e92ab None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:56.474589 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5976b-2dd9-4520-9d2f-c947901e92ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:56.502840 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-7fe5976b-2dd9-4520-9d2f-c947901e92ab None None] MFA Rules not processed for user `5a446dc1c91345ddb49748f524ef2ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:56.505381 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-7fe5976b-2dd9-4520-9d2f-c947901e92ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:56.573329 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1390/2756] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:38:56 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:56.583949 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5698a8c-d4ed-4e7e-89df-b0778f098501 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:56.587240 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b5698a8c-d4ed-4e7e-89df-b0778f098501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:56.644742 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5698a8c-d4ed-4e7e-89df-b0778f098501 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:56.648617 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773c456-3908-49eb-b928-2ca90d577920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:56.649405 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773c456-3908-49eb-b928-2ca90d577920 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:56.649726 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773c456-3908-49eb-b928-2ca90d577920 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:56.649998 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773c456-3908-49eb-b928-2ca90d577920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:56.706436 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773c456-3908-49eb-b928-2ca90d577920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:56.708081 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773c456-3908-49eb-b928-2ca90d577920 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:56.717097 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1367/2757] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:56 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:38:58.076818 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfd288-54b4-4126-9686-ee5fd6b7870e None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:58.077338 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfd288-54b4-4126-9686-ee5fd6b7870e None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:58.077452 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfd288-54b4-4126-9686-ee5fd6b7870e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:58.096156 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f1cfd288-54b4-4126-9686-ee5fd6b7870e None None] MFA Rules not processed for user `3f65fb7e73db469f8b171c3126005427`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:58.097363 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f1cfd288-54b4-4126-9686-ee5fd6b7870e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:58.150998 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1391/2758] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 01:38:58 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:58.164244 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773c456-3908-49eb-b928-2ca90d577920 service cinder] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:58.165686 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-0773c456-3908-49eb-b928-2ca90d577920 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:58.232545 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773c456-3908-49eb-b928-2ca90d577920 service cinder] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:58.237870 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6d797-919e-4835-ac80-0ac8ba4f2bc7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48536f4437240b79cf10961de9cc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:58.239250 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6d797-919e-4835-ac80-0ac8ba4f2bc7 service swift] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:58.240031 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6d797-919e-4835-ac80-0ac8ba4f2bc7 service swift] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:58.240031 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6d797-919e-4835-ac80-0ac8ba4f2bc7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:58.247843 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6d797-919e-4835-ac80-0ac8ba4f2bc7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:58.249431 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6d797-919e-4835-ac80-0ac8ba4f2bc7 service swift] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:58.257577 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1368/2759] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 01:38:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 01:38:58.783271 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfd288-54b4-4126-9686-ee5fd6b7870e None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:58.784714 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f1cfd288-54b4-4126-9686-ee5fd6b7870e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:58.796762 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfd288-54b4-4126-9686-ee5fd6b7870e None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:58.800617 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f5086-329d-4d01-a128-dc099ef865ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:58.801498 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f5086-329d-4d01-a128-dc099ef865ea service cinder] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:58.801785 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f5086-329d-4d01-a128-dc099ef865ea service cinder] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:58.802059 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f5086-329d-4d01-a128-dc099ef865ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:58.860583 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f5086-329d-4d01-a128-dc099ef865ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:58.862048 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f5086-329d-4d01-a128-dc099ef865ea service cinder] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:58.872378 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1392/2760] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:38:58 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:38:59.545208 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39ac14-b803-4d30-97b4-d807f6119a8a None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:59.545671 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39ac14-b803-4d30-97b4-d807f6119a8a None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:59.545766 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39ac14-b803-4d30-97b4-d807f6119a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:59.563697 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-eb39ac14-b803-4d30-97b4-d807f6119a8a None None] MFA Rules not processed for user `3f65fb7e73db469f8b171c3126005427`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:38:59.565046 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-eb39ac14-b803-4d30-97b4-d807f6119a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:38:59.572839 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1369/2761] 10.222.0.25 () {58 vars in 1010 bytes} [Fri Aug 27 01:38:59 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:38:59.585544 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f5086-329d-4d01-a128-dc099ef865ea service cinder] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:38:59.597345 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f5086-329d-4d01-a128-dc099ef865ea service cinder] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:38:59.602661 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68894ece-33f9-46f4-a635-9ace23ecf2a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48536f4437240b79cf10961de9cc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:38:59.603291 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68894ece-33f9-46f4-a635-9ace23ecf2a2 service swift] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:38:59.603569 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68894ece-33f9-46f4-a635-9ace23ecf2a2 service swift] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:38:59.603846 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68894ece-33f9-46f4-a635-9ace23ecf2a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:38:59.611702 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68894ece-33f9-46f4-a635-9ace23ecf2a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:38:59.613853 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68894ece-33f9-46f4-a635-9ace23ecf2a2 service swift] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:38:59.622046 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1393/2762] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 01:38:59 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 01:39:00.232308 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686dba2-1f93-4dfa-a71f-408d446dcc40 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:00.232948 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686dba2-1f93-4dfa-a71f-408d446dcc40 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:00.232948 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686dba2-1f93-4dfa-a71f-408d446dcc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:00.250997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-d686dba2-1f93-4dfa-a71f-408d446dcc40 None None] MFA Rules not processed for user `3f65fb7e73db469f8b171c3126005427`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:39:00.252180 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-d686dba2-1f93-4dfa-a71f-408d446dcc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:00.259751 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1370/2763] 10.222.0.25 () {58 vars in 968 bytes} [Fri Aug 27 01:39:00 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:39:00.273159 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68894ece-33f9-46f4-a635-9ace23ecf2a2 service swift] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:00.283576 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68894ece-33f9-46f4-a635-9ace23ecf2a2 service swift] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:00.289606 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94684d-bc24-4a02-866a-ea908b978fd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48536f4437240b79cf10961de9cc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:00.290260 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94684d-bc24-4a02-866a-ea908b978fd9 service swift] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:00.293414 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94684d-bc24-4a02-866a-ea908b978fd9 service swift] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:00.293414 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94684d-bc24-4a02-866a-ea908b978fd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:00.299612 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94684d-bc24-4a02-866a-ea908b978fd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:00.302271 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94684d-bc24-4a02-866a-ea908b978fd9 service swift] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:00.310847 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1394/2764] 10.222.0.25 () {60 vars in 1385 bytes} [Fri Aug 27 01:39:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 01:39:00.466296 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686dba2-1f93-4dfa-a71f-408d446dcc40 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:00.476607 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686dba2-1f93-4dfa-a71f-408d446dcc40 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:00.480277 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c590df1-9a84-49b8-8632-9c8daab85604 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686fb610b1ac47388bffbcfdf8f15907', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:00.481056 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c590df1-9a84-49b8-8632-9c8daab85604 service cinder] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:00.481235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c590df1-9a84-49b8-8632-9c8daab85604 service cinder] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:00.481515 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c590df1-9a84-49b8-8632-9c8daab85604 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:00.496313 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c590df1-9a84-49b8-8632-9c8daab85604 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:00.498004 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c590df1-9a84-49b8-8632-9c8daab85604 service cinder] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:00.508109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1371/2765] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:39:00 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:39:03.234662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94684d-bc24-4a02-866a-ea908b978fd9 service swift] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:03.239854 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-ce94684d-bc24-4a02-866a-ea908b978fd9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:03.302029 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94684d-bc24-4a02-866a-ea908b978fd9 service swift] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:03.306763 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006949c-9406-4d16-bf9a-076064215287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:03.307656 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006949c-9406-4d16-bf9a-076064215287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:03.307980 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006949c-9406-4d16-bf9a-076064215287 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:03.308236 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006949c-9406-4d16-bf9a-076064215287 admin admin] PATH_INFO: `/v3/users/6373463a7b8e4a0c96d35aa88b16cd9b` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:03.309434 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006949c-9406-4d16-bf9a-076064215287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6373463a7b8e4a0c96d35aa88b16cd9b)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:03.314474 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006949c-9406-4d16-bf9a-076064215287 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:03.583796 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-e006949c-9406-4d16-bf9a-076064215287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6373463a7b8e4a0c96d35aa88b16cd9b'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:03.595510 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-e006949c-9406-4d16-bf9a-076064215287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6373463a7b8e4a0c96d35aa88b16cd9b'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:03.604939 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-e006949c-9406-4d16-bf9a-076064215287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6373463a7b8e4a0c96d35aa88b16cd9b'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:03.606488 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-e006949c-9406-4d16-bf9a-076064215287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6373463a7b8e4a0c96d35aa88b16cd9b'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:03.721008 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-e006949c-9406-4d16-bf9a-076064215287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6373463a7b8e4a0c96d35aa88b16cd9b'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:03.727440 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1395/2766] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:39:03 2021] DELETE /identity/v3/users/6373463a7b8e4a0c96d35aa88b16cd9b => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:39:03.731947 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc09e-07fb-47d8-a93f-de3000f7ab8b None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:03.732457 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc09e-07fb-47d8-a93f-de3000f7ab8b None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:03.732562 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc09e-07fb-47d8-a93f-de3000f7ab8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:03.750817 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-3b8fc09e-07fb-47d8-a93f-de3000f7ab8b None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:39:03.752023 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-3b8fc09e-07fb-47d8-a93f-de3000f7ab8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:03.813826 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1372/2767] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:39:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:39:03.824304 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006949c-9406-4d16-bf9a-076064215287 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:03.825792 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-e006949c-9406-4d16-bf9a-076064215287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:03.881085 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006949c-9406-4d16-bf9a-076064215287 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:03.887714 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf4fe9-2ffd-4614-ae49-746e048077fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:03.887714 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf4fe9-2ffd-4614-ae49-746e048077fc service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:03.887714 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf4fe9-2ffd-4614-ae49-746e048077fc service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:03.887714 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf4fe9-2ffd-4614-ae49-746e048077fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:03.903655 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf4fe9-2ffd-4614-ae49-746e048077fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:03.905540 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf4fe9-2ffd-4614-ae49-746e048077fc service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:03.916997 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1396/2768] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:39:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:39:04.306747 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fc09e-07fb-47d8-a93f-de3000f7ab8b None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:04.308236 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-3b8fc09e-07fb-47d8-a93f-de3000f7ab8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:04.320873 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fc09e-07fb-47d8-a93f-de3000f7ab8b None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:04.325853 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffca5a-a068-4d31-86a3-e9f0ebaf75e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:04.327052 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffca5a-a068-4d31-86a3-e9f0ebaf75e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:04.327565 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffca5a-a068-4d31-86a3-e9f0ebaf75e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:04.327850 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffca5a-a068-4d31-86a3-e9f0ebaf75e0 admin admin] PATH_INFO: `/v3/projects/d72e10657fb743329337e869d71860f6` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:04.330171 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffca5a-a068-4d31-86a3-e9f0ebaf75e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d72e10657fb743329337e869d71860f6)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:04.331441 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffca5a-a068-4d31-86a3-e9f0ebaf75e0 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:04.509630 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3dffca5a-a068-4d31-86a3-e9f0ebaf75e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd72e10657fb743329337e869d71860f6', 'request_id': 'req-3dffca5a-a068-4d31-86a3-e9f0ebaf75e0'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:04.516279 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3dffca5a-a068-4d31-86a3-e9f0ebaf75e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd72e10657fb743329337e869d71860f6', 'request_id': 'req-3dffca5a-a068-4d31-86a3-e9f0ebaf75e0'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:04.572621 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3dffca5a-a068-4d31-86a3-e9f0ebaf75e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd72e10657fb743329337e869d71860f6', 'request_id': 'req-3dffca5a-a068-4d31-86a3-e9f0ebaf75e0'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:04.585467 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3dffca5a-a068-4d31-86a3-e9f0ebaf75e0 admin admin] The token cache is being invalidate because project d72e10657fb743329337e869d71860f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:39:04.585467 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3dffca5a-a068-4d31-86a3-e9f0ebaf75e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:04.585860 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3dffca5a-a068-4d31-86a3-e9f0ebaf75e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:04.587497 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1373/2769] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:39:04 2021] DELETE /identity/v3/projects/d72e10657fb743329337e869d71860f6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:39:05.549539 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf4fe9-2ffd-4614-ae49-746e048077fc service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:05.551597 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-45bf4fe9-2ffd-4614-ae49-746e048077fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:05.564779 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf4fe9-2ffd-4614-ae49-746e048077fc service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:05.624606 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de109b0b-1cd6-42e2-ae5c-5549241c9d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:05.625523 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de109b0b-1cd6-42e2-ae5c-5549241c9d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:05.625802 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de109b0b-1cd6-42e2-ae5c-5549241c9d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:05.626082 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de109b0b-1cd6-42e2-ae5c-5549241c9d49 admin admin] PATH_INFO: `/v3/users/45360969513b4afa8d1362ca9270c642` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:05.627307 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de109b0b-1cd6-42e2-ae5c-5549241c9d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45360969513b4afa8d1362ca9270c642)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:05.629860 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de109b0b-1cd6-42e2-ae5c-5549241c9d49 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:05.881830 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-de109b0b-1cd6-42e2-ae5c-5549241c9d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45360969513b4afa8d1362ca9270c642'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:05.893469 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-de109b0b-1cd6-42e2-ae5c-5549241c9d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45360969513b4afa8d1362ca9270c642'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:05.901006 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-de109b0b-1cd6-42e2-ae5c-5549241c9d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45360969513b4afa8d1362ca9270c642'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:05.901932 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-de109b0b-1cd6-42e2-ae5c-5549241c9d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45360969513b4afa8d1362ca9270c642'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:05.966864 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-de109b0b-1cd6-42e2-ae5c-5549241c9d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45360969513b4afa8d1362ca9270c642'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:05.973782 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1397/2770] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:39:05 2021] DELETE /identity/v3/users/45360969513b4afa8d1362ca9270c642 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:39:05.987745 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f040d10-c66a-4732-ba4f-1e082d5da975 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:05.987745 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f040d10-c66a-4732-ba4f-1e082d5da975 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:05.987745 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f040d10-c66a-4732-ba4f-1e082d5da975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:06.005956 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-3f040d10-c66a-4732-ba4f-1e082d5da975 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:39:06.007190 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-3f040d10-c66a-4732-ba4f-1e082d5da975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:06.071884 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1374/2771] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:39:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:39:06.088730 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de109b0b-1cd6-42e2-ae5c-5549241c9d49 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:06.090414 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-de109b0b-1cd6-42e2-ae5c-5549241c9d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:06.147941 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de109b0b-1cd6-42e2-ae5c-5549241c9d49 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:06.151587 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad6689-66cc-4986-8904-b27c5fbc1f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:06.152233 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad6689-66cc-4986-8904-b27c5fbc1f62 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:06.152516 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad6689-66cc-4986-8904-b27c5fbc1f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:06.152792 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad6689-66cc-4986-8904-b27c5fbc1f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:06.162969 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad6689-66cc-4986-8904-b27c5fbc1f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:06.164397 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad6689-66cc-4986-8904-b27c5fbc1f62 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:06.174260 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1398/2772] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:39:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:39:06.666359 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f040d10-c66a-4732-ba4f-1e082d5da975 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:06.667845 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-3f040d10-c66a-4732-ba4f-1e082d5da975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:06.683824 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f040d10-c66a-4732-ba4f-1e082d5da975 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:06.690319 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1d7b2-3bcd-4715-8e28-3622116cfda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:06.691155 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1d7b2-3bcd-4715-8e28-3622116cfda3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:06.691560 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1d7b2-3bcd-4715-8e28-3622116cfda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:06.691741 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1d7b2-3bcd-4715-8e28-3622116cfda3 admin admin] PATH_INFO: `/v3/projects/5b84c3bd6d8340a5bd9aa4f77ff20e91` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:06.693235 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1d7b2-3bcd-4715-8e28-3622116cfda3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b84c3bd6d8340a5bd9aa4f77ff20e91)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:06.695389 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1d7b2-3bcd-4715-8e28-3622116cfda3 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:06.799442 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-62b1d7b2-3bcd-4715-8e28-3622116cfda3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b84c3bd6d8340a5bd9aa4f77ff20e91', 'request_id': 'req-62b1d7b2-3bcd-4715-8e28-3622116cfda3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:06.805328 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-62b1d7b2-3bcd-4715-8e28-3622116cfda3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b84c3bd6d8340a5bd9aa4f77ff20e91', 'request_id': 'req-62b1d7b2-3bcd-4715-8e28-3622116cfda3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:06.884793 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-62b1d7b2-3bcd-4715-8e28-3622116cfda3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b84c3bd6d8340a5bd9aa4f77ff20e91', 'request_id': 'req-62b1d7b2-3bcd-4715-8e28-3622116cfda3'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:06.895832 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-62b1d7b2-3bcd-4715-8e28-3622116cfda3 admin admin] The token cache is being invalidate because project 5b84c3bd6d8340a5bd9aa4f77ff20e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:39:06.896109 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-62b1d7b2-3bcd-4715-8e28-3622116cfda3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:06.896758 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-62b1d7b2-3bcd-4715-8e28-3622116cfda3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:06.898282 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1375/2773] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:39:06 2021] DELETE /identity/v3/projects/5b84c3bd6d8340a5bd9aa4f77ff20e91 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:39:06.902249 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad6689-66cc-4986-8904-b27c5fbc1f62 service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:06.912489 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad6689-66cc-4986-8904-b27c5fbc1f62 service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:06.965207 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e74f1-6b09-4f56-933a-2fcd86ccfb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:06.966055 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e74f1-6b09-4f56-933a-2fcd86ccfb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:06.966332 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e74f1-6b09-4f56-933a-2fcd86ccfb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:06.966603 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e74f1-6b09-4f56-933a-2fcd86ccfb60 admin admin] PATH_INFO: `/v3/users/f7897e2fee2b440c967686f00cfc5ab7` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:06.967759 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e74f1-6b09-4f56-933a-2fcd86ccfb60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7897e2fee2b440c967686f00cfc5ab7)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:06.969682 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e74f1-6b09-4f56-933a-2fcd86ccfb60 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:07.173225 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f85e74f1-6b09-4f56-933a-2fcd86ccfb60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7897e2fee2b440c967686f00cfc5ab7'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:07.185433 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f85e74f1-6b09-4f56-933a-2fcd86ccfb60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7897e2fee2b440c967686f00cfc5ab7'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:07.192989 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f85e74f1-6b09-4f56-933a-2fcd86ccfb60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7897e2fee2b440c967686f00cfc5ab7'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:07.193729 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f85e74f1-6b09-4f56-933a-2fcd86ccfb60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7897e2fee2b440c967686f00cfc5ab7'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:07.320716 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f85e74f1-6b09-4f56-933a-2fcd86ccfb60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7897e2fee2b440c967686f00cfc5ab7'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:07.327055 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1399/2774] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:39:06 2021] DELETE /identity/v3/users/f7897e2fee2b440c967686f00cfc5ab7 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:39:07.750995 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1d7b2-3bcd-4715-8e28-3622116cfda3 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:07.756935 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-62b1d7b2-3bcd-4715-8e28-3622116cfda3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:07.766054 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1d7b2-3bcd-4715-8e28-3622116cfda3 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:07.822175 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dff37-8a5a-4ede-9400-751dc0b5c5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:07.823012 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dff37-8a5a-4ede-9400-751dc0b5c5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:07.823313 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dff37-8a5a-4ede-9400-751dc0b5c5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:07.823582 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dff37-8a5a-4ede-9400-751dc0b5c5fc admin admin] PATH_INFO: `/v3/projects/3ddc8a04e940413bb999617a940f80de` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:07.824742 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dff37-8a5a-4ede-9400-751dc0b5c5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ddc8a04e940413bb999617a940f80de)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:07.826639 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dff37-8a5a-4ede-9400-751dc0b5c5fc admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:07.947071 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-429dff37-8a5a-4ede-9400-751dc0b5c5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ddc8a04e940413bb999617a940f80de', 'request_id': 'req-429dff37-8a5a-4ede-9400-751dc0b5c5fc'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:07.952967 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-429dff37-8a5a-4ede-9400-751dc0b5c5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ddc8a04e940413bb999617a940f80de', 'request_id': 'req-429dff37-8a5a-4ede-9400-751dc0b5c5fc'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:08.010682 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-429dff37-8a5a-4ede-9400-751dc0b5c5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ddc8a04e940413bb999617a940f80de', 'request_id': 'req-429dff37-8a5a-4ede-9400-751dc0b5c5fc'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:08.020570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-429dff37-8a5a-4ede-9400-751dc0b5c5fc admin admin] The token cache is being invalidate because project 3ddc8a04e940413bb999617a940f80de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:39:08.020901 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-429dff37-8a5a-4ede-9400-751dc0b5c5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:08.021521 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-429dff37-8a5a-4ede-9400-751dc0b5c5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:08.023028 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1376/2775] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:39:07 2021] DELETE /identity/v3/projects/3ddc8a04e940413bb999617a940f80de => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:39:08.026988 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e74f1-6b09-4f56-933a-2fcd86ccfb60 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:08.028489 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f85e74f1-6b09-4f56-933a-2fcd86ccfb60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:08.041442 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e74f1-6b09-4f56-933a-2fcd86ccfb60 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:08.095941 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e4351-40a5-4f21-97f5-6c7d124d64cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:08.096809 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e4351-40a5-4f21-97f5-6c7d124d64cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:08.099155 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e4351-40a5-4f21-97f5-6c7d124d64cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:08.099155 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e4351-40a5-4f21-97f5-6c7d124d64cb admin admin] PATH_INFO: `/v3/users/5a446dc1c91345ddb49748f524ef2ae0` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:08.099612 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e4351-40a5-4f21-97f5-6c7d124d64cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a446dc1c91345ddb49748f524ef2ae0)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:08.101618 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e4351-40a5-4f21-97f5-6c7d124d64cb admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:08.294865 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ba4e4351-40a5-4f21-97f5-6c7d124d64cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a446dc1c91345ddb49748f524ef2ae0'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:08.306599 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ba4e4351-40a5-4f21-97f5-6c7d124d64cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a446dc1c91345ddb49748f524ef2ae0'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:08.313452 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ba4e4351-40a5-4f21-97f5-6c7d124d64cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a446dc1c91345ddb49748f524ef2ae0'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:08.314145 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ba4e4351-40a5-4f21-97f5-6c7d124d64cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a446dc1c91345ddb49748f524ef2ae0'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:08.372140 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-ba4e4351-40a5-4f21-97f5-6c7d124d64cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a446dc1c91345ddb49748f524ef2ae0'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:08.378590 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1400/2776] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:39:08 2021] DELETE /identity/v3/users/5a446dc1c91345ddb49748f524ef2ae0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 01:39:08.825730 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dff37-8a5a-4ede-9400-751dc0b5c5fc admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:08.827132 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-429dff37-8a5a-4ede-9400-751dc0b5c5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:08.842841 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dff37-8a5a-4ede-9400-751dc0b5c5fc admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:08.900506 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2a223-e856-4148-887a-cdf6d4c625e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:08.901411 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2a223-e856-4148-887a-cdf6d4c625e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:08.901691 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2a223-e856-4148-887a-cdf6d4c625e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:08.901970 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2a223-e856-4148-887a-cdf6d4c625e6 admin admin] PATH_INFO: `/v3/projects/03bb93442fe14e17a82910eafcba0c3d` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:08.903144 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2a223-e856-4148-887a-cdf6d4c625e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03bb93442fe14e17a82910eafcba0c3d)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:08.905061 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2a223-e856-4148-887a-cdf6d4c625e6 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:09.010196 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-e7f2a223-e856-4148-887a-cdf6d4c625e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03bb93442fe14e17a82910eafcba0c3d', 'request_id': 'req-e7f2a223-e856-4148-887a-cdf6d4c625e6'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:09.016090 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-e7f2a223-e856-4148-887a-cdf6d4c625e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03bb93442fe14e17a82910eafcba0c3d', 'request_id': 'req-e7f2a223-e856-4148-887a-cdf6d4c625e6'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:09.080532 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-e7f2a223-e856-4148-887a-cdf6d4c625e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03bb93442fe14e17a82910eafcba0c3d', 'request_id': 'req-e7f2a223-e856-4148-887a-cdf6d4c625e6'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:09.090565 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-e7f2a223-e856-4148-887a-cdf6d4c625e6 admin admin] The token cache is being invalidate because project 03bb93442fe14e17a82910eafcba0c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:39:09.092847 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-e7f2a223-e856-4148-887a-cdf6d4c625e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:09.092847 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-e7f2a223-e856-4148-887a-cdf6d4c625e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:39:09.093079 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1377/2777] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:39:08 2021] DELETE /identity/v3/projects/03bb93442fe14e17a82910eafcba0c3d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:39:09.098804 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec6bd7-4404-469a-9a11-48fb4444ea69 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:09.099281 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec6bd7-4404-469a-9a11-48fb4444ea69 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:09.099377 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec6bd7-4404-469a-9a11-48fb4444ea69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:09.118974 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-c5ec6bd7-4404-469a-9a11-48fb4444ea69 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:39:09.120186 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c5ec6bd7-4404-469a-9a11-48fb4444ea69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:09.176709 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1401/2778] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:39:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:39:09.184903 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79150a3-7799-4cc3-be7f-7c6d308f1517 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:09.185195 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79150a3-7799-4cc3-be7f-7c6d308f1517 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:09.185470 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79150a3-7799-4cc3-be7f-7c6d308f1517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:09.203856 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-e79150a3-7799-4cc3-be7f-7c6d308f1517 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:39:09.205105 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-e79150a3-7799-4cc3-be7f-7c6d308f1517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:09.213022 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1378/2779] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:39:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:39:09.217147 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec6bd7-4404-469a-9a11-48fb4444ea69 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:09.226783 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec6bd7-4404-469a-9a11-48fb4444ea69 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:09.231314 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5911a7e-a985-42c3-a7aa-40e91bb19fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:09.231960 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5911a7e-a985-42c3-a7aa-40e91bb19fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:09.232242 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5911a7e-a985-42c3-a7aa-40e91bb19fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:09.232516 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5911a7e-a985-42c3-a7aa-40e91bb19fd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:09.233266 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5911a7e-a985-42c3-a7aa-40e91bb19fd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 01:39:09.233585 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5911a7e-a985-42c3-a7aa-40e91bb19fd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:09.235141 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5911a7e-a985-42c3-a7aa-40e91bb19fd5 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:09.246727 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1402/2780] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Aug 27 01:39:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 01:39:09.250795 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79150a3-7799-4cc3-be7f-7c6d308f1517 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:09.260539 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79150a3-7799-4cc3-be7f-7c6d308f1517 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:09.265211 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72404b1-d254-432a-918c-b1b7aa8ffb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:09.265850 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72404b1-d254-432a-918c-b1b7aa8ffb6a admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:09.266135 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72404b1-d254-432a-918c-b1b7aa8ffb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:09.266408 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72404b1-d254-432a-918c-b1b7aa8ffb6a admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:09.267095 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72404b1-d254-432a-918c-b1b7aa8ffb6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:09.268997 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72404b1-d254-432a-918c-b1b7aa8ffb6a admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:09.361965 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1379/2781] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:39:09 2021] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:39:09.366449 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5911a7e-a985-42c3-a7aa-40e91bb19fd5 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:09.376339 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5911a7e-a985-42c3-a7aa-40e91bb19fd5 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:09.431991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7ecd6-a7bd-48aa-9b3c-890103a1dec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:09.432700 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7ecd6-a7bd-48aa-9b3c-890103a1dec6 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:09.433014 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7ecd6-a7bd-48aa-9b3c-890103a1dec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:09.433290 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7ecd6-a7bd-48aa-9b3c-890103a1dec6 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:09.433980 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7ecd6-a7bd-48aa-9b3c-890103a1dec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:09.435866 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7ecd6-a7bd-48aa-9b3c-890103a1dec6 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:09.525909 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1403/2782] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:39:09 2021] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:39:09.529914 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72404b1-d254-432a-918c-b1b7aa8ffb6a admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:09.541377 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72404b1-d254-432a-918c-b1b7aa8ffb6a admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:09.546305 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dcf09-31d6-4971-8c55-0235736702eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:09.546980 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dcf09-31d6-4971-8c55-0235736702eb admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:09.547263 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dcf09-31d6-4971-8c55-0235736702eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:09.547802 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dcf09-31d6-4971-8c55-0235736702eb admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:09.548522 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97dcf09-31d6-4971-8c55-0235736702eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:09.550188 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97dcf09-31d6-4971-8c55-0235736702eb admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:09.561457 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1380/2783] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:39:09 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:39:09.565514 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7ecd6-a7bd-48aa-9b3c-890103a1dec6 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:09.575808 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7ecd6-a7bd-48aa-9b3c-890103a1dec6 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:09.580423 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06d7dc-5eb7-433d-8917-85aab1d568b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:09.581107 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06d7dc-5eb7-433d-8917-85aab1d568b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:09.581386 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06d7dc-5eb7-433d-8917-85aab1d568b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:09.581658 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06d7dc-5eb7-433d-8917-85aab1d568b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:09.582979 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06d7dc-5eb7-433d-8917-85aab1d568b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:09.584619 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06d7dc-5eb7-433d-8917-85aab1d568b4 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:09.594139 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1404/2784] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:39:09 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:39:09.598132 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dcf09-31d6-4971-8c55-0235736702eb admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:09.608026 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dcf09-31d6-4971-8c55-0235736702eb admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:09.612943 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99045c37-b042-46ce-9f98-69021249ee4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:09.613830 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99045c37-b042-46ce-9f98-69021249ee4f admin admin] REQUEST_METHOD: `PUT` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:09.614108 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99045c37-b042-46ce-9f98-69021249ee4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:09.614380 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99045c37-b042-46ce-9f98-69021249ee4f admin admin] PATH_INFO: `/v3/projects/e450a8d39c6c4bc1aa95f2240bf96927/users/a6b922afb576470db214cfe37258a289/roles/681adf4aa4c14ac7a9ce4ac1c261cf93` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:09.628189 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99045c37-b042-46ce-9f98-69021249ee4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e450a8d39c6c4bc1aa95f2240bf96927, user_id=a6b922afb576470db214cfe37258a289, role_id=681adf4aa4c14ac7a9ce4ac1c261cf93)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:09.631528 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99045c37-b042-46ce-9f98-69021249ee4f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:09.743905 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1381/2785] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:39:09 2021] PUT /identity/v3/projects/e450a8d39c6c4bc1aa95f2240bf96927/users/a6b922afb576470db214cfe37258a289/roles/681adf4aa4c14ac7a9ce4ac1c261cf93 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:39:09.749063 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821238a-e2a9-48cb-b497-a3a5164ae022 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:09.749356 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821238a-e2a9-48cb-b497-a3a5164ae022 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:09.755851 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821238a-e2a9-48cb-b497-a3a5164ae022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:09.767584 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-5821238a-e2a9-48cb-b497-a3a5164ae022 None None] MFA Rules not processed for user `d64df7fb530c43779ba7cb0d2f2adf99`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:39:09.768772 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-5821238a-e2a9-48cb-b497-a3a5164ae022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:09.826084 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1405/2786] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:39:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:39:09.836215 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99045c37-b042-46ce-9f98-69021249ee4f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:09.838067 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-99045c37-b042-46ce-9f98-69021249ee4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:09.893609 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99045c37-b042-46ce-9f98-69021249ee4f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:09.897918 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632c2dc-f03d-4d97-80bc-0d94f6469cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:09.898559 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632c2dc-f03d-4d97-80bc-0d94f6469cee service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:09.898851 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632c2dc-f03d-4d97-80bc-0d94f6469cee service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:09.899131 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632c2dc-f03d-4d97-80bc-0d94f6469cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:09.907898 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632c2dc-f03d-4d97-80bc-0d94f6469cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:09.909360 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632c2dc-f03d-4d97-80bc-0d94f6469cee service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:09.919095 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1382/2787] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:39:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:39:15.695994 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af291a1-5d96-4fc6-8d6c-a5eb130833ee None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:15.696520 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af291a1-5d96-4fc6-8d6c-a5eb130833ee None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:15.696608 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af291a1-5d96-4fc6-8d6c-a5eb130833ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:15.749321 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-9af291a1-5d96-4fc6-8d6c-a5eb130833ee None None] MFA Rules not processed for user `a6b922afb576470db214cfe37258a289`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:39:15.750815 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-9af291a1-5d96-4fc6-8d6c-a5eb130833ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:15.835253 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1406/2788] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:39:15 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:39:15.839885 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632c2dc-f03d-4d97-80bc-0d94f6469cee service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:15.853573 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632c2dc-f03d-4d97-80bc-0d94f6469cee service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:15.860987 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b1ffb-430e-4a99-af60-3a8b05681ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:15.861666 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b1ffb-430e-4a99-af60-3a8b05681ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:15.862055 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b1ffb-430e-4a99-af60-3a8b05681ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:15.862437 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b1ffb-430e-4a99-af60-3a8b05681ec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:15.863300 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b1ffb-430e-4a99-af60-3a8b05681ec4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:15.865405 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b1ffb-430e-4a99-af60-3a8b05681ec4 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:16.011360 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1383/2789] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Aug 27 01:39:15 2021] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 01:39:16.015620 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af291a1-5d96-4fc6-8d6c-a5eb130833ee None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:16.029979 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af291a1-5d96-4fc6-8d6c-a5eb130833ee None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:16.096598 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340438b4-dd57-4d54-9a1f-da55364f09a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:16.098516 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340438b4-dd57-4d54-9a1f-da55364f09a0 admin admin] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:16.102064 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340438b4-dd57-4d54-9a1f-da55364f09a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:16.102415 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340438b4-dd57-4d54-9a1f-da55364f09a0 admin admin] PATH_INFO: `/v3/users` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:16.103169 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340438b4-dd57-4d54-9a1f-da55364f09a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:16.107893 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340438b4-dd57-4d54-9a1f-da55364f09a0 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:16.198417 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1407/2790] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Aug 27 01:39:16 2021] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 01:39:16.202954 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b1ffb-430e-4a99-af60-3a8b05681ec4 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:16.215880 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b1ffb-430e-4a99-af60-3a8b05681ec4 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:16.220603 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49200b-5eb5-4a26-8ec4-7391ea848954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:16.221317 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49200b-5eb5-4a26-8ec4-7391ea848954 admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:16.221600 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49200b-5eb5-4a26-8ec4-7391ea848954 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:16.221881 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49200b-5eb5-4a26-8ec4-7391ea848954 admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:16.223195 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49200b-5eb5-4a26-8ec4-7391ea848954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:16.225758 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49200b-5eb5-4a26-8ec4-7391ea848954 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:16.238902 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1384/2791] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:39:16 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 01:39:16.243256 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340438b4-dd57-4d54-9a1f-da55364f09a0 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:16.253998 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340438b4-dd57-4d54-9a1f-da55364f09a0 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:16.258754 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fba09b-a88b-40c4-9fac-caef5ffb916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:16.259625 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fba09b-a88b-40c4-9fac-caef5ffb916e admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:16.259902 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fba09b-a88b-40c4-9fac-caef5ffb916e admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:16.260173 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fba09b-a88b-40c4-9fac-caef5ffb916e admin admin] PATH_INFO: `/v3/projects/4f38c403960e49abbc8bdde7568d4d99/users/7ccf04ad8fa64857af11eeadfb10cbac/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:16.275476 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fba09b-a88b-40c4-9fac-caef5ffb916e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f38c403960e49abbc8bdde7568d4d99, user_id=7ccf04ad8fa64857af11eeadfb10cbac, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:16.278306 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fba09b-a88b-40c4-9fac-caef5ffb916e admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:16.365991 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1408/2792] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:39:16 2021] PUT /identity/v3/projects/4f38c403960e49abbc8bdde7568d4d99/users/7ccf04ad8fa64857af11eeadfb10cbac/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:39:16.371135 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49200b-5eb5-4a26-8ec4-7391ea848954 admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:16.382082 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49200b-5eb5-4a26-8ec4-7391ea848954 admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:16.440153 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcc395-0c1a-4c4f-9be1-086406d24cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:16.441426 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcc395-0c1a-4c4f-9be1-086406d24cba admin admin] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:16.442027 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcc395-0c1a-4c4f-9be1-086406d24cba admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:16.442301 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcc395-0c1a-4c4f-9be1-086406d24cba admin admin] PATH_INFO: `/v3/roles` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:16.443032 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcc395-0c1a-4c4f-9be1-086406d24cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:16.444759 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcc395-0c1a-4c4f-9be1-086406d24cba admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:16.454884 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1385/2793] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Aug 27 01:39:16 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 01:39:16.459599 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fba09b-a88b-40c4-9fac-caef5ffb916e admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:16.470337 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fba09b-a88b-40c4-9fac-caef5ffb916e admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:16.475496 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a4f44-2ab7-4541-ad2d-4f08e6975613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:16.476491 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a4f44-2ab7-4541-ad2d-4f08e6975613 admin admin] REQUEST_METHOD: `PUT` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:16.476859 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a4f44-2ab7-4541-ad2d-4f08e6975613 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:16.477233 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a4f44-2ab7-4541-ad2d-4f08e6975613 admin admin] PATH_INFO: `/v3/projects/4f38c403960e49abbc8bdde7568d4d99/users/7ccf04ad8fa64857af11eeadfb10cbac/roles/faadc5010ffb447ba5280e491c2ea2f5` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:16.479295 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a4f44-2ab7-4541-ad2d-4f08e6975613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f38c403960e49abbc8bdde7568d4d99, user_id=7ccf04ad8fa64857af11eeadfb10cbac, role_id=faadc5010ffb447ba5280e491c2ea2f5)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:16.481978 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a4f44-2ab7-4541-ad2d-4f08e6975613 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:16.493296 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1409/2794] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Aug 27 01:39:16 2021] PUT /identity/v3/projects/4f38c403960e49abbc8bdde7568d4d99/users/7ccf04ad8fa64857af11eeadfb10cbac/roles/faadc5010ffb447ba5280e491c2ea2f5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:39:19.715729 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcc395-0c1a-4c4f-9be1-086406d24cba admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:19.775638 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcc395-0c1a-4c4f-9be1-086406d24cba admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:19.832571 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49d6b2-07f8-4900-a724-136ad397f535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:19.833266 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49d6b2-07f8-4900-a724-136ad397f535 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:19.833548 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49d6b2-07f8-4900-a724-136ad397f535 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:19.833825 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49d6b2-07f8-4900-a724-136ad397f535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:19.835630 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ab49d6b2-07f8-4900-a724-136ad397f535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:19.910789 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49d6b2-07f8-4900-a724-136ad397f535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:19.912329 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49d6b2-07f8-4900-a724-136ad397f535 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:19.923169 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1386/2795] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:39:19 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:39:22.568000 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b4162-b16c-4828-924b-45621e4aba48 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:22.568484 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b4162-b16c-4828-924b-45621e4aba48 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:22.568749 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b4162-b16c-4828-924b-45621e4aba48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:22.635486 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-524b4162-b16c-4828-924b-45621e4aba48 None None] MFA Rules not processed for user `7ccf04ad8fa64857af11eeadfb10cbac`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:39:22.636784 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-524b4162-b16c-4828-924b-45621e4aba48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:22.784334 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1410/2796] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:39:22 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:39:22.796009 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49d6b2-07f8-4900-a724-136ad397f535 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:39:22.797912 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-ab49d6b2-07f8-4900-a724-136ad397f535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:22.915663 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49d6b2-07f8-4900-a724-136ad397f535 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:39:22.925143 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2ada9-f17c-432e-ad67-69e004a383cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:39:22.932565 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2ada9-f17c-432e-ad67-69e004a383cb service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:22.933092 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2ada9-f17c-432e-ad67-69e004a383cb service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:22.933477 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2ada9-f17c-432e-ad67-69e004a383cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:23.011282 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2ada9-f17c-432e-ad67-69e004a383cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:39:23.014198 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2ada9-f17c-432e-ad67-69e004a383cb service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:39:23.024427 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1387/2797] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:39:22 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:39:44.697245 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3d90a-44d2-4b05-ab30-e73d9ca8e2b8 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:39:44.697788 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3d90a-44d2-4b05-ab30-e73d9ca8e2b8 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:39:44.697788 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3d90a-44d2-4b05-ab30-e73d9ca8e2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:39:44.715688 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-cea3d90a-44d2-4b05-ab30-e73d9ca8e2b8 None None] MFA Rules not processed for user `a6b922afb576470db214cfe37258a289`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:39:44.716902 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-cea3d90a-44d2-4b05-ab30-e73d9ca8e2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:39:44.724570 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1411/2798] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:39:44 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:40:02.092678 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2ada9-f17c-432e-ad67-69e004a383cb service nova] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:40:02.094236 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-31f2ada9-f17c-432e-ad67-69e004a383cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:40:02.106402 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2ada9-f17c-432e-ad67-69e004a383cb service nova] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:40:02.110000 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f2679-d754-4359-b5c4-78d2e9e7eb33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:40:02.110631 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f2679-d754-4359-b5c4-78d2e9e7eb33 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:40:02.110907 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f2679-d754-4359-b5c4-78d2e9e7eb33 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:40:02.111179 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f2679-d754-4359-b5c4-78d2e9e7eb33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:40:02.120267 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f2679-d754-4359-b5c4-78d2e9e7eb33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:40:02.121702 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f2679-d754-4359-b5c4-78d2e9e7eb33 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:40:02.131701 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1388/2799] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:40:02 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:40:31.591212 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3d90a-44d2-4b05-ab30-e73d9ca8e2b8 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:40:31.600793 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3d90a-44d2-4b05-ab30-e73d9ca8e2b8 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:40:31.604355 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffd196-5714-43ea-8094-dc64038f4826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:40:31.605077 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffd196-5714-43ea-8094-dc64038f4826 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:40:31.605419 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffd196-5714-43ea-8094-dc64038f4826 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:40:31.605697 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffd196-5714-43ea-8094-dc64038f4826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:40:31.607478 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f8ffd196-5714-43ea-8094-dc64038f4826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:40:31.617883 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffd196-5714-43ea-8094-dc64038f4826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:40:31.619458 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffd196-5714-43ea-8094-dc64038f4826 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:40:31.628065 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1412/2800] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:40:31 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:41:20.044435 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f2679-d754-4359-b5c4-78d2e9e7eb33 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:41:20.053787 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f2679-d754-4359-b5c4-78d2e9e7eb33 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:41:20.057410 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0ca97-533c-402f-87e1-2f10f5689c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:41:20.058034 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0ca97-533c-402f-87e1-2f10f5689c50 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:41:20.058312 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0ca97-533c-402f-87e1-2f10f5689c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:41:20.058582 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0ca97-533c-402f-87e1-2f10f5689c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:41:20.060417 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-cdc0ca97-533c-402f-87e1-2f10f5689c50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:41:20.074194 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0ca97-533c-402f-87e1-2f10f5689c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:41:20.075614 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0ca97-533c-402f-87e1-2f10f5689c50 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:41:20.086449 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1389/2801] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:41:20 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 01:41:21.246899 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffd196-5714-43ea-8094-dc64038f4826 service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:41:21.256169 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffd196-5714-43ea-8094-dc64038f4826 service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:41:21.259750 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6981c48-c266-40bd-b48e-605ba868a56c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:41:21.260381 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6981c48-c266-40bd-b48e-605ba868a56c service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:41:21.260662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6981c48-c266-40bd-b48e-605ba868a56c service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:41:21.260972 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6981c48-c266-40bd-b48e-605ba868a56c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:41:21.262685 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-d6981c48-c266-40bd-b48e-605ba868a56c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:41:21.278428 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6981c48-c266-40bd-b48e-605ba868a56c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:41:21.279854 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6981c48-c266-40bd-b48e-605ba868a56c service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:41:21.293393 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1413/2802] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:41:21 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:41:34.580355 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0ca97-533c-402f-87e1-2f10f5689c50 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:41:34.581767 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-cdc0ca97-533c-402f-87e1-2f10f5689c50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:41:34.648442 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0ca97-533c-402f-87e1-2f10f5689c50 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:41:34.653548 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004ff2d-c335-4b95-a4d5-83359f0f7ab0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd67c0b68ca7349399d9ea9f4a0b2b564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:41:34.654187 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004ff2d-c335-4b95-a4d5-83359f0f7ab0 service placement] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:41:34.654469 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004ff2d-c335-4b95-a4d5-83359f0f7ab0 service placement] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:41:34.654745 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004ff2d-c335-4b95-a4d5-83359f0f7ab0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:41:34.657125 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-3004ff2d-c335-4b95-a4d5-83359f0f7ab0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:41:34.670187 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004ff2d-c335-4b95-a4d5-83359f0f7ab0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:41:34.670187 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004ff2d-c335-4b95-a4d5-83359f0f7ab0 service placement] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:41:34.680240 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1390/2803] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:41:34 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:41:35.574654 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6981c48-c266-40bd-b48e-605ba868a56c service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:41:35.576186 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-d6981c48-c266-40bd-b48e-605ba868a56c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:41:35.590322 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6981c48-c266-40bd-b48e-605ba868a56c service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:41:35.596230 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50652cd-3f7c-4afc-a00a-6751d628bba1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:41:35.596897 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50652cd-3f7c-4afc-a00a-6751d628bba1 service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:41:35.597179 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50652cd-3f7c-4afc-a00a-6751d628bba1 service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:41:35.597448 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50652cd-3f7c-4afc-a00a-6751d628bba1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:41:35.599627 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c50652cd-3f7c-4afc-a00a-6751d628bba1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:41:35.613244 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50652cd-3f7c-4afc-a00a-6751d628bba1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:41:35.614821 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50652cd-3f7c-4afc-a00a-6751d628bba1 service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:41:35.627118 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1414/2804] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:41:35 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:42:01.087265 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004ff2d-c335-4b95-a4d5-83359f0f7ab0 service placement] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:42:01.100009 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004ff2d-c335-4b95-a4d5-83359f0f7ab0 service placement] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:42:01.105570 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5df20-214a-4cd3-b192-567d11e814f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:42:01.106213 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5df20-214a-4cd3-b192-567d11e814f9 service nova] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:42:01.106493 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5df20-214a-4cd3-b192-567d11e814f9 service nova] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:42:01.106773 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5df20-214a-4cd3-b192-567d11e814f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:42:01.108520 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-f1c5df20-214a-4cd3-b192-567d11e814f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:42:01.121363 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5df20-214a-4cd3-b192-567d11e814f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:42:01.122973 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5df20-214a-4cd3-b192-567d11e814f9 service nova] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:42:01.134166 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1391/2805] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:42:01 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:42:02.958296 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382990f-f6ab-49d0-943a-a734be5d6471 None None] REQUEST_METHOD: `POST` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:42:02.958819 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382990f-f6ab-49d0-943a-a734be5d6471 None None] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:42:02.958819 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382990f-f6ab-49d0-943a-a734be5d6471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:42:02.975576 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.auth.core [None req-f382990f-f6ab-49d0-943a-a734be5d6471 None None] MFA Rules not processed for user `a6b922afb576470db214cfe37258a289`. Rule list: `[]` (Enabled: `True`). {{(pid=73678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:42:02.976760 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f382990f-f6ab-49d0-943a-a734be5d6471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:42:02.984121 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1415/2806] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:42:02 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 01:42:03.276930 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5df20-214a-4cd3-b192-567d11e814f9 service nova] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:42:03.286569 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5df20-214a-4cd3-b192-567d11e814f9 service nova] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:42:03.290182 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee3470-b4ec-48f2-8b59-6215d34ba95d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:42:03.290812 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee3470-b4ec-48f2-8b59-6215d34ba95d service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:42:03.291090 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee3470-b4ec-48f2-8b59-6215d34ba95d service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:42:03.291361 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee3470-b4ec-48f2-8b59-6215d34ba95d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:42:03.293128 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-12ee3470-b4ec-48f2-8b59-6215d34ba95d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:42:03.302995 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee3470-b4ec-48f2-8b59-6215d34ba95d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:42:03.304399 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee3470-b4ec-48f2-8b59-6215d34ba95d service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:42:03.312810 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1392/2807] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:42:03 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:43:03.867743 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382990f-f6ab-49d0-943a-a734be5d6471 None None] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:43:03.911445 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382990f-f6ab-49d0-943a-a734be5d6471 None None] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:43:03.917207 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f14f7-6578-46d8-9a4c-ee73a92415d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249a7642a0284dde91a7719f732b2d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:43:03.917857 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f14f7-6578-46d8-9a4c-ee73a92415d0 service nova] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:43:03.918135 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f14f7-6578-46d8-9a4c-ee73a92415d0 service nova] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:43:03.918406 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f14f7-6578-46d8-9a4c-ee73a92415d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:43:03.920480 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-034f14f7-6578-46d8-9a4c-ee73a92415d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:43:03.954300 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f14f7-6578-46d8-9a4c-ee73a92415d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:43:03.955910 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f14f7-6578-46d8-9a4c-ee73a92415d0 service nova] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:43:03.967024 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1416/2808] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:43:03 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:43:16.579273 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee3470-b4ec-48f2-8b59-6215d34ba95d service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:43:16.580683 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-12ee3470-b4ec-48f2-8b59-6215d34ba95d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:43:16.696397 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee3470-b4ec-48f2-8b59-6215d34ba95d service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:43:16.701154 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c4a56-b14b-4787-9c2d-d6b4935b3d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:43:16.702009 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c4a56-b14b-4787-9c2d-d6b4935b3d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:43:16.702292 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c4a56-b14b-4787-9c2d-d6b4935b3d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:43:16.702568 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c4a56-b14b-4787-9c2d-d6b4935b3d8e admin admin] PATH_INFO: `/v3/users/ded8a106d4d64603a7c87306eae430b7` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:43:16.703780 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c4a56-b14b-4787-9c2d-d6b4935b3d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded8a106d4d64603a7c87306eae430b7)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:43:16.705724 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c4a56-b14b-4787-9c2d-d6b4935b3d8e admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:43:16.905709 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-bf5c4a56-b14b-4787-9c2d-d6b4935b3d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded8a106d4d64603a7c87306eae430b7'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:43:16.906400 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-bf5c4a56-b14b-4787-9c2d-d6b4935b3d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded8a106d4d64603a7c87306eae430b7'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:43:16.913081 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-bf5c4a56-b14b-4787-9c2d-d6b4935b3d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded8a106d4d64603a7c87306eae430b7'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:43:16.913711 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-bf5c4a56-b14b-4787-9c2d-d6b4935b3d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded8a106d4d64603a7c87306eae430b7'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:43:16.984012 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-bf5c4a56-b14b-4787-9c2d-d6b4935b3d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded8a106d4d64603a7c87306eae430b7'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:43:17.000846 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1393/2809] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:43:16 2021] DELETE /identity/v3/users/ded8a106d4d64603a7c87306eae430b7 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:43:17.240266 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f14f7-6578-46d8-9a4c-ee73a92415d0 service nova] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:43:17.250263 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f14f7-6578-46d8-9a4c-ee73a92415d0 service nova] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:43:17.305843 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1c0f8-0040-41d9-ba32-870ace409393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:43:17.306727 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c0f8-0040-41d9-ba32-870ace409393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:43:17.307011 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c0f8-0040-41d9-ba32-870ace409393 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:43:17.307314 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c0f8-0040-41d9-ba32-870ace409393 admin admin] PATH_INFO: `/v3/projects/d683ea4300b545fda6f56b5c11ee189c` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:43:17.308509 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1c0f8-0040-41d9-ba32-870ace409393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d683ea4300b545fda6f56b5c11ee189c)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:43:17.310484 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1c0f8-0040-41d9-ba32-870ace409393 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:43:17.420410 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4ed1c0f8-0040-41d9-ba32-870ace409393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd683ea4300b545fda6f56b5c11ee189c', 'request_id': 'req-4ed1c0f8-0040-41d9-ba32-870ace409393'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:43:17.426867 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4ed1c0f8-0040-41d9-ba32-870ace409393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd683ea4300b545fda6f56b5c11ee189c', 'request_id': 'req-4ed1c0f8-0040-41d9-ba32-870ace409393'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:43:17.515200 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4ed1c0f8-0040-41d9-ba32-870ace409393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd683ea4300b545fda6f56b5c11ee189c', 'request_id': 'req-4ed1c0f8-0040-41d9-ba32-870ace409393'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:43:17.525611 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4ed1c0f8-0040-41d9-ba32-870ace409393 admin admin] The token cache is being invalidate because project d683ea4300b545fda6f56b5c11ee189c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:43:17.525893 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4ed1c0f8-0040-41d9-ba32-870ace409393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:43:17.526533 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-4ed1c0f8-0040-41d9-ba32-870ace409393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:43:17.528044 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1417/2810] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:43:17 2021] DELETE /identity/v3/projects/d683ea4300b545fda6f56b5c11ee189c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:43:17.531955 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c4a56-b14b-4787-9c2d-d6b4935b3d8e admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:43:17.533365 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-bf5c4a56-b14b-4787-9c2d-d6b4935b3d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:43:17.546698 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c4a56-b14b-4787-9c2d-d6b4935b3d8e admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:43:17.599688 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39d8b7-db91-4db1-98da-966269bf5b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:43:17.600547 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39d8b7-db91-4db1-98da-966269bf5b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:43:17.600827 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39d8b7-db91-4db1-98da-966269bf5b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:43:17.601127 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39d8b7-db91-4db1-98da-966269bf5b05 admin admin] PATH_INFO: `/v3/users/e3bfcf334f4b4a9bbacb09949fca8d65` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:43:17.602292 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39d8b7-db91-4db1-98da-966269bf5b05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3bfcf334f4b4a9bbacb09949fca8d65)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:43:17.604181 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39d8b7-db91-4db1-98da-966269bf5b05 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:43:17.770651 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-dd39d8b7-db91-4db1-98da-966269bf5b05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3bfcf334f4b4a9bbacb09949fca8d65'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:43:17.771258 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-dd39d8b7-db91-4db1-98da-966269bf5b05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3bfcf334f4b4a9bbacb09949fca8d65'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:43:17.777861 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-dd39d8b7-db91-4db1-98da-966269bf5b05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3bfcf334f4b4a9bbacb09949fca8d65'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:43:17.778468 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-dd39d8b7-db91-4db1-98da-966269bf5b05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3bfcf334f4b4a9bbacb09949fca8d65'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:43:17.832191 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-dd39d8b7-db91-4db1-98da-966269bf5b05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3bfcf334f4b4a9bbacb09949fca8d65'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:43:17.849531 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1394/2811] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:43:17 2021] DELETE /identity/v3/users/e3bfcf334f4b4a9bbacb09949fca8d65 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:43:18.093976 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1c0f8-0040-41d9-ba32-870ace409393 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:43:18.095511 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-4ed1c0f8-0040-41d9-ba32-870ace409393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:43:18.108876 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1c0f8-0040-41d9-ba32-870ace409393 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:43:18.164075 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2fa69-418e-4c98-9a12-e7384d850191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:43:18.164962 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2fa69-418e-4c98-9a12-e7384d850191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:43:18.165239 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2fa69-418e-4c98-9a12-e7384d850191 admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:43:18.165505 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2fa69-418e-4c98-9a12-e7384d850191 admin admin] PATH_INFO: `/v3/projects/5300ebf3b4fe4d50a207577cae0856a2` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:43:18.166667 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2fa69-418e-4c98-9a12-e7384d850191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5300ebf3b4fe4d50a207577cae0856a2)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:43:18.168798 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2fa69-418e-4c98-9a12-e7384d850191 admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:43:18.279949 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f4c2fa69-418e-4c98-9a12-e7384d850191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5300ebf3b4fe4d50a207577cae0856a2', 'request_id': 'req-f4c2fa69-418e-4c98-9a12-e7384d850191'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:43:18.286069 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f4c2fa69-418e-4c98-9a12-e7384d850191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5300ebf3b4fe4d50a207577cae0856a2', 'request_id': 'req-f4c2fa69-418e-4c98-9a12-e7384d850191'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:43:18.366472 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f4c2fa69-418e-4c98-9a12-e7384d850191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5300ebf3b4fe4d50a207577cae0856a2', 'request_id': 'req-f4c2fa69-418e-4c98-9a12-e7384d850191'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:43:18.376692 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f4c2fa69-418e-4c98-9a12-e7384d850191 admin admin] The token cache is being invalidate because project 5300ebf3b4fe4d50a207577cae0856a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:43:18.378602 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f4c2fa69-418e-4c98-9a12-e7384d850191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:43:18.378602 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-f4c2fa69-418e-4c98-9a12-e7384d850191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:43:18.379131 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1418/2812] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:43:18 2021] DELETE /identity/v3/projects/5300ebf3b4fe4d50a207577cae0856a2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:43:57.419079 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f415b9-e304-40d0-8372-be0d436bce16 None None] REQUEST_METHOD: `POST` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:43:57.419508 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f415b9-e304-40d0-8372-be0d436bce16 None None] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:43:57.419657 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f415b9-e304-40d0-8372-be0d436bce16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:43:57.437430 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.auth.core [None req-b7f415b9-e304-40d0-8372-be0d436bce16 None None] MFA Rules not processed for user `a6b922afb576470db214cfe37258a289`. Rule list: `[]` (Enabled: `True`). {{(pid=73679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 01:43:57.438614 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b7f415b9-e304-40d0-8372-be0d436bce16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:43:57.490385 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1395/2813] 10.222.0.25 () {58 vars in 958 bytes} [Fri Aug 27 01:43:57 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 01:43:59.598327 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2fa69-418e-4c98-9a12-e7384d850191 admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:43:59.600360 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-f4c2fa69-418e-4c98-9a12-e7384d850191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:43:59.689445 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2fa69-418e-4c98-9a12-e7384d850191 admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:43:59.694720 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946fde9-7d2d-4574-8177-5458ddde956e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd67c0b68ca7349399d9ea9f4a0b2b564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:43:59.695379 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946fde9-7d2d-4574-8177-5458ddde956e service placement] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:43:59.695662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946fde9-7d2d-4574-8177-5458ddde956e service placement] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:43:59.695936 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946fde9-7d2d-4574-8177-5458ddde956e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:43:59.697811 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-9946fde9-7d2d-4574-8177-5458ddde956e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:43:59.709630 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946fde9-7d2d-4574-8177-5458ddde956e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:43:59.711205 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946fde9-7d2d-4574-8177-5458ddde956e service placement] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:43:59.721767 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1419/2814] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:43:59 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:45:37.556354 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f415b9-e304-40d0-8372-be0d436bce16 None None] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:45:37.558733 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-b7f415b9-e304-40d0-8372-be0d436bce16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:45:37.632759 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f415b9-e304-40d0-8372-be0d436bce16 None None] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:45:37.636797 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1023d-f286-45f0-9bcb-12d2a8eca651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:45:37.637505 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1023d-f286-45f0-9bcb-12d2a8eca651 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:45:37.637811 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1023d-f286-45f0-9bcb-12d2a8eca651 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:45:37.638093 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1023d-f286-45f0-9bcb-12d2a8eca651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:45:37.639883 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-88d1023d-f286-45f0-9bcb-12d2a8eca651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:45:37.649296 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1023d-f286-45f0-9bcb-12d2a8eca651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:45:37.650712 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1023d-f286-45f0-9bcb-12d2a8eca651 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:45:37.658946 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1396/2815] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:45:37 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:45:47.270708 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946fde9-7d2d-4574-8177-5458ddde956e service placement] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:45:47.280584 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946fde9-7d2d-4574-8177-5458ddde956e service placement] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:45:47.284169 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e51cb8-3d36-4c05-8c8f-55e42dee1ec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:45:47.284808 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e51cb8-3d36-4c05-8c8f-55e42dee1ec1 service neutron] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:45:47.285121 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e51cb8-3d36-4c05-8c8f-55e42dee1ec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:45:47.285397 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e51cb8-3d36-4c05-8c8f-55e42dee1ec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:45:47.287261 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c4e51cb8-3d36-4c05-8c8f-55e42dee1ec1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:45:47.298365 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e51cb8-3d36-4c05-8c8f-55e42dee1ec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:45:47.299765 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e51cb8-3d36-4c05-8c8f-55e42dee1ec1 service neutron] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:45:47.308262 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1420/2816] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:45:47 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:46:02.365469 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1023d-f286-45f0-9bcb-12d2a8eca651 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:46:02.374690 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1023d-f286-45f0-9bcb-12d2a8eca651 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:46:02.378432 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28ec51-5566-42c8-a1a6-4a2e7de05ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2182e4d74047a399e7ffea63e7ce6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:46:02.379059 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28ec51-5566-42c8-a1a6-4a2e7de05ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:46:02.379337 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28ec51-5566-42c8-a1a6-4a2e7de05ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:46:02.379660 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28ec51-5566-42c8-a1a6-4a2e7de05ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:46:02.381420 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-8d28ec51-5566-42c8-a1a6-4a2e7de05ab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:46:02.445254 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28ec51-5566-42c8-a1a6-4a2e7de05ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:46:02.446681 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28ec51-5566-42c8-a1a6-4a2e7de05ab8 service neutron] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:46:02.456848 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1397/2817] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:46:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 01:46:09.622942 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e51cb8-3d36-4c05-8c8f-55e42dee1ec1 service neutron] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:46:09.624388 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-c4e51cb8-3d36-4c05-8c8f-55e42dee1ec1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:46:09.639874 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e51cb8-3d36-4c05-8c8f-55e42dee1ec1 service neutron] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:46:09.644576 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19a439-c843-4d47-bd1d-aa7ce27b089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:46:09.645478 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19a439-c843-4d47-bd1d-aa7ce27b089d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:46:09.645827 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19a439-c843-4d47-bd1d-aa7ce27b089d admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:46:09.646083 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19a439-c843-4d47-bd1d-aa7ce27b089d admin admin] PATH_INFO: `/v3/users/a6b922afb576470db214cfe37258a289` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:46:09.647293 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19a439-c843-4d47-bd1d-aa7ce27b089d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b922afb576470db214cfe37258a289)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:46:09.649223 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19a439-c843-4d47-bd1d-aa7ce27b089d admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:46:09.852489 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-7e19a439-c843-4d47-bd1d-aa7ce27b089d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b922afb576470db214cfe37258a289'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:46:09.864195 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-7e19a439-c843-4d47-bd1d-aa7ce27b089d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b922afb576470db214cfe37258a289'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:46:09.870799 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-7e19a439-c843-4d47-bd1d-aa7ce27b089d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b922afb576470db214cfe37258a289'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:46:09.871466 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-7e19a439-c843-4d47-bd1d-aa7ce27b089d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b922afb576470db214cfe37258a289'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:46:09.946123 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-7e19a439-c843-4d47-bd1d-aa7ce27b089d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b922afb576470db214cfe37258a289'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:46:09.952914 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1421/2818] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:46:09 2021] DELETE /identity/v3/users/a6b922afb576470db214cfe37258a289 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:46:10.216107 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28ec51-5566-42c8-a1a6-4a2e7de05ab8 service neutron] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:46:10.227721 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28ec51-5566-42c8-a1a6-4a2e7de05ab8 service neutron] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:46:10.285528 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4250dc-db36-48f7-b419-b145daefb78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:46:10.286390 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4250dc-db36-48f7-b419-b145daefb78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:46:10.286672 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4250dc-db36-48f7-b419-b145daefb78f admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:46:10.286950 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4250dc-db36-48f7-b419-b145daefb78f admin admin] PATH_INFO: `/v3/projects/e450a8d39c6c4bc1aa95f2240bf96927` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:46:10.288144 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4250dc-db36-48f7-b419-b145daefb78f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e450a8d39c6c4bc1aa95f2240bf96927)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:46:10.290334 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4250dc-db36-48f7-b419-b145daefb78f admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:46:10.385343 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3c4250dc-db36-48f7-b419-b145daefb78f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e450a8d39c6c4bc1aa95f2240bf96927', 'request_id': 'req-3c4250dc-db36-48f7-b419-b145daefb78f'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:46:10.392077 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3c4250dc-db36-48f7-b419-b145daefb78f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e450a8d39c6c4bc1aa95f2240bf96927', 'request_id': 'req-3c4250dc-db36-48f7-b419-b145daefb78f'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:46:10.449218 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3c4250dc-db36-48f7-b419-b145daefb78f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e450a8d39c6c4bc1aa95f2240bf96927', 'request_id': 'req-3c4250dc-db36-48f7-b419-b145daefb78f'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:46:10.465314 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3c4250dc-db36-48f7-b419-b145daefb78f admin admin] The token cache is being invalidate because project e450a8d39c6c4bc1aa95f2240bf96927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:46:10.465602 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3c4250dc-db36-48f7-b419-b145daefb78f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:46:10.466581 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-3c4250dc-db36-48f7-b419-b145daefb78f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:46:10.468140 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1398/2819] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:46:10 2021] DELETE /identity/v3/projects/e450a8d39c6c4bc1aa95f2240bf96927 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:46:10.472183 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19a439-c843-4d47-bd1d-aa7ce27b089d admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:46:10.473583 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-7e19a439-c843-4d47-bd1d-aa7ce27b089d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:46:10.487032 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19a439-c843-4d47-bd1d-aa7ce27b089d admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:46:10.541520 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cd38f-9440-43ba-8455-095d50b3fb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:46:10.542381 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cd38f-9440-43ba-8455-095d50b3fb7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:46:10.542662 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cd38f-9440-43ba-8455-095d50b3fb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:46:10.542936 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cd38f-9440-43ba-8455-095d50b3fb7c admin admin] PATH_INFO: `/v3/users/7ccf04ad8fa64857af11eeadfb10cbac` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:46:10.544634 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cd38f-9440-43ba-8455-095d50b3fb7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ccf04ad8fa64857af11eeadfb10cbac)` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:46:10.546569 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cd38f-9440-43ba-8455-095d50b3fb7c admin admin] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:46:10.681637 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-780cd38f-9440-43ba-8455-095d50b3fb7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ccf04ad8fa64857af11eeadfb10cbac'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:46:10.694793 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-780cd38f-9440-43ba-8455-095d50b3fb7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ccf04ad8fa64857af11eeadfb10cbac'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:46:10.702427 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-780cd38f-9440-43ba-8455-095d50b3fb7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ccf04ad8fa64857af11eeadfb10cbac'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:46:10.703841 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-780cd38f-9440-43ba-8455-095d50b3fb7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ccf04ad8fa64857af11eeadfb10cbac'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:46:10.826353 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.notifications [None req-780cd38f-9440-43ba-8455-095d50b3fb7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ccf04ad8fa64857af11eeadfb10cbac'} {{(pid=73678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:46:10.833210 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1422/2820] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Aug 27 01:46:10 2021] DELETE /identity/v3/users/7ccf04ad8fa64857af11eeadfb10cbac => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:46:11.096366 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4250dc-db36-48f7-b419-b145daefb78f admin admin] Authenticating user token {{(pid=73679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:46:11.097950 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.fernet_utils [None req-3c4250dc-db36-48f7-b419-b145daefb78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:46:11.111009 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4250dc-db36-48f7-b419-b145daefb78f admin admin] Validating token access rules against request {{(pid=73679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:46:11.166954 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edecd2f-0633-4fae-ab4f-e458360eea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64df7fb530c43779ba7cb0d2f2adf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9904079a3e94900bd545a99cd672ff0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:46:11.167858 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edecd2f-0633-4fae-ab4f-e458360eea23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:46:11.168144 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edecd2f-0633-4fae-ab4f-e458360eea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:46:11.168418 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edecd2f-0633-4fae-ab4f-e458360eea23 admin admin] PATH_INFO: `/v3/projects/4f38c403960e49abbc8bdde7568d4d99` {{(pid=73679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:46:11.169638 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edecd2f-0633-4fae-ab4f-e458360eea23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f38c403960e49abbc8bdde7568d4d99)` {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:46:11.171560 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edecd2f-0633-4fae-ab4f-e458360eea23 admin admin] RBAC: Authorization granted {{(pid=73679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:46:11.300134 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4edecd2f-0633-4fae-ab4f-e458360eea23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f38c403960e49abbc8bdde7568d4d99', 'request_id': 'req-4edecd2f-0633-4fae-ab4f-e458360eea23'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:46:11.306422 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4edecd2f-0633-4fae-ab4f-e458360eea23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f38c403960e49abbc8bdde7568d4d99', 'request_id': 'req-4edecd2f-0633-4fae-ab4f-e458360eea23'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:46:11.379673 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4edecd2f-0633-4fae-ab4f-e458360eea23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f38c403960e49abbc8bdde7568d4d99', 'request_id': 'req-4edecd2f-0633-4fae-ab4f-e458360eea23'} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:46:11.390307 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4edecd2f-0633-4fae-ab4f-e458360eea23 admin admin] The token cache is being invalidate because project 4f38c403960e49abbc8bdde7568d4d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 01:46:11.390589 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4edecd2f-0633-4fae-ab4f-e458360eea23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:46:11.391204 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: DEBUG keystone.notifications [None req-4edecd2f-0633-4fae-ab4f-e458360eea23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 01:46:11.392739 dv-cinder-759169-3-iscsi devstack@keystone.service[73679]: [pid: 73679|app: 0|req: 1399/2821] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Aug 27 01:46:11 2021] DELETE /identity/v3/projects/4f38c403960e49abbc8bdde7568d4d99 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 01:49:40.815405 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cd38f-9440-43ba-8455-095d50b3fb7c admin admin] Authenticating user token {{(pid=73678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 01:49:40.816924 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-780cd38f-9440-43ba-8455-095d50b3fb7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:49:40.883592 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cd38f-9440-43ba-8455-095d50b3fb7c admin admin] Validating token access rules against request {{(pid=73678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 01:49:40.941711 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d643d0-640a-4fcc-a752-e2bb040e8633 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd67c0b68ca7349399d9ea9f4a0b2b564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0094d4fd0a114a2cbf5919f2a0e88e82', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 01:49:40.942274 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d643d0-640a-4fcc-a752-e2bb040e8633 service placement] REQUEST_METHOD: `GET` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 01:49:40.942558 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d643d0-640a-4fcc-a752-e2bb040e8633 service placement] SCRIPT_NAME: `/identity` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 01:49:40.942829 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d643d0-640a-4fcc-a752-e2bb040e8633 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 01:49:40.944560 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.fernet_utils [None req-82d643d0-640a-4fcc-a752-e2bb040e8633 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 01:49:40.956237 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d643d0-640a-4fcc-a752-e2bb040e8633 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 01:49:40.957833 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d643d0-640a-4fcc-a752-e2bb040e8633 service placement] RBAC: Authorization granted {{(pid=73678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 01:49:40.967723 dv-cinder-759169-3-iscsi devstack@keystone.service[73678]: [pid: 73678|app: 0|req: 1423/2822] 10.222.0.25 () {60 vars in 1366 bytes} [Fri Aug 27 01:49:40 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)